2023-12-19T05:21:48.742 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T05:21:48.742 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495666 --verbose --name rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi --owner scheduled_rishabh@teuthology --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} -- /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495666/orig.config.yaml 2023-12-19T05:21:48.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T05:21:48.861 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495666 branch: rishabh-mdscap-reef description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} email: null first_in_suite: false job_id: '7495666' kernel: client: branch: testing flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-mdscap-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mdscap-reef sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 9974 sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c sleep_before_teardown: 0 subset: 301/512 suite: fs suite_branch: rishabh-mdscap-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNKYPxCG5tfyB7VJv1zQilOS7o1Qd6nKauCYBYgHZDXUtgFB2X4aazON73bL3PW+CoFRVbQXuaczqAM6dqGJJ9o= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGM8PnFWmnVtm4CsgmmeHNSXUyIbfYxX5Flw1cdrqGhFn1cJL0LRNzMSisn5eyiQspNCc6Z19PWNoXpQ1a25vDA= smithi188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOi3SwN1u8ImHtE7fhfdgUeNPv7jH8ti5mSueEPNoTZcb5Bpm4LqDDMJqC+iolCegUGgDWvL6junwJVdA2ZXFA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-19_05:09:22 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-19T05:21:48.861 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa; will attempt to use it 2023-12-19T05:21:48.861 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa/tasks 2023-12-19T05:21:48.862 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-19T05:21:48.863 INFO:teuthology.task.internal:Checking packages... 2023-12-19T05:21:48.886 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '24e2e32ab893c11f7e31ee84381b2f961d1b317c' 2023-12-19T05:21:48.886 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-19T05:21:48.886 INFO:teuthology.packaging:ref: None 2023-12-19T05:21:48.886 INFO:teuthology.packaging:tag: None 2023-12-19T05:21:48.886 INFO:teuthology.packaging:branch: rishabh-mdscap-reef 2023-12-19T05:21:48.886 INFO:teuthology.packaging:sha1: 24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T05:21:48.887 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-mdscap-reef 2023-12-19T05:21:49.026 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-1377.g24e2e32a 2023-12-19T05:21:49.027 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-19T05:21:49.034 INFO:teuthology.task.internal:no buildpackages task found 2023-12-19T05:21:49.034 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-19T05:21:49.055 INFO:teuthology.task.internal:Saving configuration 2023-12-19T05:21:49.074 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-19T05:21:49.079 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T05:21:49.101 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495666', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 05:10:41.773288', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNKYPxCG5tfyB7VJv1zQilOS7o1Qd6nKauCYBYgHZDXUtgFB2X4aazON73bL3PW+CoFRVbQXuaczqAM6dqGJJ9o='} 2023-12-19T05:21:49.125 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495666', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 05:10:41.774872', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGM8PnFWmnVtm4CsgmmeHNSXUyIbfYxX5Flw1cdrqGhFn1cJL0LRNzMSisn5eyiQspNCc6Z19PWNoXpQ1a25vDA='} 2023-12-19T05:21:49.148 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495666', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 05:10:41.771583', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOi3SwN1u8ImHtE7fhfdgUeNPv7jH8ti5mSueEPNoTZcb5Bpm4LqDDMJqC+iolCegUGgDWvL6junwJVdA2ZXFA='} 2023-12-19T05:21:49.148 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-19T05:21:49.154 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-12-19T05:21:49.154 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-12-19T05:21:49.154 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['client.0'] 2023-12-19T05:21:49.154 INFO:teuthology.run_tasks:Running task console_log... 2023-12-19T05:21:49.263 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9282d9fdc0>, signals=[15]) 2023-12-19T05:21:49.264 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-19T05:21:49.272 INFO:teuthology.task.internal:Opening connections... 2023-12-19T05:21:49.273 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2023-12-19T05:21:49.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:21:49.359 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2023-12-19T05:21:49.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:21:49.443 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2023-12-19T05:21:49.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:21:49.529 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-19T05:21:49.535 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2023-12-19T05:21:49.554 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2023-12-19T05:21:49.554 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-12-19T05:21:49.611 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream" 2023-12-19T05:21:49.611 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="9" 2023-12-19T05:21:49.611 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos" 2023-12-19T05:21:49.611 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora" 2023-12-19T05:21:49.612 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="9" 2023-12-19T05:21:49.612 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el9" 2023-12-19T05:21:49.612 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T05:21:49.612 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-12-19T05:21:49.612 INFO:teuthology.orchestra.run.smithi120.stdout:LOGO="fedora-logo-icon" 2023-12-19T05:21:49.612 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T05:21:49.612 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/" 2023-12-19T05:21:49.612 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:21:49.612 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T05:21:49.612 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T05:21:49.613 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-12-19T05:21:49.634 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2023-12-19T05:21:49.653 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2023-12-19T05:21:49.653 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2023-12-19T05:21:49.710 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2023-12-19T05:21:49.710 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2023-12-19T05:21:49.710 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2023-12-19T05:21:49.710 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2023-12-19T05:21:49.710 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2023-12-19T05:21:49.710 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2023-12-19T05:21:49.711 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T05:21:49.711 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2023-12-19T05:21:49.711 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2023-12-19T05:21:49.711 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T05:21:49.711 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2023-12-19T05:21:49.711 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:21:49.711 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T05:21:49.711 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T05:21:49.711 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2023-12-19T05:21:49.734 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2023-12-19T05:21:49.753 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2023-12-19T05:21:49.753 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-12-19T05:21:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2023-12-19T05:21:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2023-12-19T05:21:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2023-12-19T05:21:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2023-12-19T05:21:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2023-12-19T05:21:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2023-12-19T05:21:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-19T05:21:49.810 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-12-19T05:21:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2023-12-19T05:21:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-19T05:21:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2023-12-19T05:21:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-19T05:21:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-19T05:21:49.811 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-19T05:21:49.811 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-12-19T05:21:49.834 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-19T05:21:49.844 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-19T05:21:49.850 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-19T05:21:49.850 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2023-12-19T05:21:49.853 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2023-12-19T05:21:49.855 DEBUG:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2023-12-19T05:21:49.870 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-19T05:21:49.877 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-19T05:21:49.877 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2023-12-19T05:21:49.909 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2023-12-19T05:21:49.911 DEBUG:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2023-12-19T05:21:49.950 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-19T05:21:50.031 INFO:teuthology.run_tasks:Running task kernel... 2023-12-19T05:21:50.045 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-19T05:21:50.045 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-12-19T05:21:50.045 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-12-19T05:21:50.045 DEBUG:teuthology.orchestra.run.smithi188:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T05:21:50.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:21:50.061 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-19T05:21:50.479 DEBUG:teuthology.task.kernel:sha1 for client.0 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T05:21:50.479 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T05:21:50.479 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2023-12-19T05:21:50.496 INFO:teuthology.orchestra.run.smithi188.stdout:5.14.0-361.el9.x86_64 2023-12-19T05:21:50.496 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T05:21:50.497 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T05:21:50.497 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum upgrade -y linux-firmware 2023-12-19T05:21:52.937 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-12-19T05:21:54.921 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - BaseOS 2.2 MB/s | 2.0 MB 00:00 2023-12-19T05:21:56.061 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 7.9 MB 00:00 2023-12-19T05:22:00.045 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 18 MB 00:03 2023-12-19T05:22:04.995 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 5.8 MB 00:01 2023-12-19T05:22:06.521 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 15 kB 00:00 2023-12-19T05:22:08.064 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2023-12-19T05:22:12.863 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2023-12-19T05:22:15.090 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-12-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrading: 2023-12-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi188.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrade 1 Package 2023-12-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 328 M 2023-12-19T05:22:15.102 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-19T05:22:26.071 INFO:teuthology.orchestra.run.smithi188.stdout:linux-firmware-20231030-141.el9.noarch.rpm 30 MB/s | 328 MB 00:10 2023-12-19T05:22:26.072 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-19T05:22:26.072 INFO:teuthology.orchestra.run.smithi188.stdout:Total 30 MB/s | 328 MB 00:10 2023-12-19T05:22:26.072 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-19T05:22:26.190 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-19T05:22:26.190 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-19T05:22:28.382 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-19T05:22:28.382 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-19T05:22:34.368 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-19T05:22:34.629 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-19T05:22:34.710 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T05:22:35.644 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T05:22:35.644 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-19T05:22:36.023 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-19T05:22:36.023 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:22:36.023 INFO:teuthology.orchestra.run.smithi188.stdout:Upgraded: 2023-12-19T05:22:36.023 INFO:teuthology.orchestra.run.smithi188.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-19T05:22:36.023 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:22:36.023 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-19T05:22:36.330 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-19T05:22:36.330 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T05:22:36.479 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-19T05:22:36.480 DEBUG:teuthology.orchestra.run.smithi188:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-19T05:22:36.482 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi188.front.sepia.ceph.com to complete... 2023-12-19T05:22:47.577 INFO:teuthology.orchestra.run.smithi188.stderr:2023-12-19 05:22:47 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-19T05:22:47.578 INFO:teuthology.orchestra.run.smithi188.stderr:FINISHED --2023-12-19 05:22:47-- 2023-12-19T05:22:47.578 INFO:teuthology.orchestra.run.smithi188.stderr:Total wall clock time: 11s 2023-12-19T05:22:47.578 INFO:teuthology.orchestra.run.smithi188.stderr:Downloaded: 1 files, 306M in 11s (28.5 MB/s) 2023-12-19T05:22:47.581 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-19T05:22:47.581 DEBUG:teuthology.orchestra.run.smithi188:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-19T05:22:49.471 INFO:teuthology.orchestra.run.smithi188.stdout:Verifying... ######################################## 2023-12-19T05:22:49.599 INFO:teuthology.orchestra.run.smithi188.stdout:Preparing... ######################################## 2023-12-19T05:22:49.680 INFO:teuthology.orchestra.run.smithi188.stdout:Updating / installing... 2023-12-19T05:22:56.813 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-19T05:23:12.171 INFO:teuthology.orchestra.run.smithi188.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-19T05:23:33.320 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi188.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-19T05:23:33.321 DEBUG:teuthology.orchestra.run.smithi188:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-19T05:23:33.399 INFO:teuthology.orchestra.run.smithi188.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T05:23:33.399 INFO:teuthology.orchestra.run.smithi188.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-19T05:23:33.399 INFO:teuthology.orchestra.run.smithi188.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T05:23:33.399 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-19T05:23:33.399 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-19T05:23:33.399 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-19T05:23:33.399 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-19T05:23:33.399 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-19T05:23:33.399 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T05:23:33.399 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T05:23:33.399 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T05:23:33.399 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T05:23:33.400 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T05:23:33.400 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T05:23:33.400 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T05:23:33.400 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-19T05:23:33.400 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T05:23:33.400 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T05:23:33.400 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T05:23:33.400 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T05:23:33.400 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T05:23:33.400 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T05:23:33.400 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T05:23:33.400 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T05:23:33.400 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T05:23:33.401 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T05:23:33.401 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T05:23:33.401 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T05:23:33.401 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-19T05:23:33.401 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-19T05:23:33.401 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-19T05:23:33.401 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T05:23:33.401 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-19T05:23:33.401 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T05:23:33.401 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T05:23:33.401 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T05:23:33.401 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-19T05:23:33.401 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T05:23:33.401 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T05:23:33.402 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T05:23:33.402 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-19T05:23:33.402 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T05:23:33.402 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T05:23:33.402 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T05:23:33.402 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T05:23:33.402 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T05:23:33.402 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T05:23:33.402 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T05:23:33.402 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T05:23:33.402 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T05:23:33.402 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T05:23:33.402 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T05:23:33.402 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T05:23:33.403 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T05:23:33.404 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T05:23:33.404 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T05:23:33.404 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T05:23:33.404 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T05:23:33.404 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T05:23:33.404 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T05:23:33.404 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T05:23:33.404 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T05:23:33.404 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T05:23:33.404 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T05:23:33.404 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T05:23:33.404 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T05:23:33.404 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T05:23:33.405 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T05:23:33.405 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T05:23:33.405 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T05:23:33.405 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T05:23:33.405 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-19T05:23:33.405 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-19T05:23:33.405 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T05:23:33.405 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T05:23:33.405 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-19T05:23:33.405 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T05:23:33.405 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T05:23:33.405 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T05:23:33.405 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T05:23:33.406 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T05:23:33.406 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-19T05:23:33.406 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T05:23:33.406 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T05:23:33.406 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-19T05:23:33.406 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T05:23:33.406 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T05:23:33.406 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T05:23:33.406 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T05:23:33.406 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T05:23:33.406 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T05:23:33.406 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T05:23:33.406 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T05:23:33.406 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T05:23:33.407 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T05:23:33.408 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T05:23:33.408 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T05:23:33.408 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T05:23:33.408 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T05:23:33.408 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T05:23:33.408 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T05:23:33.408 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T05:23:33.408 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T05:23:33.408 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T05:23:33.408 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T05:23:33.408 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T05:23:33.408 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-19T05:23:33.408 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T05:23:33.408 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T05:23:33.409 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T05:23:33.409 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T05:23:33.409 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T05:23:33.409 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T05:23:33.409 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T05:23:33.409 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T05:23:33.409 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T05:23:33.409 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T05:23:33.409 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T05:23:33.409 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T05:23:33.409 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T05:23:33.409 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T05:23:33.409 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T05:23:33.409 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T05:23:33.410 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T05:23:33.410 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-19T05:23:33.410 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T05:23:33.410 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-19T05:23:33.410 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-19T05:23:33.410 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-19T05:23:33.410 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-19T05:23:33.410 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-19T05:23:33.410 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T05:23:33.410 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-19T05:23:33.410 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-19T05:23:33.410 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T05:23:33.410 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-19T05:23:33.410 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-19T05:23:33.411 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T05:23:33.411 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T05:23:33.411 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-19T05:23:33.411 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-19T05:23:33.411 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T05:23:33.411 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T05:23:33.411 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-19T05:23:33.411 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T05:23:33.411 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T05:23:33.411 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T05:23:33.411 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-19T05:23:33.411 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-19T05:23:33.411 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T05:23:33.411 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T05:23:33.412 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T05:23:33.413 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T05:23:33.413 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T05:23:33.413 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T05:23:33.413 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-19T05:23:33.413 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T05:23:33.413 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T05:23:33.413 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T05:23:33.413 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-19T05:23:33.413 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-19T05:23:33.413 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T05:23:33.413 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T05:23:33.413 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T05:23:33.413 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T05:23:33.414 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-19T05:23:33.415 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-19T05:23:33.415 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-19T05:23:33.415 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T05:23:33.415 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-19T05:23:33.415 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T05:23:33.415 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T05:23:33.415 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T05:23:33.415 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-19T05:23:33.415 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T05:23:33.415 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-19T05:23:33.415 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T05:23:33.415 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-19T05:23:33.415 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-19T05:23:33.415 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-19T05:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-19T05:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T05:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-19T05:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T05:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-19T05:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T05:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T05:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T05:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T05:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T05:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T05:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T05:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T05:23:33.416 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T05:23:33.417 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T05:23:33.417 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T05:23:33.417 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T05:23:33.417 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T05:23:33.417 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-19T05:23:33.417 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-19T05:23:33.417 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T05:23:33.417 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-19T05:23:33.417 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T05:23:33.417 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T05:23:33.417 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-19T05:23:33.417 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T05:23:33.418 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T05:23:33.419 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T05:23:33.419 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T05:23:33.419 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T05:23:33.419 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T05:23:33.419 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T05:23:33.419 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T05:23:33.419 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T05:23:33.419 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T05:23:33.419 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T05:23:33.419 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T05:23:33.419 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T05:23:33.419 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T05:23:33.419 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T05:23:33.419 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T05:23:33.420 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T05:23:33.420 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T05:23:33.420 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T05:23:33.420 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T05:23:33.420 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T05:23:33.420 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T05:23:33.420 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T05:23:33.420 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T05:23:33.420 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T05:23:33.420 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T05:23:33.420 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T05:23:33.420 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T05:23:33.420 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T05:23:33.420 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T05:23:33.421 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T05:23:33.421 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T05:23:33.421 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T05:23:33.421 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T05:23:33.421 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T05:23:33.421 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T05:23:33.421 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T05:23:33.421 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T05:23:33.421 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T05:23:33.421 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T05:23:33.421 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T05:23:33.421 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T05:23:33.421 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T05:23:33.421 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T05:23:33.422 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T05:23:33.422 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T05:23:33.422 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T05:23:33.422 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T05:23:33.422 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T05:23:33.422 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T05:23:33.422 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-19T05:23:33.422 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T05:23:33.422 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T05:23:33.422 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T05:23:33.422 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-19T05:23:33.422 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T05:23:33.422 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T05:23:33.422 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T05:23:33.423 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T05:23:33.423 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T05:23:33.423 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T05:23:33.423 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T05:23:33.423 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T05:23:33.423 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T05:23:33.423 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T05:23:33.423 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T05:23:33.423 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T05:23:33.423 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T05:23:33.423 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T05:23:33.423 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T05:23:33.423 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T05:23:33.423 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T05:23:33.424 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T05:23:33.424 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T05:23:33.424 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T05:23:33.424 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T05:23:33.424 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T05:23:33.424 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T05:23:33.424 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T05:23:33.424 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T05:23:33.424 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T05:23:33.424 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T05:23:33.424 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T05:23:33.424 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T05:23:33.424 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T05:23:33.424 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T05:23:33.425 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T05:23:33.425 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T05:23:33.425 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T05:23:33.425 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T05:23:33.425 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T05:23:33.425 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T05:23:33.425 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T05:23:33.425 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T05:23:33.425 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T05:23:33.425 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T05:23:33.425 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T05:23:33.425 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T05:23:33.425 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T05:23:33.425 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T05:23:33.426 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T05:23:33.426 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T05:23:33.426 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T05:23:33.426 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T05:23:33.426 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T05:23:33.426 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T05:23:33.426 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T05:23:33.426 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T05:23:33.426 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T05:23:33.426 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T05:23:33.426 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T05:23:33.426 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T05:23:33.426 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T05:23:33.426 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T05:23:33.427 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-19T05:23:33.428 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T05:23:33.429 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T05:23:33.429 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T05:23:33.429 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T05:23:33.429 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T05:23:33.429 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T05:23:33.429 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T05:23:33.429 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T05:23:33.429 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T05:23:33.429 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T05:23:33.429 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T05:23:33.429 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T05:23:33.429 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T05:23:33.429 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T05:23:33.429 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T05:23:33.430 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T05:23:33.431 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T05:23:33.432 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T05:23:33.433 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-19T05:23:33.434 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-19T05:23:33.434 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T05:23:33.434 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T05:23:33.434 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T05:23:33.434 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T05:23:33.434 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T05:23:33.434 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T05:23:33.434 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T05:23:33.434 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-19T05:23:33.434 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-19T05:23:33.434 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T05:23:33.434 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T05:23:33.435 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-19T05:23:33.436 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T05:23:33.436 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-19T05:23:33.436 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-19T05:23:33.436 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T05:23:33.436 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T05:23:33.436 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T05:23:33.436 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T05:23:33.436 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-19T05:23:33.436 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T05:23:33.436 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-19T05:23:33.436 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T05:23:33.436 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T05:23:33.436 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T05:23:33.436 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T05:23:33.437 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T05:23:33.437 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T05:23:33.437 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T05:23:33.437 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T05:23:33.437 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-19T05:23:33.437 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T05:23:33.437 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-19T05:23:33.437 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T05:23:33.437 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T05:23:33.437 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T05:23:33.437 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T05:23:33.437 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T05:23:33.437 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T05:23:33.438 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T05:23:33.439 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-19T05:23:33.440 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T05:23:33.441 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T05:23:33.441 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T05:23:33.441 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T05:23:33.441 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T05:23:33.441 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T05:23:33.441 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T05:23:33.441 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-19T05:23:33.441 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T05:23:33.441 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T05:23:33.441 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-19T05:23:33.441 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T05:23:33.441 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T05:23:33.441 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T05:23:33.441 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T05:23:33.442 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-19T05:23:33.442 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-19T05:23:33.442 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T05:23:33.442 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T05:23:33.442 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T05:23:33.442 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T05:23:33.442 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-19T05:23:33.442 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T05:23:33.442 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-19T05:23:33.442 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T05:23:33.442 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T05:23:33.442 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T05:23:33.442 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T05:23:33.442 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-19T05:23:33.443 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T05:23:33.444 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-19T05:23:33.445 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T05:23:33.445 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T05:23:33.445 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T05:23:33.445 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-19T05:23:33.445 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-19T05:23:33.445 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T05:23:33.445 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T05:23:33.445 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T05:23:33.445 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T05:23:33.445 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-19T05:23:33.445 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T05:23:33.445 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T05:23:33.445 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T05:23:33.445 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T05:23:33.446 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-19T05:23:33.446 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T05:23:33.446 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-19T05:23:33.446 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T05:23:33.446 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-19T05:23:33.446 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T05:23:33.446 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-19T05:23:33.446 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T05:23:33.446 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-19T05:23:33.446 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T05:23:33.446 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T05:23:33.446 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T05:23:33.446 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-19T05:23:33.447 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-19T05:23:33.447 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T05:23:33.447 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-19T05:23:33.447 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T05:23:33.447 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-19T05:23:33.447 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T05:23:33.447 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-19T05:23:33.447 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T05:23:33.447 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T05:23:33.447 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-19T05:23:33.447 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T05:23:33.447 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T05:23:33.447 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-19T05:23:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T05:23:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T05:23:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-19T05:23:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T05:23:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T05:23:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-19T05:23:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-19T05:23:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T05:23:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-19T05:23:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-19T05:23:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T05:23:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-19T05:23:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T05:23:33.448 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-19T05:23:33.449 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T05:23:33.449 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-19T05:23:33.449 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T05:23:33.449 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-19T05:23:33.449 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T05:23:33.449 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-19T05:23:33.449 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-19T05:23:33.449 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T05:23:33.449 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-19T05:23:33.449 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-19T05:23:33.449 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T05:23:33.449 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T05:23:33.449 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T05:23:33.449 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T05:23:33.450 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T05:23:33.450 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T05:23:33.450 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-19T05:23:33.450 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T05:23:33.450 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T05:23:33.450 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T05:23:33.450 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-19T05:23:33.450 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-19T05:23:33.450 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T05:23:33.450 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T05:23:33.450 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T05:23:33.450 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-19T05:23:33.450 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T05:23:33.450 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-19T05:23:33.451 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T05:23:33.451 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-19T05:23:33.451 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T05:23:33.451 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-19T05:23:33.451 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T05:23:33.451 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-19T05:23:33.451 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T05:23:33.451 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-19T05:23:33.451 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T05:23:33.451 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-19T05:23:33.451 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T05:23:33.451 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-19T05:23:33.451 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T05:23:33.451 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-19T05:23:33.452 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T05:23:33.453 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-19T05:23:33.453 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T05:23:33.453 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-19T05:23:33.453 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-19T05:23:33.453 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T05:23:33.453 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-19T05:23:33.453 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T05:23:33.453 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T05:23:33.453 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-19T05:23:33.453 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T05:23:33.453 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-19T05:23:33.453 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T05:23:33.453 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-19T05:23:33.454 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T05:23:33.454 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T05:23:33.454 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-19T05:23:33.454 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-19T05:23:33.454 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T05:23:33.454 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T05:23:33.454 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-19T05:23:33.454 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T05:23:33.454 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-19T05:23:33.454 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T05:23:33.454 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-19T05:23:33.454 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T05:23:33.454 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T05:23:33.455 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T05:23:33.455 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T05:23:33.455 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-19T05:23:33.455 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-19T05:23:33.455 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-19T05:23:33.455 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T05:23:33.455 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-19T05:23:33.455 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T05:23:33.455 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-19T05:23:33.455 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T05:23:33.455 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T05:23:33.455 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-19T05:23:33.455 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T05:23:33.455 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T05:23:33.456 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T05:23:33.456 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T05:23:33.456 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-19T05:23:33.456 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-19T05:23:33.456 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T05:23:33.456 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T05:23:33.456 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-19T05:23:33.456 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T05:23:33.456 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T05:23:33.456 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T05:23:33.456 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T05:23:33.456 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-19T05:23:33.456 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-19T05:23:33.457 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T05:23:33.458 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T05:23:33.458 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-19T05:23:33.458 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T05:23:33.458 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T05:23:33.458 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T05:23:33.458 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-19T05:23:33.458 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T05:23:33.458 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T05:23:33.458 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T05:23:33.458 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T05:23:33.458 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T05:23:33.458 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-19T05:23:33.459 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T05:23:33.459 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T05:23:33.459 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-19T05:23:33.459 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T05:23:33.459 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T05:23:33.459 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-19T05:23:33.459 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T05:23:33.459 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T05:23:33.459 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-19T05:23:33.459 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T05:23:33.459 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T05:23:33.459 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T05:23:33.459 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T05:23:33.459 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-19T05:23:33.460 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T05:23:33.461 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T05:23:33.461 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T05:23:33.461 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-19T05:23:33.461 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T05:23:33.461 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T05:23:33.461 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T05:23:33.461 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T05:23:33.461 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T05:23:33.461 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-19T05:23:33.461 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-19T05:23:33.461 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T05:23:33.461 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T05:23:33.461 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T05:23:33.462 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-19T05:23:33.463 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T05:23:33.464 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T05:23:33.465 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T05:23:33.465 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T05:23:33.465 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T05:23:33.465 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T05:23:33.465 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T05:23:33.465 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T05:23:33.465 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T05:23:33.465 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T05:23:33.465 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-19T05:23:33.465 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T05:23:33.465 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T05:23:33.465 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T05:23:33.465 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T05:23:33.465 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T05:23:33.466 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T05:23:33.467 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T05:23:33.467 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-19T05:23:33.467 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T05:23:33.467 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T05:23:33.467 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-19T05:23:33.467 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T05:23:33.467 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T05:23:33.467 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T05:23:33.467 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T05:23:33.467 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T05:23:33.467 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T05:23:33.467 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T05:23:33.467 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T05:23:33.467 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T05:23:33.468 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T05:23:33.468 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T05:23:33.468 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T05:23:33.468 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T05:23:33.468 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T05:23:33.468 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T05:23:33.468 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T05:23:33.468 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T05:23:33.468 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T05:23:33.468 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T05:23:33.468 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T05:23:33.468 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T05:23:33.468 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T05:23:33.468 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T05:23:33.469 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T05:23:33.469 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T05:23:33.469 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T05:23:33.469 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T05:23:33.469 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T05:23:33.469 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T05:23:33.469 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T05:23:33.469 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T05:23:33.469 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-19T05:23:33.469 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T05:23:33.469 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T05:23:33.469 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T05:23:33.469 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T05:23:33.469 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T05:23:33.470 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-19T05:23:33.471 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T05:23:33.471 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-19T05:23:33.471 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T05:23:33.471 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T05:23:33.471 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-19T05:23:33.471 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T05:23:33.471 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-19T05:23:33.471 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-19T05:23:33.471 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T05:23:33.471 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-19T05:23:33.471 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T05:23:33.471 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T05:23:33.471 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T05:23:33.471 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-19T05:23:33.472 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-19T05:23:33.472 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-19T05:23:33.472 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-19T05:23:33.472 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-19T05:23:33.472 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T05:23:33.472 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-19T05:23:33.472 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T05:23:33.472 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T05:23:33.472 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-19T05:23:33.472 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T05:23:33.472 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T05:23:33.472 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-19T05:23:33.472 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T05:23:33.472 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T05:23:33.473 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T05:23:33.473 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T05:23:33.473 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T05:23:33.473 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T05:23:33.473 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T05:23:33.473 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-19T05:23:33.473 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T05:23:33.473 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T05:23:33.473 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T05:23:33.473 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-19T05:23:33.473 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T05:23:33.473 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T05:23:33.473 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T05:23:33.474 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T05:23:33.475 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T05:23:33.476 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T05:23:33.477 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T05:23:33.477 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T05:23:33.477 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T05:23:33.477 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T05:23:33.477 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-19T05:23:33.477 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T05:23:33.477 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-19T05:23:33.477 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-19T05:23:33.477 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-19T05:23:33.477 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T05:23:33.477 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T05:23:33.477 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T05:23:33.477 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T05:23:33.478 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T05:23:33.478 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T05:23:33.478 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T05:23:33.478 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T05:23:33.478 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T05:23:33.478 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T05:23:33.478 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T05:23:33.478 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T05:23:33.478 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T05:23:33.478 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T05:23:33.478 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T05:23:33.478 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-19T05:23:33.478 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-19T05:23:33.478 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T05:23:33.479 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T05:23:33.479 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T05:23:33.479 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T05:23:33.479 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-19T05:23:33.479 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-19T05:23:33.479 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T05:23:33.479 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T05:23:33.479 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-19T05:23:33.479 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T05:23:33.479 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-19T05:23:33.479 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-19T05:23:33.479 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T05:23:33.479 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-19T05:23:33.479 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T05:23:33.480 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-19T05:23:33.481 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T05:23:33.481 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T05:23:33.481 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-19T05:23:33.481 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T05:23:33.481 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T05:23:33.481 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T05:23:33.481 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T05:23:33.481 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T05:23:33.481 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T05:23:33.481 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T05:23:33.481 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T05:23:33.481 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T05:23:33.481 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T05:23:33.481 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-19T05:23:33.482 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T05:23:33.482 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T05:23:33.482 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T05:23:33.482 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T05:23:33.482 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T05:23:33.482 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T05:23:33.482 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T05:23:33.482 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-19T05:23:33.482 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T05:23:33.482 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-19T05:23:33.482 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T05:23:33.482 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T05:23:33.482 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T05:23:33.482 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T05:23:33.483 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T05:23:33.484 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T05:23:33.484 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T05:23:33.484 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T05:23:33.484 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T05:23:33.484 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T05:23:33.484 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T05:23:33.484 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T05:23:33.484 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T05:23:33.484 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T05:23:33.484 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T05:23:33.484 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T05:23:33.484 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T05:23:33.484 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T05:23:33.484 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T05:23:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T05:23:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T05:23:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T05:23:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T05:23:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T05:23:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T05:23:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T05:23:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T05:23:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T05:23:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T05:23:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T05:23:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T05:23:33.485 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T05:23:33.486 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T05:23:33.487 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-19T05:23:33.487 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T05:23:33.487 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T05:23:33.487 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T05:23:33.487 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-19T05:23:33.487 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-19T05:23:33.487 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T05:23:33.487 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T05:23:33.487 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T05:23:33.487 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T05:23:33.487 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-19T05:23:33.487 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T05:23:33.487 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T05:23:33.487 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-19T05:23:33.488 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-19T05:23:33.489 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-19T05:23:33.489 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T05:23:33.489 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T05:23:33.489 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-19T05:23:33.489 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T05:23:33.489 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T05:23:33.489 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T05:23:33.489 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T05:23:33.489 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T05:23:33.489 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T05:23:33.489 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T05:23:33.489 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T05:23:33.489 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T05:23:33.490 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T05:23:33.490 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T05:23:33.490 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T05:23:33.490 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-19T05:23:33.490 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T05:23:33.490 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T05:23:33.490 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T05:23:33.490 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T05:23:33.490 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T05:23:33.490 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T05:23:33.490 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T05:23:33.490 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T05:23:33.490 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T05:23:33.490 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T05:23:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T05:23:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T05:23:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T05:23:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T05:23:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T05:23:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T05:23:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T05:23:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T05:23:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T05:23:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T05:23:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T05:23:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T05:23:33.491 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-19T05:23:33.492 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T05:23:33.493 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-19T05:23:33.494 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T05:23:33.495 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-19T05:23:33.495 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-19T05:23:33.495 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T05:23:33.495 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-19T05:23:33.495 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T05:23:33.495 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-19T05:23:33.495 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T05:23:33.495 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-19T05:23:33.495 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T05:23:33.495 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-19T05:23:33.495 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T05:23:33.495 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-19T05:23:33.495 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-19T05:23:33.496 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T05:23:33.497 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T05:23:33.498 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T05:23:33.499 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-19T05:23:33.500 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T05:23:33.501 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-19T05:23:33.501 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T05:23:33.501 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T05:23:33.501 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T05:23:33.501 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T05:23:33.501 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T05:23:33.501 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-19T05:23:33.501 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T05:23:33.501 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-19T05:23:33.501 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T05:23:33.501 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-19T05:23:33.501 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T05:23:33.501 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-19T05:23:33.501 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-19T05:23:33.502 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T05:23:33.503 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-19T05:23:33.504 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T05:23:33.504 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T05:23:33.504 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-19T05:23:33.504 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T05:23:33.504 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-19T05:23:33.504 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T05:23:33.504 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-19T05:23:33.504 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T05:23:33.504 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T05:23:33.504 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T05:23:33.504 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T05:23:33.504 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-19T05:23:33.504 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-19T05:23:33.504 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-19T05:23:33.505 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T05:23:33.505 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-19T05:23:33.505 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-19T05:23:33.505 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T05:23:33.505 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T05:23:33.505 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T05:23:33.505 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T05:23:33.505 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T05:23:33.505 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T05:23:33.505 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T05:23:33.505 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T05:23:33.505 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-19T05:23:33.505 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T05:23:33.506 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T05:23:33.506 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T05:23:33.506 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T05:23:33.506 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T05:23:33.506 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-19T05:23:33.506 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T05:23:33.506 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-19T05:23:33.506 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T05:23:33.506 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T05:23:33.506 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T05:23:33.506 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T05:23:33.506 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-19T05:23:33.506 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T05:23:33.506 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-19T05:23:33.507 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T05:23:33.507 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T05:23:33.507 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-19T05:23:33.507 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T05:23:33.507 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T05:23:33.507 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T05:23:33.507 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T05:23:33.507 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T05:23:33.507 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T05:23:33.507 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T05:23:33.507 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T05:23:33.507 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T05:23:33.507 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T05:23:33.507 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-19T05:23:33.508 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T05:23:33.509 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-19T05:23:33.509 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-19T05:23:33.509 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T05:23:33.509 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-19T05:23:33.509 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T05:23:33.509 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T05:23:33.509 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T05:23:33.509 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T05:23:33.509 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-19T05:23:33.509 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-19T05:23:33.509 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-19T05:23:33.509 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T05:23:33.509 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T05:23:33.509 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T05:23:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T05:23:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T05:23:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-19T05:23:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-19T05:23:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T05:23:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T05:23:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T05:23:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-19T05:23:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T05:23:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T05:23:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T05:23:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T05:23:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T05:23:33.510 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T05:23:33.511 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T05:23:33.512 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T05:23:33.513 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T05:23:33.513 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T05:23:33.513 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T05:23:33.513 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T05:23:33.513 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T05:23:33.513 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T05:23:33.513 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T05:23:33.513 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T05:23:33.513 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T05:23:33.513 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T05:23:33.513 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T05:23:33.513 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T05:23:33.513 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T05:23:33.514 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T05:23:33.515 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T05:23:33.515 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T05:23:33.515 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T05:23:33.515 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T05:23:33.515 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T05:23:33.515 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T05:23:33.515 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T05:23:33.515 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T05:23:33.515 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T05:23:33.515 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T05:23:33.515 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T05:23:33.515 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T05:23:33.515 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T05:23:33.515 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T05:23:33.516 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T05:23:33.517 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T05:23:33.517 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T05:23:33.517 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-19T05:23:33.517 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T05:23:33.517 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-19T05:23:33.517 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T05:23:33.517 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-19T05:23:33.517 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T05:23:33.517 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-19T05:23:33.517 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-19T05:23:33.517 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T05:23:33.517 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T05:23:33.517 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T05:23:33.517 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T05:23:33.518 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T05:23:33.519 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T05:23:33.520 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T05:23:33.520 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T05:23:33.520 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T05:23:33.520 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T05:23:33.520 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T05:23:33.520 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T05:23:33.520 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T05:23:33.520 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T05:23:33.520 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T05:23:33.520 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T05:23:33.520 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T05:23:33.520 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T05:23:33.520 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T05:23:33.520 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T05:23:33.521 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T05:23:33.521 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T05:23:33.521 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T05:23:33.521 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T05:23:33.521 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T05:23:33.521 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T05:23:33.521 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T05:23:33.521 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T05:23:33.521 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T05:23:33.521 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T05:23:33.521 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T05:23:33.521 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T05:23:33.521 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T05:23:33.521 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T05:23:33.522 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T05:23:33.522 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T05:23:33.522 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T05:23:33.522 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T05:23:33.522 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T05:23:33.522 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T05:23:33.522 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T05:23:33.522 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T05:23:33.522 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T05:23:33.522 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T05:23:33.522 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T05:23:33.522 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T05:23:33.522 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T05:23:33.522 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T05:23:33.523 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T05:23:33.524 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T05:23:33.525 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T05:23:33.526 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T05:23:33.526 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T05:23:33.526 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T05:23:33.526 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T05:23:33.526 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T05:23:33.526 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T05:23:33.526 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T05:23:33.526 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T05:23:33.526 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T05:23:33.526 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T05:23:33.526 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T05:23:33.526 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T05:23:33.526 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T05:23:33.526 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T05:23:33.527 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T05:23:33.527 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T05:23:33.527 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T05:23:33.527 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T05:23:33.527 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T05:23:33.527 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T05:23:33.527 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T05:23:33.527 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T05:23:33.527 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T05:23:33.527 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T05:23:33.527 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T05:23:33.527 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T05:23:33.527 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T05:23:33.527 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T05:23:33.528 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T05:23:33.528 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T05:23:33.528 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T05:23:33.528 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-19T05:23:33.528 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T05:23:33.528 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-19T05:23:33.528 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T05:23:33.528 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-19T05:23:33.528 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T05:23:33.528 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T05:23:33.528 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T05:23:33.528 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T05:23:33.528 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-19T05:23:33.528 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T05:23:33.529 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-19T05:23:33.529 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T05:23:33.529 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T05:23:33.529 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T05:23:33.529 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-19T05:23:33.529 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T05:23:33.529 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T05:23:33.529 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T05:23:33.529 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T05:23:33.529 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T05:23:33.529 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T05:23:33.529 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T05:23:33.529 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T05:23:33.529 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T05:23:33.530 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T05:23:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T05:23:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T05:23:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T05:23:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T05:23:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T05:23:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T05:23:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T05:23:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T05:23:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T05:23:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T05:23:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T05:23:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T05:23:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T05:23:33.531 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T05:23:33.532 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-19T05:23:33.533 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T05:23:33.533 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-19T05:23:33.533 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T05:23:33.533 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T05:23:33.533 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-19T05:23:33.533 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T05:23:33.533 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-19T05:23:33.533 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T05:23:33.533 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T05:23:33.533 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T05:23:33.533 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T05:23:33.533 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T05:23:33.533 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-19T05:23:33.533 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T05:23:33.534 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T05:23:33.535 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T05:23:33.535 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T05:23:33.535 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T05:23:33.535 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T05:23:33.535 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T05:23:33.535 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T05:23:33.535 INFO:teuthology.orchestra.run.smithi188.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T05:23:33.536 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T05:23:33.536 DEBUG:teuthology.orchestra.run.smithi188:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-19T05:23:33.560 INFO:teuthology.orchestra.run.smithi188.stdout:postinstall scriptlet (using /bin/sh): 2023-12-19T05:23:33.560 INFO:teuthology.orchestra.run.smithi188.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-19T05:23:33.560 INFO:teuthology.orchestra.run.smithi188.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-19T05:23:33.560 INFO:teuthology.orchestra.run.smithi188.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T05:23:33.560 INFO:teuthology.orchestra.run.smithi188.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T05:23:33.560 INFO:teuthology.orchestra.run.smithi188.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T05:23:33.560 INFO:teuthology.orchestra.run.smithi188.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-19T05:23:33.560 INFO:teuthology.orchestra.run.smithi188.stdout:fi 2023-12-19T05:23:33.560 INFO:teuthology.orchestra.run.smithi188.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-19T05:23:33.560 INFO:teuthology.orchestra.run.smithi188.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-19T05:23:33.561 INFO:teuthology.orchestra.run.smithi188.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-19T05:23:33.561 INFO:teuthology.orchestra.run.smithi188.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-19T05:23:33.561 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-19T05:23:33.561 INFO:teuthology.orchestra.run.smithi188.stdout:fi 2023-12-19T05:23:33.561 INFO:teuthology.orchestra.run.smithi188.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-19T05:23:33.561 INFO:teuthology.orchestra.run.smithi188.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-19T05:23:33.561 INFO:teuthology.orchestra.run.smithi188.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-19T05:23:33.561 INFO:teuthology.orchestra.run.smithi188.stdout:fi 2023-12-19T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi188:> sudo rpm -qi grub2-tools 2023-12-19T05:23:33.639 INFO:teuthology.orchestra.run.smithi188.stdout:Name : grub2-tools 2023-12-19T05:23:33.639 INFO:teuthology.orchestra.run.smithi188.stdout:Epoch : 1 2023-12-19T05:23:33.639 INFO:teuthology.orchestra.run.smithi188.stdout:Version : 2.06 2023-12-19T05:23:33.639 INFO:teuthology.orchestra.run.smithi188.stdout:Release : 68.el9 2023-12-19T05:23:33.639 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: x86_64 2023-12-19T05:23:33.639 INFO:teuthology.orchestra.run.smithi188.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout:Group : Unspecified 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout:Size : 8264254 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout:License : GPLv3+ 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout:Packager : builder@centos.org 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout:Vendor : CentOS 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout:Summary : Support tools for GRUB. 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout:Description : 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-19T05:23:33.640 INFO:teuthology.orchestra.run.smithi188.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-19T05:23:33.641 INFO:teuthology.orchestra.run.smithi188.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-19T05:23:33.641 INFO:teuthology.orchestra.run.smithi188.stdout:hardware devices. 2023-12-19T05:23:33.641 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:23:33.641 INFO:teuthology.orchestra.run.smithi188.stdout:This subpackage provides tools for support of all platforms. 2023-12-19T05:23:33.642 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-19T05:23:33.642 INFO:teuthology.task.kernel:Updating grub on smithi188 to boot 6.6.0-gcd68252d7b4d 2023-12-19T05:23:33.642 DEBUG:teuthology.orchestra.run.smithi188:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-19T05:23:34.162 INFO:teuthology.orchestra.run.smithi188.stderr:Generating grub configuration file ... 2023-12-19T05:23:35.665 INFO:teuthology.orchestra.run.smithi188.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-19T05:23:35.703 INFO:teuthology.orchestra.run.smithi188.stderr:done 2023-12-19T05:23:35.705 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2023-12-19T05:23:35.720 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.36f8vRJkbu 2023-12-19T05:23:35.720 DEBUG:teuthology.orchestra.run.smithi188:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.36f8vRJkbu 2023-12-19T05:23:35.807 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.36f8vRJkbu 2023-12-19T05:23:35.909 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.36f8vRJkbu is 6KB 2023-12-19T05:23:35.958 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.36f8vRJkbu 2023-12-19T05:23:35.972 DEBUG:teuthology.orchestra.run.smithi188:> sudo /bin/ls /boot/loader/entries || true 2023-12-19T05:23:36.041 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-19T05:23:36.042 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-19T05:23:36.042 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-19T05:23:36.042 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-19T05:23:36.043 DEBUG:teuthology.orchestra.run.smithi188:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-19T05:23:36.215 DEBUG:teuthology.orchestra.run.smithi188:> sudo shutdown -r now 2023-12-19T05:24:06.218 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-19T05:24:06.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-12-19T05:24:06.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:25:06.222 DEBUG:teuthology.orchestra.remote:timed out 2023-12-19T05:25:15.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-12-19T05:25:15.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:25:18.289 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-12-19T05:25:30.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-12-19T05:25:30.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:25:30.611 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-12-19T05:25:31.324 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-12-19T05:25:31.325 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gcd68252d7b4d"... 2023-12-19T05:25:31.325 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2023-12-19T05:25:31.371 INFO:teuthology.orchestra.run.smithi188.stdout:6.6.0-gcd68252d7b4d 2023-12-19T05:25:31.371 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T05:25:31.371 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T05:25:31.371 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-19T05:25:32.373 DEBUG:teuthology.parallel:result is None 2023-12-19T05:25:32.373 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-19T05:25:32.381 INFO:teuthology.task.internal:Creating test directory... 2023-12-19T05:25:32.381 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T05:25:32.384 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T05:25:32.386 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T05:25:32.429 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-19T05:25:32.436 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-19T05:25:32.444 INFO:teuthology.task.internal:Creating archive directory... 2023-12-19T05:25:32.445 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T05:25:32.447 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T05:25:32.449 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T05:25:32.596 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-19T05:25:32.604 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-19T05:25:32.604 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T05:25:32.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:25:32.621 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T05:25:32.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:25:32.637 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T05:25:32.664 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T05:25:32.680 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T05:25:32.711 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T05:25:32.719 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T05:25:32.731 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T05:25:32.737 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T05:25:32.802 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T05:25:32.867 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T05:25:32.870 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-19T05:25:32.878 INFO:teuthology.task.internal:Configuring sudo... 2023-12-19T05:25:32.878 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T05:25:32.880 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T05:25:32.883 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T05:25:32.954 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-19T05:25:32.963 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-19T05:25:32.963 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T05:25:32.966 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T05:25:32.968 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T05:25:33.007 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T05:25:33.068 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T05:25:33.120 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T05:25:33.205 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T05:25:33.249 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:25:33.250 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T05:25:33.318 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T05:25:33.362 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T05:25:33.430 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T05:25:33.473 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T05:25:33.519 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:25:33.519 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T05:25:33.588 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T05:25:33.663 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T05:25:33.742 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T05:25:33.811 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T05:25:33.908 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:25:33.908 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T05:25:33.988 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2023-12-19T05:25:33.990 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2023-12-19T05:25:33.993 DEBUG:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2023-12-19T05:25:34.033 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T05:25:34.040 INFO:teuthology.orchestra.run.smithi120.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T05:25:34.149 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-19T05:25:34.524 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-19T05:25:34.533 INFO:teuthology.task.internal:Starting timer... 2023-12-19T05:25:34.533 INFO:teuthology.run_tasks:Running task pcp... 2023-12-19T05:25:34.544 INFO:teuthology.run_tasks:Running task selinux... 2023-12-19T05:25:34.553 DEBUG:teuthology.orchestra.run.smithi120:> sudo service auditd rotate 2023-12-19T05:25:34.606 INFO:teuthology.orchestra.run.smithi120.stdout:Rotating logs: 2023-12-19T05:25:34.607 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2023-12-19T05:25:34.665 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: 2023-12-19T05:25:34.667 DEBUG:teuthology.orchestra.run.smithi188:> sudo service auditd rotate 2023-12-19T05:25:34.871 INFO:teuthology.orchestra.run.smithi188.stdout:Rotating logs: 2023-12-19T05:25:34.876 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-19T05:25:34.876 DEBUG:teuthology.orchestra.run.smithi120:> /usr/sbin/getenforce 2023-12-19T05:25:34.895 INFO:teuthology.orchestra.run.smithi120.stdout:Permissive 2023-12-19T05:25:34.895 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2023-12-19T05:25:34.918 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2023-12-19T05:25:34.919 DEBUG:teuthology.orchestra.run.smithi188:> /usr/sbin/getenforce 2023-12-19T05:25:34.974 INFO:teuthology.orchestra.run.smithi188.stdout:Permissive 2023-12-19T05:25:34.974 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi120.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi155.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi188.front.sepia.ceph.com': 'permissive'} 2023-12-19T05:25:34.974 DEBUG:teuthology.orchestra.run.smithi120:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T05:25:35.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:25:35.002 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T05:25:35.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:25:35.032 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-19T05:25:35.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:25:35.104 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-19T05:25:35.104 DEBUG:teuthology.orchestra.run.smithi120:> sudo /usr/sbin/setenforce permissive 2023-12-19T05:25:35.137 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2023-12-19T05:25:35.178 DEBUG:teuthology.orchestra.run.smithi188:> sudo /usr/sbin/setenforce permissive 2023-12-19T05:25:35.277 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-19T05:25:35.287 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-19T05:25:35.287 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-19T05:25:35.304 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-19T05:25:35.305 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi120.front.sepia.ceph.com,smithi155.front.sepia.ceph.com,smithi188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-19T05:35:41.528 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi120.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com')] 2023-12-19T05:35:41.529 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-12-19T05:35:41.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:35:41.614 DEBUG:teuthology.orchestra.run.smithi120:> true 2023-12-19T05:35:41.681 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-12-19T05:35:41.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-12-19T05:35:41.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:35:41.767 DEBUG:teuthology.orchestra.run.smithi155:> true 2023-12-19T05:35:41.841 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2023-12-19T05:35:41.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-12-19T05:35:41.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T05:35:41.974 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-12-19T05:35:42.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-12-19T05:35:42.126 INFO:teuthology.run_tasks:Running task clock... 2023-12-19T05:35:42.136 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-19T05:35:42.136 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T05:35:42.136 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T05:35:42.144 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T05:35:42.144 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T05:35:42.147 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T05:35:42.147 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T05:35:42.173 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T05:35:42.181 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T05:35:42.192 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T05:35:42.201 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T05:35:42.222 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: ntpd: command not found 2023-12-19T05:35:42.235 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2023-12-19T05:35:42.236 INFO:teuthology.orchestra.run.smithi120.stdout:506 Cannot talk to daemon 2023-12-19T05:35:42.248 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-19T05:35:42.249 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2023-12-19T05:35:42.254 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T05:35:42.267 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T05:35:42.270 INFO:teuthology.orchestra.run.smithi120.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T05:35:42.283 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T05:35:42.298 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-19T05:35:42.315 INFO:teuthology.orchestra.run.smithi120.stderr:bash: line 1: ntpq: command not found 2023-12-19T05:35:42.318 INFO:teuthology.orchestra.run.smithi120.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T05:35:42.318 INFO:teuthology.orchestra.run.smithi120.stdout:=============================================================================== 2023-12-19T05:35:42.318 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:35:42.318 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:35:42.318 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:35:42.318 INFO:teuthology.orchestra.run.smithi120.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:35:42.327 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2023-12-19T05:35:42.333 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T05:35:42.333 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2023-12-19T05:35:42.333 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:35:42.333 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:35:42.333 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:35:42.333 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:35:42.393 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: ntpd: command not found 2023-12-19T05:35:42.432 INFO:teuthology.orchestra.run.smithi188.stdout:506 Cannot talk to daemon 2023-12-19T05:35:42.482 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-19T05:35:42.537 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-19T05:35:42.661 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2023-12-19T05:35:42.670 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-19T05:35:42.670 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2023-12-19T05:35:42.670 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:35:42.670 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:35:42.670 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:35:42.670 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-19T05:35:42.672 INFO:teuthology.run_tasks:Running task install... 2023-12-19T05:35:42.680 DEBUG:teuthology.task.install:project ceph 2023-12-19T05:35:42.681 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}} 2023-12-19T05:35:42.681 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'} 2023-12-19T05:35:42.681 INFO:teuthology.task.install:Using flavor: default 2023-12-19T05:35:42.687 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-19T05:35:42.687 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-19T05:35:42.687 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-19T05:35:42.688 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T05:35:42.689 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-19T05:35:42.690 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T05:35:42.691 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'tag': None, 'wait_for_package': False} 2023-12-19T05:35:42.691 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T05:35:42.836 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-19T05:35:42.836 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-19T05:35:42.849 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-19T05:35:42.849 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-19T05:35:42.907 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/ 2023-12-19T05:35:42.907 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1377.g24e2e32a 2023-12-19T05:35:42.958 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T05:35:42.958 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:35:42.958 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T05:35:42.989 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-19T05:35:42.989 DEBUG:teuthology.orchestra.run.smithi120:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T05:35:43.012 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T05:35:43.012 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:35:43.012 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T05:35:43.060 DEBUG:teuthology.orchestra.run.smithi120:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T05:35:43.075 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-mdscap-reef/24e2e32ab893c11f7e31ee84381b2f961d1b317c/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-19T05:35:43.076 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:35:43.076 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-19T05:35:43.106 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-19T05:35:43.106 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T05:35:43.114 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-19T05:35:43.114 DEBUG:teuthology.orchestra.run.smithi188:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/24e2e32ab893c11f7e31ee84381b2f961d1b317c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-19T05:35:43.143 DEBUG:teuthology.orchestra.run.smithi120:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T05:35:43.175 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T05:35:43.212 INFO:teuthology.orchestra.run.smithi120.stdout:check_obsoletes = 1 2023-12-19T05:35:43.213 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum clean all 2023-12-19T05:35:43.257 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T05:35:43.260 DEBUG:teuthology.orchestra.run.smithi188:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-19T05:35:43.323 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2023-12-19T05:35:43.325 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2023-12-19T05:35:43.396 DEBUG:teuthology.orchestra.run.smithi188:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-19T05:35:43.448 INFO:teuthology.orchestra.run.smithi120.stdout:73 files removed 2023-12-19T05:35:43.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-19T05:35:43.481 INFO:teuthology.orchestra.run.smithi188.stdout:check_obsoletes = 1 2023-12-19T05:35:43.486 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum clean all 2023-12-19T05:35:43.561 INFO:teuthology.orchestra.run.smithi155.stdout:73 files removed 2023-12-19T05:35:43.588 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-19T05:35:43.845 INFO:teuthology.orchestra.run.smithi188.stdout:73 files removed 2023-12-19T05:35:43.884 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-19T05:35:44.173 INFO:teuthology.orchestra.run.smithi120.stdout:ceph packages for x86_64 188 kB/s | 77 kB 00:00 2023-12-19T05:35:44.360 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 163 kB/s | 77 kB 00:00 2023-12-19T05:35:44.591 INFO:teuthology.orchestra.run.smithi120.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2023-12-19T05:35:44.777 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2023-12-19T05:35:44.860 INFO:teuthology.orchestra.run.smithi188.stdout:ceph packages for x86_64 165 kB/s | 77 kB 00:00 2023-12-19T05:35:44.891 INFO:teuthology.orchestra.run.smithi120.stdout:ceph source packages 6.9 kB/s | 1.9 kB 00:00 2023-12-19T05:35:45.128 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 5.8 kB/s | 1.9 kB 00:00 2023-12-19T05:35:45.286 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS-9 - AppStream 17 MB/s | 6.4 MB 00:00 2023-12-19T05:35:45.318 INFO:teuthology.orchestra.run.smithi188.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2023-12-19T05:35:45.539 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS-9 - AppStream 17 MB/s | 6.4 MB 00:00 2023-12-19T05:35:45.870 INFO:teuthology.orchestra.run.smithi188.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2023-12-19T05:35:46.515 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-12-19T05:35:46.611 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS-9 - BaseOS 7.3 MB/s | 2.0 MB 00:00 2023-12-19T05:35:46.897 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS-9 - BaseOS 6.6 MB/s | 2.0 MB 00:00 2023-12-19T05:35:47.435 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 7.9 MB 00:00 2023-12-19T05:35:47.963 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.9 MB 00:00 2023-12-19T05:35:48.190 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - BaseOS 4.6 MB/s | 2.0 MB 00:00 2023-12-19T05:35:50.286 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 7.9 MB 00:01 2023-12-19T05:35:50.444 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 18 MB 00:01 2023-12-19T05:35:54.180 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - AppStream 3.5 MB/s | 18 MB 00:05 2023-12-19T05:35:55.437 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 5.8 MB 00:01 2023-12-19T05:35:56.838 INFO:teuthology.orchestra.run.smithi120.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 15 kB 00:00 2023-12-19T05:35:58.623 INFO:teuthology.orchestra.run.smithi120.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2023-12-19T05:35:59.164 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 5.8 MB 00:01 2023-12-19T05:36:00.498 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 15 kB 00:00 2023-12-19T05:36:03.615 INFO:teuthology.orchestra.run.smithi120.stdout:lab-extras 4.5 kB/s | 1.7 kB 00:00 2023-12-19T05:36:05.956 INFO:teuthology.orchestra.run.smithi120.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T05:36:05.957 INFO:teuthology.orchestra.run.smithi120.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T05:36:05.970 INFO:teuthology.orchestra.run.smithi120.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-19T05:36:05.971 INFO:teuthology.orchestra.run.smithi120.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-19T05:36:05.972 INFO:teuthology.orchestra.run.smithi120.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T05:36:05.973 INFO:teuthology.orchestra.run.smithi120.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-19T05:36:05.975 INFO:teuthology.orchestra.run.smithi120.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T05:36:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-19T05:36:05.978 INFO:teuthology.orchestra.run.smithi120.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T05:36:06.050 INFO:teuthology.orchestra.run.smithi120.stdout:Dependencies resolved. 2023-12-19T05:36:06.065 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================================ 2023-12-19T05:36:06.065 INFO:teuthology.orchestra.run.smithi120.stdout: Package Arch Version Repository Size 2023-12-19T05:36:06.065 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================================ 2023-12-19T05:36:06.065 INFO:teuthology.orchestra.run.smithi120.stdout:Installing: 2023-12-19T05:36:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-19T05:36:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-19T05:36:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-19T05:36:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-19T05:36:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-19T05:36:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-19T05:36:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-19T05:36:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-19T05:36:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-19T05:36:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-19T05:36:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-19T05:36:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-19T05:36:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-19T05:36:06.066 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-19T05:36:06.067 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-19T05:36:06.067 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-19T05:36:06.067 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-19T05:36:06.067 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-19T05:36:06.067 INFO:teuthology.orchestra.run.smithi120.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-19T05:36:06.067 INFO:teuthology.orchestra.run.smithi120.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-19T05:36:06.067 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-19T05:36:06.067 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-19T05:36:06.067 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-19T05:36:06.067 INFO:teuthology.orchestra.run.smithi120.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-19T05:36:06.067 INFO:teuthology.orchestra.run.smithi120.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-19T05:36:06.067 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-19T05:36:06.067 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-19T05:36:06.068 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-19T05:36:06.068 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-19T05:36:06.068 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-19T05:36:06.068 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-19T05:36:06.068 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-19T05:36:06.068 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-19T05:36:06.068 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-19T05:36:06.068 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T05:36:06.068 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-19T05:36:06.068 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-19T05:36:06.068 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrading: 2023-12-19T05:36:06.068 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-19T05:36:06.068 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-19T05:36:06.068 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-19T05:36:06.069 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-19T05:36:06.069 INFO:teuthology.orchestra.run.smithi120.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-19T05:36:06.069 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-19T05:36:06.069 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-19T05:36:06.069 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-19T05:36:06.069 INFO:teuthology.orchestra.run.smithi120.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-19T05:36:06.069 INFO:teuthology.orchestra.run.smithi120.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-19T05:36:06.069 INFO:teuthology.orchestra.run.smithi120.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-19T05:36:06.069 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T05:36:06.069 INFO:teuthology.orchestra.run.smithi120.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-19T05:36:06.069 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-19T05:36:06.069 INFO:teuthology.orchestra.run.smithi120.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-19T05:36:06.069 INFO:teuthology.orchestra.run.smithi120.stdout:Installing dependencies: 2023-12-19T05:36:06.069 INFO:teuthology.orchestra.run.smithi120.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-19T05:36:06.070 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T05:36:06.070 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T05:36:06.070 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-19T05:36:06.070 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-19T05:36:06.070 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-19T05:36:06.070 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-19T05:36:06.070 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T05:36:06.070 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-19T05:36:06.070 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-19T05:36:06.070 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T05:36:06.070 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T05:36:06.070 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T05:36:06.070 INFO:teuthology.orchestra.run.smithi120.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-19T05:36:06.071 INFO:teuthology.orchestra.run.smithi120.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T05:36:06.071 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T05:36:06.071 INFO:teuthology.orchestra.run.smithi120.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T05:36:06.071 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T05:36:06.071 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T05:36:06.071 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-19T05:36:06.071 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T05:36:06.071 INFO:teuthology.orchestra.run.smithi120.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T05:36:06.071 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T05:36:06.071 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T05:36:06.071 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T05:36:06.072 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-19T05:36:06.072 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T05:36:06.072 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-19T05:36:06.072 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T05:36:06.072 INFO:teuthology.orchestra.run.smithi120.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-19T05:36:06.072 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T05:36:06.072 INFO:teuthology.orchestra.run.smithi120.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T05:36:06.072 INFO:teuthology.orchestra.run.smithi120.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T05:36:06.072 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T05:36:06.072 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T05:36:06.072 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-19T05:36:06.072 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T05:36:06.072 INFO:teuthology.orchestra.run.smithi120.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-19T05:36:06.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T05:36:06.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T05:36:06.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T05:36:06.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-19T05:36:06.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-19T05:36:06.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T05:36:06.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T05:36:06.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T05:36:06.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T05:36:06.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-19T05:36:06.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-19T05:36:06.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T05:36:06.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T05:36:06.073 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T05:36:06.074 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T05:36:06.074 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T05:36:06.074 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T05:36:06.074 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T05:36:06.074 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T05:36:06.074 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T05:36:06.074 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T05:36:06.074 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T05:36:06.074 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T05:36:06.075 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T05:36:06.075 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T05:36:06.075 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T05:36:06.075 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T05:36:06.075 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T05:36:06.075 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T05:36:06.075 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T05:36:06.075 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T05:36:06.076 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T05:36:06.076 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T05:36:06.076 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T05:36:06.076 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T05:36:06.076 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T05:36:06.076 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T05:36:06.076 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T05:36:06.076 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T05:36:06.076 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T05:36:06.076 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-19T05:36:06.076 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T05:36:06.076 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T05:36:06.076 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T05:36:06.076 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T05:36:06.077 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T05:36:06.077 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T05:36:06.077 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T05:36:06.077 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T05:36:06.077 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T05:36:06.077 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T05:36:06.077 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T05:36:06.077 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-19T05:36:06.077 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T05:36:06.077 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T05:36:06.078 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T05:36:06.078 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T05:36:06.078 INFO:teuthology.orchestra.run.smithi120.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T05:36:06.078 INFO:teuthology.orchestra.run.smithi120.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T05:36:06.078 INFO:teuthology.orchestra.run.smithi120.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T05:36:06.078 INFO:teuthology.orchestra.run.smithi120.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-19T05:36:06.079 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T05:36:06.079 INFO:teuthology.orchestra.run.smithi120.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-19T05:36:06.079 INFO:teuthology.orchestra.run.smithi120.stdout:Installing weak dependencies: 2023-12-19T05:36:06.079 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T05:36:06.079 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:36:06.079 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction Summary 2023-12-19T05:36:06.079 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================================ 2023-12-19T05:36:06.079 INFO:teuthology.orchestra.run.smithi120.stdout:Install 139 Packages 2023-12-19T05:36:06.079 INFO:teuthology.orchestra.run.smithi120.stdout:Upgrade 15 Packages 2023-12-19T05:36:06.079 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:36:06.081 INFO:teuthology.orchestra.run.smithi120.stdout:Total download size: 200 M 2023-12-19T05:36:06.082 INFO:teuthology.orchestra.run.smithi120.stdout:Downloading Packages: 2023-12-19T05:36:06.824 INFO:teuthology.orchestra.run.smithi120.stdout:(1/154): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 30 kB/s | 6.5 kB 00:00 2023-12-19T05:36:07.358 INFO:teuthology.orchestra.run.smithi120.stdout:(2/154): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.5 MB/s | 839 kB 00:00 2023-12-19T05:36:07.458 INFO:teuthology.orchestra.run.smithi120.stdout:(3/154): ceph-immutable-object-cache-18.2.0-137 1.4 MB/s | 142 kB 00:00 2023-12-19T05:36:07.750 INFO:teuthology.orchestra.run.smithi120.stdout:(4/154): ceph-common-18.2.0-1377.g24e2e32a.el9. 16 MB/s | 18 MB 00:01 2023-12-19T05:36:07.859 INFO:teuthology.orchestra.run.smithi120.stdout:(5/154): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 13 MB/s | 1.4 MB 00:00 2023-12-19T05:36:08.126 INFO:teuthology.orchestra.run.smithi120.stdout:(6/154): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 17 MB/s | 4.4 MB 00:00 2023-12-19T05:36:08.192 INFO:teuthology.orchestra.run.smithi120.stdout:(7/154): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 2.9 MB/s | 2.1 MB 00:00 2023-12-19T05:36:08.286 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 2.6 MB/s | 20 MB 00:07 2023-12-19T05:36:08.726 INFO:teuthology.orchestra.run.smithi120.stdout:(8/154): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 2.4 MB/s | 5.2 MB 00:02 2023-12-19T05:36:08.801 INFO:teuthology.orchestra.run.smithi120.stdout:(9/154): ceph-selinux-18.2.0-1377.g24e2e32a.el9 322 kB/s | 24 kB 00:00 2023-12-19T05:36:09.027 INFO:teuthology.orchestra.run.smithi120.stdout:(10/154): ceph-osd-18.2.0-1377.g24e2e32a.el9.x8 20 MB/s | 18 MB 00:00 2023-12-19T05:36:09.077 INFO:teuthology.orchestra.run.smithi120.stdout:(11/154): cephfs-mirror-18.2.0-1377.g24e2e32a.e 4.3 MB/s | 219 kB 00:00 2023-12-19T05:36:09.119 INFO:teuthology.orchestra.run.smithi120.stdout:(12/154): cephfs-shell-18.2.0-1377.g24e2e32a.el 649 kB/s | 27 kB 00:00 2023-12-19T05:36:09.161 INFO:teuthology.orchestra.run.smithi120.stdout:(13/154): libcephfs-devel-18.2.0-1377.g24e2e32a 744 kB/s | 31 kB 00:00 2023-12-19T05:36:09.228 INFO:teuthology.orchestra.run.smithi120.stdout:(14/154): libcephfs2-18.2.0-1377.g24e2e32a.el9. 9.6 MB/s | 658 kB 00:00 2023-12-19T05:36:09.278 INFO:teuthology.orchestra.run.smithi120.stdout:(15/154): libcephsqlite-18.2.0-1377.g24e2e32a.e 3.3 MB/s | 166 kB 00:00 2023-12-19T05:36:09.320 INFO:teuthology.orchestra.run.smithi120.stdout:(16/154): librados-devel-18.2.0-1377.g24e2e32a. 3.0 MB/s | 127 kB 00:00 2023-12-19T05:36:09.371 INFO:teuthology.orchestra.run.smithi120.stdout:(17/154): libradosstriper1-18.2.0-1377.g24e2e32 9.2 MB/s | 474 kB 00:00 2023-12-19T05:36:09.637 INFO:teuthology.orchestra.run.smithi120.stdout:(18/154): librgw2-18.2.0-1377.g24e2e32a.el9.x86 17 MB/s | 4.5 MB 00:00 2023-12-19T05:36:09.671 INFO:teuthology.orchestra.run.smithi120.stdout:(19/154): python3-ceph-argparse-18.2.0-1377.g24 1.3 MB/s | 45 kB 00:00 2023-12-19T05:36:09.713 INFO:teuthology.orchestra.run.smithi120.stdout:(20/154): python3-ceph-common-18.2.0-1377.g24e2 2.9 MB/s | 124 kB 00:00 2023-12-19T05:36:09.763 INFO:teuthology.orchestra.run.smithi120.stdout:(21/154): python3-cephfs-18.2.0-1377.g24e2e32a. 3.2 MB/s | 162 kB 00:00 2023-12-19T05:36:09.817 INFO:teuthology.orchestra.run.smithi120.stdout:(22/154): python3-rados-18.2.0-1377.g24e2e32a.e 6.2 MB/s | 319 kB 00:00 2023-12-19T05:36:09.864 INFO:teuthology.orchestra.run.smithi120.stdout:(23/154): python3-rbd-18.2.0-1377.g24e2e32a.el9 5.8 MB/s | 297 kB 00:00 2023-12-19T05:36:09.906 INFO:teuthology.orchestra.run.smithi120.stdout:(24/154): python3-rgw-18.2.0-1377.g24e2e32a.el9 2.3 MB/s | 99 kB 00:00 2023-12-19T05:36:09.948 INFO:teuthology.orchestra.run.smithi120.stdout:(25/154): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 2.0 MB/s | 87 kB 00:00 2023-12-19T05:36:10.148 INFO:teuthology.orchestra.run.smithi120.stdout:(26/154): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 15 MB/s | 3.0 MB 00:00 2023-12-19T05:36:10.198 INFO:teuthology.orchestra.run.smithi120.stdout:(27/154): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 3.4 MB/s | 171 kB 00:00 2023-12-19T05:36:10.232 INFO:teuthology.orchestra.run.smithi120.stdout:(28/154): ceph-grafana-dashboards-18.2.0-1377.g 692 kB/s | 23 kB 00:00 2023-12-19T05:36:10.274 INFO:teuthology.orchestra.run.smithi120.stdout:(29/154): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 3.1 MB/s | 132 kB 00:00 2023-12-19T05:36:10.408 INFO:teuthology.orchestra.run.smithi120.stdout:(30/154): ceph-mgr-dashboard-18.2.0-1377.g24e2e 13 MB/s | 1.8 MB 00:00 2023-12-19T05:36:10.667 INFO:teuthology.orchestra.run.smithi120.stdout:(31/154): ceph-radosgw-18.2.0-1377.g24e2e32a.el 3.1 MB/s | 7.7 MB 00:02 2023-12-19T05:36:10.817 INFO:teuthology.orchestra.run.smithi120.stdout:(32/154): ceph-mgr-diskprediction-local-18.2.0- 18 MB/s | 7.4 MB 00:00 2023-12-19T05:36:10.844 INFO:teuthology.orchestra.run.smithi120.stdout:(33/154): ceph-mgr-modules-core-18.2.0-1377.g24 1.3 MB/s | 242 kB 00:00 2023-12-19T05:36:10.867 INFO:teuthology.orchestra.run.smithi120.stdout:(34/154): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 1.0 MB/s | 50 kB 00:00 2023-12-19T05:36:10.901 INFO:teuthology.orchestra.run.smithi120.stdout:(35/154): ceph-prometheus-alerts-18.2.0-1377.g2 250 kB/s | 15 kB 00:00 2023-12-19T05:36:10.926 INFO:teuthology.orchestra.run.smithi120.stdout:(36/154): ceph-volume-18.2.0-1377.g24e2e32a.el9 4.4 MB/s | 262 kB 00:00 2023-12-19T05:36:10.960 INFO:teuthology.orchestra.run.smithi120.stdout:(37/154): cephadm-18.2.0-1377.g24e2e32a.el9.noa 3.7 MB/s | 221 kB 00:00 2023-12-19T05:36:10.985 INFO:teuthology.orchestra.run.smithi120.stdout:(38/154): cephfs-top-18.2.0-1377.g24e2e32a.el9. 307 kB/s | 18 kB 00:00 2023-12-19T05:36:11.127 INFO:teuthology.orchestra.run.smithi120.stdout:(39/154): automake-1.16.2-8.el9.noarch.rpm 3.9 MB/s | 662 kB 00:00 2023-12-19T05:36:11.169 INFO:teuthology.orchestra.run.smithi120.stdout:(40/154): bison-3.7.4-5.el9.x86_64.rpm 4.9 MB/s | 920 kB 00:00 2023-12-19T05:36:11.194 INFO:teuthology.orchestra.run.smithi120.stdout:(41/154): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2023-12-19T05:36:11.212 INFO:teuthology.orchestra.run.smithi120.stdout:(42/154): elfutils-libelf-devel-0.190-1.el9.x86 513 kB/s | 21 kB 00:00 2023-12-19T05:36:11.237 INFO:teuthology.orchestra.run.smithi120.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 7.1 MB/s | 307 kB 00:00 2023-12-19T05:36:11.254 INFO:teuthology.orchestra.run.smithi120.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 759 kB/s | 32 kB 00:00 2023-12-19T05:36:11.346 INFO:teuthology.orchestra.run.smithi120.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2023-12-19T05:36:11.363 INFO:teuthology.orchestra.run.smithi120.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 159 kB/s | 17 kB 00:00 2023-12-19T05:36:11.388 INFO:teuthology.orchestra.run.smithi120.stdout:(47/154): jq-1.6-16.el9.x86_64.rpm 4.3 MB/s | 186 kB 00:00 2023-12-19T05:36:11.405 INFO:teuthology.orchestra.run.smithi120.stdout:(48/154): libaio-devel-0.3.111-13.el9.x86_64.rp 240 kB/s | 10 kB 00:00 2023-12-19T05:36:11.431 INFO:teuthology.orchestra.run.smithi120.stdout:(49/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-12-19T05:36:11.448 INFO:teuthology.orchestra.run.smithi120.stdout:(50/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-12-19T05:36:11.481 INFO:teuthology.orchestra.run.smithi120.stdout:(51/154): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-19T05:36:11.515 INFO:teuthology.orchestra.run.smithi120.stdout:(52/154): libtool-2.4.6-45.el9.x86_64.rpm 8.4 MB/s | 578 kB 00:00 2023-12-19T05:36:11.532 INFO:teuthology.orchestra.run.smithi120.stdout:(53/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 492 kB/s | 24 kB 00:00 2023-12-19T05:36:11.549 INFO:teuthology.orchestra.run.smithi120.stdout:(54/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.3 MB/s | 46 kB 00:00 2023-12-19T05:36:11.574 INFO:teuthology.orchestra.run.smithi120.stdout:(55/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-12-19T05:36:11.599 INFO:teuthology.orchestra.run.smithi120.stdout:(56/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2023-12-19T05:36:11.616 INFO:teuthology.orchestra.run.smithi120.stdout:(57/154): openblas-0.3.21-2.el9.x86_64.rpm 818 kB/s | 34 kB 00:00 2023-12-19T05:36:11.742 INFO:teuthology.orchestra.run.smithi120.stdout:(58/154): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2023-12-19T05:36:11.792 INFO:teuthology.orchestra.run.smithi120.stdout:(59/154): postgresql-13.11-1.el9.x86_64.rpm 8.7 MB/s | 1.5 MB 00:00 2023-12-19T05:36:11.817 INFO:teuthology.orchestra.run.smithi120.stdout:(60/154): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2023-12-19T05:36:11.843 INFO:teuthology.orchestra.run.smithi120.stdout:(61/154): postgresql-private-libs-13.11-1.el9.x 2.7 MB/s | 134 kB 00:00 2023-12-19T05:36:12.027 INFO:teuthology.orchestra.run.smithi120.stdout:(62/154): postgresql-server-13.11-1.el9.x86_64. 27 MB/s | 5.7 MB 00:00 2023-12-19T05:36:12.052 INFO:teuthology.orchestra.run.smithi120.stdout:(63/154): python3-attrs-20.3.0-7.el9.noarch.rpm 375 kB/s | 78 kB 00:00 2023-12-19T05:36:12.110 INFO:teuthology.orchestra.run.smithi120.stdout:(64/154): python3-jinja2-2.11.3-4.el9.noarch.rp 3.8 MB/s | 228 kB 00:00 2023-12-19T05:36:12.211 INFO:teuthology.orchestra.run.smithi120.stdout:(65/154): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 5.8 MB 00:00 2023-12-19T05:36:12.236 INFO:teuthology.orchestra.run.smithi120.stdout:(66/154): python3-jsonpatch-1.21-16.el9.noarch. 198 kB/s | 24 kB 00:00 2023-12-19T05:36:12.261 INFO:teuthology.orchestra.run.smithi120.stdout:(67/154): python3-jsonpointer-2.0-4.el9.noarch. 359 kB/s | 18 kB 00:00 2023-12-19T05:36:12.286 INFO:teuthology.orchestra.run.smithi120.stdout:(68/154): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2023-12-19T05:36:12.312 INFO:teuthology.orchestra.run.smithi120.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 633 kB/s | 32 kB 00:00 2023-12-19T05:36:12.421 INFO:teuthology.orchestra.run.smithi120.stdout:(70/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2023-12-19T05:36:12.446 INFO:teuthology.orchestra.run.smithi120.stdout:(71/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2023-12-19T05:36:12.471 INFO:teuthology.orchestra.run.smithi120.stdout:(72/154): python3-oauthlib-3.1.1-5.el9.noarch.r 3.4 MB/s | 174 kB 00:00 2023-12-19T05:36:12.489 INFO:teuthology.orchestra.run.smithi120.stdout:(73/154): python3-prettytable-0.7.2-27.el9.noar 989 kB/s | 41 kB 00:00 2023-12-19T05:36:12.513 INFO:teuthology.orchestra.run.smithi120.stdout:(74/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2023-12-19T05:36:12.539 INFO:teuthology.orchestra.run.smithi120.stdout:(75/154): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-12-19T05:36:12.556 INFO:teuthology.orchestra.run.smithi120.stdout:(76/154): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2023-12-19T05:36:12.573 INFO:teuthology.orchestra.run.smithi120.stdout:(77/154): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2023-12-19T05:36:12.748 INFO:teuthology.orchestra.run.smithi120.stdout:(78/154): python3-toml-0.10.2-6.el9.noarch.rpm 221 kB/s | 39 kB 00:00 2023-12-19T05:36:13.074 INFO:teuthology.orchestra.run.smithi120.stdout:(79/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2023-12-19T05:36:13.083 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2023-12-19T05:36:13.091 INFO:teuthology.orchestra.run.smithi120.stdout:(80/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 120 kB/s | 41 kB 00:00 2023-12-19T05:36:13.124 INFO:teuthology.orchestra.run.smithi120.stdout:(81/154): socat-1.7.4.1-5.el9.x86_64.rpm 5.8 MB/s | 300 kB 00:00 2023-12-19T05:36:13.141 INFO:teuthology.orchestra.run.smithi120.stdout:(82/154): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2023-12-19T05:36:13.175 INFO:teuthology.orchestra.run.smithi120.stdout:(83/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 85 kB 00:00 2023-12-19T05:36:13.192 INFO:teuthology.orchestra.run.smithi120.stdout:(84/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2023-12-19T05:36:13.225 INFO:teuthology.orchestra.run.smithi120.stdout:(85/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 877 kB/s | 44 kB 00:00 2023-12-19T05:36:13.251 INFO:teuthology.orchestra.run.smithi120.stdout:(86/154): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-12-19T05:36:13.284 INFO:teuthology.orchestra.run.smithi120.stdout:(87/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 13 MB/s | 803 kB 00:00 2023-12-19T05:36:13.309 INFO:teuthology.orchestra.run.smithi120.stdout:(88/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2023-12-19T05:36:13.335 INFO:teuthology.orchestra.run.smithi120.stdout:(89/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2023-12-19T05:36:13.377 INFO:teuthology.orchestra.run.smithi120.stdout:(90/154): python3-cryptography-36.0.1-4.el9.x86 17 MB/s | 1.1 MB 00:00 2023-12-19T05:36:13.402 INFO:teuthology.orchestra.run.smithi120.stdout:(91/154): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2023-12-19T05:36:13.427 INFO:teuthology.orchestra.run.smithi120.stdout:(92/154): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2023-12-19T05:36:13.453 INFO:teuthology.orchestra.run.smithi120.stdout:(93/154): python3-requests-2.25.1-7.el9.noarch. 2.2 MB/s | 113 kB 00:00 2023-12-19T05:36:13.478 INFO:teuthology.orchestra.run.smithi120.stdout:(94/154): python3-urllib3-1.26.5-4.el9.noarch.r 3.6 MB/s | 187 kB 00:00 2023-12-19T05:36:13.987 INFO:teuthology.orchestra.run.smithi120.stdout:(95/154): python3-devel-3.9.17-2.el9.x86_64.rpm 483 kB/s | 245 kB 00:00 2023-12-19T05:36:14.545 INFO:teuthology.orchestra.run.smithi120.stdout:(96/154): openssl-devel-3.0.7-25.el9.x86_64.rpm 3.8 MB/s | 4.1 MB 00:01 2023-12-19T05:36:14.571 INFO:teuthology.orchestra.run.smithi120.stdout:(97/154): fmt-8.1.1-5.el9.x86_64.rpm 190 kB/s | 111 kB 00:00 2023-12-19T05:36:14.813 INFO:teuthology.orchestra.run.smithi120.stdout:(98/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.1 MB/s | 309 kB 00:00 2023-12-19T05:36:14.921 INFO:teuthology.orchestra.run.smithi120.stdout:(99/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 240 kB/s | 26 kB 00:00 2023-12-19T05:36:15.030 INFO:teuthology.orchestra.run.smithi120.stdout:(100/154): liboath-2.6.7-2.el9.x86_64.rpm 448 kB/s | 49 kB 00:00 2023-12-19T05:36:15.139 INFO:teuthology.orchestra.run.smithi120.stdout:(101/154): libunwind-1.6.2-1.el9.x86_64.rpm 621 kB/s | 67 kB 00:00 2023-12-19T05:36:15.389 INFO:teuthology.orchestra.run.smithi120.stdout:(102/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.3 MB/s | 838 kB 00:00 2023-12-19T05:36:15.467 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T05:36:15.468 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T05:36:15.482 INFO:teuthology.orchestra.run.smithi155.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-19T05:36:15.483 INFO:teuthology.orchestra.run.smithi155.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-19T05:36:15.484 INFO:teuthology.orchestra.run.smithi155.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T05:36:15.485 INFO:teuthology.orchestra.run.smithi155.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-19T05:36:15.487 INFO:teuthology.orchestra.run.smithi155.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T05:36:15.490 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-19T05:36:15.491 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T05:36:15.556 INFO:teuthology.orchestra.run.smithi120.stdout:(103/154): libarrow-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2023-12-19T05:36:15.565 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2023-12-19T05:36:15.582 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================ 2023-12-19T05:36:15.583 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2023-12-19T05:36:15.583 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================ 2023-12-19T05:36:15.583 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2023-12-19T05:36:15.583 INFO:teuthology.orchestra.run.smithi155.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-19T05:36:15.583 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-19T05:36:15.583 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-19T05:36:15.584 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-19T05:36:15.584 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-19T05:36:15.584 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-19T05:36:15.584 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-19T05:36:15.584 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-19T05:36:15.584 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-19T05:36:15.585 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-19T05:36:15.585 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-19T05:36:15.585 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-19T05:36:15.585 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-19T05:36:15.585 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-19T05:36:15.585 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-19T05:36:15.585 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-19T05:36:15.586 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-19T05:36:15.586 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-19T05:36:15.586 INFO:teuthology.orchestra.run.smithi155.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-19T05:36:15.586 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-19T05:36:15.586 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-19T05:36:15.587 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-19T05:36:15.587 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-19T05:36:15.587 INFO:teuthology.orchestra.run.smithi155.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-19T05:36:15.587 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-19T05:36:15.587 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-19T05:36:15.587 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-19T05:36:15.587 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-19T05:36:15.587 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-19T05:36:15.588 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-19T05:36:15.588 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-19T05:36:15.588 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-19T05:36:15.588 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-19T05:36:15.588 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-19T05:36:15.588 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T05:36:15.588 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-19T05:36:15.589 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-19T05:36:15.589 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2023-12-19T05:36:15.589 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-19T05:36:15.589 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-19T05:36:15.589 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-19T05:36:15.589 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-19T05:36:15.590 INFO:teuthology.orchestra.run.smithi155.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-19T05:36:15.590 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-19T05:36:15.590 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-19T05:36:15.590 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-19T05:36:15.590 INFO:teuthology.orchestra.run.smithi155.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-19T05:36:15.590 INFO:teuthology.orchestra.run.smithi155.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-19T05:36:15.591 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-19T05:36:15.591 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T05:36:15.591 INFO:teuthology.orchestra.run.smithi155.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-19T05:36:15.591 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-19T05:36:15.591 INFO:teuthology.orchestra.run.smithi155.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-19T05:36:15.591 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2023-12-19T05:36:15.591 INFO:teuthology.orchestra.run.smithi155.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-19T05:36:15.592 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T05:36:15.592 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T05:36:15.592 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-19T05:36:15.592 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-19T05:36:15.593 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-19T05:36:15.593 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-19T05:36:15.593 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T05:36:15.593 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-19T05:36:15.593 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-19T05:36:15.593 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T05:36:15.594 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T05:36:15.594 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T05:36:15.594 INFO:teuthology.orchestra.run.smithi155.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-19T05:36:15.594 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T05:36:15.594 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T05:36:15.594 INFO:teuthology.orchestra.run.smithi155.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T05:36:15.594 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T05:36:15.595 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T05:36:15.595 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-19T05:36:15.595 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T05:36:15.595 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T05:36:15.595 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T05:36:15.595 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T05:36:15.595 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T05:36:15.595 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-19T05:36:15.596 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T05:36:15.596 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-19T05:36:15.596 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T05:36:15.596 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-19T05:36:15.596 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T05:36:15.596 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T05:36:15.596 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T05:36:15.596 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T05:36:15.597 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T05:36:15.597 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-19T05:36:15.597 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T05:36:15.597 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-19T05:36:15.597 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T05:36:15.597 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T05:36:15.597 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T05:36:15.597 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-19T05:36:15.598 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-19T05:36:15.598 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T05:36:15.598 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T05:36:15.598 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T05:36:15.598 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T05:36:15.598 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-19T05:36:15.598 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-19T05:36:15.599 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T05:36:15.599 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T05:36:15.599 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T05:36:15.599 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T05:36:15.599 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T05:36:15.599 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T05:36:15.599 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T05:36:15.599 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T05:36:15.599 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T05:36:15.599 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T05:36:15.599 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T05:36:15.600 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T05:36:15.600 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T05:36:15.600 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T05:36:15.600 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T05:36:15.600 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T05:36:15.600 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T05:36:15.600 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T05:36:15.600 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T05:36:15.601 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T05:36:15.601 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T05:36:15.601 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T05:36:15.601 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T05:36:15.601 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T05:36:15.601 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T05:36:15.601 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T05:36:15.601 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T05:36:15.602 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T05:36:15.602 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T05:36:15.602 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-19T05:36:15.602 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T05:36:15.602 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T05:36:15.602 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T05:36:15.602 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T05:36:15.602 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T05:36:15.603 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T05:36:15.603 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T05:36:15.603 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T05:36:15.603 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T05:36:15.603 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T05:36:15.603 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T05:36:15.603 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-19T05:36:15.603 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T05:36:15.603 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T05:36:15.604 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T05:36:15.604 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T05:36:15.604 INFO:teuthology.orchestra.run.smithi155.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T05:36:15.604 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T05:36:15.604 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T05:36:15.604 INFO:teuthology.orchestra.run.smithi155.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-19T05:36:15.605 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T05:36:15.605 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-19T05:36:15.605 INFO:teuthology.orchestra.run.smithi155.stdout:Installing weak dependencies: 2023-12-19T05:36:15.605 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T05:36:15.605 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:36:15.605 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2023-12-19T05:36:15.606 INFO:teuthology.orchestra.run.smithi155.stdout:============================================================================================ 2023-12-19T05:36:15.606 INFO:teuthology.orchestra.run.smithi155.stdout:Install 139 Packages 2023-12-19T05:36:15.606 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 15 Packages 2023-12-19T05:36:15.606 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:36:15.607 INFO:teuthology.orchestra.run.smithi120.stdout:(104/154): python3-asyncssh-2.13.2-3.el9.noarch 2.7 MB/s | 548 kB 00:00 2023-12-19T05:36:15.608 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 200 M 2023-12-19T05:36:15.608 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2023-12-19T05:36:15.657 INFO:teuthology.orchestra.run.smithi120.stdout:(105/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 432 kB/s | 43 kB 00:00 2023-12-19T05:36:15.690 INFO:teuthology.orchestra.run.smithi120.stdout:(106/154): python3-cachetools-4.2.4-1.el9.noarc 321 kB/s | 32 kB 00:00 2023-12-19T05:36:15.766 INFO:teuthology.orchestra.run.smithi120.stdout:(107/154): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2023-12-19T05:36:15.799 INFO:teuthology.orchestra.run.smithi120.stdout:(108/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2023-12-19T05:36:15.900 INFO:teuthology.orchestra.run.smithi120.stdout:(109/154): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2023-12-19T05:36:15.925 INFO:teuthology.orchestra.run.smithi120.stdout:(110/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2023-12-19T05:36:15.983 INFO:teuthology.orchestra.run.smithi155.stdout:(1/154): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 34 kB/s | 6.5 kB 00:00 2023-12-19T05:36:15.991 INFO:teuthology.orchestra.run.smithi120.stdout:(111/154): python3-colorama-0.4.4-12.el9.noarch 385 kB/s | 35 kB 00:00 2023-12-19T05:36:16.007 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - AppStream 763 kB/s | 18 MB 00:24 2023-12-19T05:36:16.042 INFO:teuthology.orchestra.run.smithi120.stdout:(112/154): python3-google-auth-2.23.4-1.el9.noa 1.7 MB/s | 197 kB 00:00 2023-12-19T05:36:16.084 INFO:teuthology.orchestra.run.smithi120.stdout:(113/154): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2023-12-19T05:36:16.134 INFO:teuthology.orchestra.run.smithi120.stdout:(114/154): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2023-12-19T05:36:16.176 INFO:teuthology.orchestra.run.smithi120.stdout:(115/154): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2023-12-19T05:36:16.227 INFO:teuthology.orchestra.run.smithi120.stdout:(116/154): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2023-12-19T05:36:16.269 INFO:teuthology.orchestra.run.smithi120.stdout:(117/154): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2023-12-19T05:36:16.319 INFO:teuthology.orchestra.run.smithi120.stdout:(118/154): python3-jwt+crypto-2.4.0-1.el9.noarc 98 kB/s | 9.0 kB 00:00 2023-12-19T05:36:16.325 INFO:teuthology.orchestra.run.smithi155.stdout:(2/154): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 2.4 MB/s | 839 kB 00:00 2023-12-19T05:36:16.361 INFO:teuthology.orchestra.run.smithi120.stdout:(119/154): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2023-12-19T05:36:16.400 INFO:teuthology.orchestra.run.smithi155.stdout:(3/154): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 8.5 MB/s | 5.2 MB 00:00 2023-12-19T05:36:16.417 INFO:teuthology.orchestra.run.smithi155.stdout:(4/154): ceph-immutable-object-cache-18.2.0-137 1.5 MB/s | 142 kB 00:00 2023-12-19T05:36:16.461 INFO:teuthology.orchestra.run.smithi120.stdout:(120/154): python3-logutils-0.3.5-21.el9.noarch 463 kB/s | 46 kB 00:00 2023-12-19T05:36:16.495 INFO:teuthology.orchestra.run.smithi120.stdout:(121/154): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2023-12-19T05:36:16.559 INFO:teuthology.orchestra.run.smithi155.stdout:(5/154): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 13 MB/s | 2.1 MB 00:00 2023-12-19T05:36:16.561 INFO:teuthology.orchestra.run.smithi120.stdout:(122/154): python3-more-itertools-8.12.0-2.el9. 786 kB/s | 79 kB 00:00 2023-12-19T05:36:16.587 INFO:teuthology.orchestra.run.smithi120.stdout:(123/154): python3-natsort-7.1.1-5.el9.noarch.r 627 kB/s | 58 kB 00:00 2023-12-19T05:36:16.671 INFO:teuthology.orchestra.run.smithi120.stdout:(124/154): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2023-12-19T05:36:16.688 INFO:teuthology.orchestra.run.smithi120.stdout:(125/154): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2023-12-19T05:36:16.771 INFO:teuthology.orchestra.run.smithi120.stdout:(126/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 897 kB/s | 90 kB 00:00 2023-12-19T05:36:16.788 INFO:teuthology.orchestra.run.smithi120.stdout:(127/154): python3-pyperclip-1.8.2-2.el9.noarch 281 kB/s | 28 kB 00:00 2023-12-19T05:36:16.860 INFO:teuthology.orchestra.run.smithi155.stdout:(6/154): ceph-mon-18.2.0-1377.g24e2e32a.el9.x86 15 MB/s | 4.4 MB 00:00 2023-12-19T05:36:16.864 INFO:teuthology.orchestra.run.smithi120.stdout:(128/154): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2023-12-19T05:36:16.897 INFO:teuthology.orchestra.run.smithi120.stdout:(129/154): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-12-19T05:36:16.901 INFO:teuthology.orchestra.run.smithi155.stdout:(7/154): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 3.0 MB/s | 1.4 MB 00:00 2023-12-19T05:36:16.956 INFO:teuthology.orchestra.run.smithi120.stdout:(130/154): python3-rsa-4.9-2.el9.noarch.rpm 640 kB/s | 59 kB 00:00 2023-12-19T05:36:16.990 INFO:teuthology.orchestra.run.smithi120.stdout:(131/154): python3-tempora-5.0.0-2.el9.noarch.r 387 kB/s | 36 kB 00:00 2023-12-19T05:36:17.049 INFO:teuthology.orchestra.run.smithi120.stdout:(132/154): python3-typing-extensions-4.4.0-2.el 555 kB/s | 51 kB 00:00 2023-12-19T05:36:17.099 INFO:teuthology.orchestra.run.smithi120.stdout:(133/154): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2023-12-19T05:36:17.149 INFO:teuthology.orchestra.run.smithi120.stdout:(134/154): python3-websocket-client-1.2.3-2.el9 894 kB/s | 90 kB 00:00 2023-12-19T05:36:17.224 INFO:teuthology.orchestra.run.smithi120.stdout:(135/154): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2023-12-19T05:36:17.250 INFO:teuthology.orchestra.run.smithi120.stdout:(136/154): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2023-12-19T05:36:17.334 INFO:teuthology.orchestra.run.smithi120.stdout:(137/154): re2-20211101-3.el9.x86_64.rpm 1.7 MB/s | 192 kB 00:00 2023-12-19T05:36:17.394 INFO:teuthology.orchestra.run.smithi120.stdout:(138/154): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-12-19T05:36:18.034 INFO:teuthology.orchestra.run.smithi120.stdout:(139/154): librbd1-18.2.0-1377.g24e2e32a.el9.x8 4.7 MB/s | 3.0 MB 00:00 2023-12-19T05:36:18.077 INFO:teuthology.orchestra.run.smithi155.stdout:(8/154): ceph-osd-18.2.0-1377.g24e2e32a.el9.x86 14 MB/s | 18 MB 00:01 2023-12-19T05:36:18.101 INFO:teuthology.orchestra.run.smithi120.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 68 kB 00:00 2023-12-19T05:36:18.127 INFO:teuthology.orchestra.run.smithi155.stdout:(9/154): ceph-selinux-18.2.0-1377.g24e2e32a.el9 485 kB/s | 24 kB 00:00 2023-12-19T05:36:18.468 INFO:teuthology.orchestra.run.smithi120.stdout:(141/154): ceph-test-18.2.0-1377.g24e2e32a.el9. 4.1 MB/s | 40 MB 00:09 2023-12-19T05:36:18.493 INFO:teuthology.orchestra.run.smithi120.stdout:(142/154): acl-2.3.1-4.el9.x86_64.rpm 175 kB/s | 69 kB 00:00 2023-12-19T05:36:18.502 INFO:teuthology.orchestra.run.smithi155.stdout:(10/154): ceph-radosgw-18.2.0-1377.g24e2e32a.el 4.8 MB/s | 7.7 MB 00:01 2023-12-19T05:36:18.535 INFO:teuthology.orchestra.run.smithi120.stdout:(143/154): elfutils-debuginfod-client-0.190-1.e 549 kB/s | 36 kB 00:00 2023-12-19T05:36:18.561 INFO:teuthology.orchestra.run.smithi155.stdout:(11/154): cephfs-mirror-18.2.0-1377.g24e2e32a.e 3.7 MB/s | 219 kB 00:00 2023-12-19T05:36:18.568 INFO:teuthology.orchestra.run.smithi120.stdout:(144/154): elfutils-libelf-0.190-1.el9.x86_64.r 2.5 MB/s | 192 kB 00:00 2023-12-19T05:36:18.603 INFO:teuthology.orchestra.run.smithi155.stdout:(12/154): cephfs-shell-18.2.0-1377.g24e2e32a.el 650 kB/s | 27 kB 00:00 2023-12-19T05:36:18.645 INFO:teuthology.orchestra.run.smithi155.stdout:(13/154): libcephfs-devel-18.2.0-1377.g24e2e32a 747 kB/s | 31 kB 00:00 2023-12-19T05:36:18.736 INFO:teuthology.orchestra.run.smithi155.stdout:(14/154): libcephfs2-18.2.0-1377.g24e2e32a.el9. 7.0 MB/s | 658 kB 00:00 2023-12-19T05:36:18.787 INFO:teuthology.orchestra.run.smithi155.stdout:(15/154): libcephsqlite-18.2.0-1377.g24e2e32a.e 3.3 MB/s | 166 kB 00:00 2023-12-19T05:36:18.802 INFO:teuthology.orchestra.run.smithi120.stdout:(145/154): librados2-18.2.0-1377.g24e2e32a.el9. 2.2 MB/s | 3.3 MB 00:01 2023-12-19T05:36:18.837 INFO:teuthology.orchestra.run.smithi155.stdout:(16/154): librados-devel-18.2.0-1377.g24e2e32a. 2.5 MB/s | 127 kB 00:00 2023-12-19T05:36:18.895 INFO:teuthology.orchestra.run.smithi120.stdout:(146/154): elfutils-libs-0.190-1.el9.x86_64.rpm 711 kB/s | 255 kB 00:00 2023-12-19T05:36:18.920 INFO:teuthology.orchestra.run.smithi120.stdout:(147/154): libacl-2.3.1-4.el9.x86_64.rpm 62 kB/s | 22 kB 00:00 2023-12-19T05:36:18.920 INFO:teuthology.orchestra.run.smithi155.stdout:(17/154): libradosstriper1-18.2.0-1377.g24e2e32 5.6 MB/s | 474 kB 00:00 2023-12-19T05:36:18.970 INFO:teuthology.orchestra.run.smithi120.stdout:(148/154): xfsdump-3.1.12-4.el9.x86_64.rpm 1.9 MB/s | 321 kB 00:00 2023-12-19T05:36:19.354 INFO:teuthology.orchestra.run.smithi120.stdout:(149/154): NetworkManager-team-1.45.7-1.el9.x86 113 kB/s | 43 kB 00:00 2023-12-19T05:36:19.388 INFO:teuthology.orchestra.run.smithi155.stdout:(18/154): librgw2-18.2.0-1377.g24e2e32a.el9.x86 9.5 MB/s | 4.5 MB 00:00 2023-12-19T05:36:19.430 INFO:teuthology.orchestra.run.smithi155.stdout:(19/154): python3-ceph-argparse-18.2.0-1377.g24 1.1 MB/s | 45 kB 00:00 2023-12-19T05:36:19.480 INFO:teuthology.orchestra.run.smithi155.stdout:(20/154): python3-ceph-common-18.2.0-1377.g24e2 2.4 MB/s | 124 kB 00:00 2023-12-19T05:36:19.539 INFO:teuthology.orchestra.run.smithi155.stdout:(21/154): python3-cephfs-18.2.0-1377.g24e2e32a. 2.7 MB/s | 162 kB 00:00 2023-12-19T05:36:19.614 INFO:teuthology.orchestra.run.smithi155.stdout:(22/154): python3-rados-18.2.0-1377.g24e2e32a.e 4.2 MB/s | 319 kB 00:00 2023-12-19T05:36:19.696 INFO:teuthology.orchestra.run.smithi120.stdout:(150/154): NetworkManager-tui-1.45.7-1.el9.x86_ 723 kB/s | 246 kB 00:00 2023-12-19T05:36:19.698 INFO:teuthology.orchestra.run.smithi155.stdout:(23/154): python3-rbd-18.2.0-1377.g24e2e32a.el9 3.5 MB/s | 297 kB 00:00 2023-12-19T05:36:19.748 INFO:teuthology.orchestra.run.smithi155.stdout:(24/154): python3-rgw-18.2.0-1377.g24e2e32a.el9 1.9 MB/s | 99 kB 00:00 2023-12-19T05:36:19.799 INFO:teuthology.orchestra.run.smithi155.stdout:(25/154): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.7 MB/s | 87 kB 00:00 2023-12-19T05:36:19.837 INFO:teuthology.orchestra.run.smithi120.stdout:(151/154): NetworkManager-1.45.7-1.el9.x86_64.r 2.5 MB/s | 2.3 MB 00:00 2023-12-19T05:36:19.913 INFO:teuthology.orchestra.run.smithi120.stdout:(152/154): NetworkManager-libnm-1.45.7-1.el9.x8 1.8 MB/s | 1.8 MB 00:00 2023-12-19T05:36:20.132 INFO:teuthology.orchestra.run.smithi155.stdout:(26/154): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 8.9 MB/s | 3.0 MB 00:00 2023-12-19T05:36:20.182 INFO:teuthology.orchestra.run.smithi155.stdout:(27/154): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 3.4 MB/s | 171 kB 00:00 2023-12-19T05:36:20.233 INFO:teuthology.orchestra.run.smithi155.stdout:(28/154): ceph-grafana-dashboards-18.2.0-1377.g 465 kB/s | 23 kB 00:00 2023-12-19T05:36:20.283 INFO:teuthology.orchestra.run.smithi155.stdout:(29/154): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 2.6 MB/s | 132 kB 00:00 2023-12-19T05:36:20.508 INFO:teuthology.orchestra.run.smithi155.stdout:(30/154): ceph-mgr-dashboard-18.2.0-1377.g24e2e 7.8 MB/s | 1.8 MB 00:00 2023-12-19T05:36:20.932 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 5.8 MB 00:01 2023-12-19T05:36:21.271 INFO:teuthology.orchestra.run.smithi120.stdout:(153/154): openssl-3.0.7-25.el9.x86_64.rpm 788 kB/s | 1.2 MB 00:01 2023-12-19T05:36:21.313 INFO:teuthology.orchestra.run.smithi120.stdout:(154/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 1.5 MB/s | 2.2 MB 00:01 2023-12-19T05:36:21.318 INFO:teuthology.orchestra.run.smithi120.stdout:-------------------------------------------------------------------------------- 2023-12-19T05:36:21.318 INFO:teuthology.orchestra.run.smithi120.stdout:Total 13 MB/s | 200 MB 00:15 2023-12-19T05:36:21.367 INFO:teuthology.orchestra.run.smithi155.stdout:(31/154): ceph-mgr-diskprediction-local-18.2.0- 8.6 MB/s | 7.4 MB 00:00 2023-12-19T05:36:21.483 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction check 2023-12-19T05:36:21.669 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction check succeeded. 2023-12-19T05:36:21.669 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction test 2023-12-19T05:36:21.734 INFO:teuthology.orchestra.run.smithi155.stdout:(32/154): ceph-test-18.2.0-1377.g24e2e32a.el9.x 11 MB/s | 40 MB 00:03 2023-12-19T05:36:21.759 INFO:teuthology.orchestra.run.smithi155.stdout:(33/154): ceph-mgr-modules-core-18.2.0-1377.g24 618 kB/s | 242 kB 00:00 2023-12-19T05:36:21.784 INFO:teuthology.orchestra.run.smithi155.stdout:(34/154): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 1.0 MB/s | 50 kB 00:00 2023-12-19T05:36:21.809 INFO:teuthology.orchestra.run.smithi155.stdout:(35/154): ceph-prometheus-alerts-18.2.0-1377.g2 292 kB/s | 15 kB 00:00 2023-12-19T05:36:21.860 INFO:teuthology.orchestra.run.smithi155.stdout:(36/154): ceph-volume-18.2.0-1377.g24e2e32a.el9 3.4 MB/s | 262 kB 00:00 2023-12-19T05:36:21.885 INFO:teuthology.orchestra.run.smithi155.stdout:(37/154): cephadm-18.2.0-1377.g24e2e32a.el9.noa 2.9 MB/s | 221 kB 00:00 2023-12-19T05:36:21.910 INFO:teuthology.orchestra.run.smithi155.stdout:(38/154): cephfs-top-18.2.0-1377.g24e2e32a.el9. 361 kB/s | 18 kB 00:00 2023-12-19T05:36:22.185 INFO:teuthology.orchestra.run.smithi155.stdout:(39/154): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 662 kB 00:00 2023-12-19T05:36:22.236 INFO:teuthology.orchestra.run.smithi155.stdout:(40/154): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 106 kB 00:00 2023-12-19T05:36:22.269 INFO:teuthology.orchestra.run.smithi155.stdout:(41/154): bison-3.7.4-5.el9.x86_64.rpm 2.5 MB/s | 920 kB 00:00 2023-12-19T05:36:22.295 INFO:teuthology.orchestra.run.smithi155.stdout:(42/154): elfutils-libelf-devel-0.190-1.el9.x86 368 kB/s | 21 kB 00:00 2023-12-19T05:36:22.328 INFO:teuthology.orchestra.run.smithi155.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 307 kB 00:00 2023-12-19T05:36:22.353 INFO:teuthology.orchestra.run.smithi155.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 545 kB/s | 32 kB 00:00 2023-12-19T05:36:22.495 INFO:teuthology.orchestra.run.smithi155.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2023-12-19T05:36:22.520 INFO:teuthology.orchestra.run.smithi155.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 103 kB/s | 17 kB 00:00 2023-12-19T05:36:22.546 INFO:teuthology.orchestra.run.smithi155.stdout:(47/154): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2023-12-19T05:36:22.563 INFO:teuthology.orchestra.run.smithi155.stdout:(48/154): libaio-devel-0.3.111-13.el9.x86_64.rp 242 kB/s | 10 kB 00:00 2023-12-19T05:36:22.596 INFO:teuthology.orchestra.run.smithi155.stdout:(49/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2023-12-19T05:36:22.624 INFO:teuthology.orchestra.run.smithi155.stdout:(50/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 728 kB/s | 44 kB 00:00 2023-12-19T05:36:22.657 INFO:teuthology.orchestra.run.smithi155.stdout:(51/154): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-12-19T05:36:22.691 INFO:teuthology.orchestra.run.smithi155.stdout:(52/154): libtool-2.4.6-45.el9.x86_64.rpm 8.6 MB/s | 578 kB 00:00 2023-12-19T05:36:22.777 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 15 kB 00:00 2023-12-19T05:36:22.875 INFO:teuthology.orchestra.run.smithi155.stdout:(53/154): ceph-common-18.2.0-1377.g24e2e32a.el9 2.6 MB/s | 18 MB 00:07 2023-12-19T05:36:22.900 INFO:teuthology.orchestra.run.smithi155.stdout:(54/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 101 kB/s | 24 kB 00:00 2023-12-19T05:36:22.925 INFO:teuthology.orchestra.run.smithi155.stdout:(55/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 198 kB/s | 46 kB 00:00 2023-12-19T05:36:22.959 INFO:teuthology.orchestra.run.smithi155.stdout:(56/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-12-19T05:36:22.984 INFO:teuthology.orchestra.run.smithi155.stdout:(57/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.5 MB/s | 217 kB 00:00 2023-12-19T05:36:23.009 INFO:teuthology.orchestra.run.smithi155.stdout:(58/154): openblas-0.3.21-2.el9.x86_64.rpm 408 kB/s | 34 kB 00:00 2023-12-19T05:36:23.159 INFO:teuthology.orchestra.run.smithi155.stdout:(59/154): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2023-12-19T05:36:23.210 INFO:teuthology.orchestra.run.smithi155.stdout:(60/154): postgresql-13.11-1.el9.x86_64.rpm 7.7 MB/s | 1.5 MB 00:00 2023-12-19T05:36:23.235 INFO:teuthology.orchestra.run.smithi155.stdout:(61/154): postgresql-contrib-13.11-1.el9.x86_64 3.6 MB/s | 811 kB 00:00 2023-12-19T05:36:23.260 INFO:teuthology.orchestra.run.smithi155.stdout:(62/154): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2023-12-19T05:36:23.294 INFO:teuthology.orchestra.run.smithi120.stdout:Transaction test succeeded. 2023-12-19T05:36:23.295 INFO:teuthology.orchestra.run.smithi120.stdout:Running transaction 2023-12-19T05:36:23.444 INFO:teuthology.orchestra.run.smithi155.stdout:(63/154): postgresql-server-13.11-1.el9.x86_64. 24 MB/s | 5.7 MB 00:00 2023-12-19T05:36:23.469 INFO:teuthology.orchestra.run.smithi155.stdout:(64/154): python3-attrs-20.3.0-7.el9.noarch.rpm 376 kB/s | 78 kB 00:00 2023-12-19T05:36:23.603 INFO:teuthology.orchestra.run.smithi155.stdout:(65/154): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2023-12-19T05:36:23.628 INFO:teuthology.orchestra.run.smithi155.stdout:(66/154): python3-jinja2-2.11.3-4.el9.noarch.rp 1.2 MB/s | 228 kB 00:00 2023-12-19T05:36:23.653 INFO:teuthology.orchestra.run.smithi155.stdout:(67/154): python3-jsonpatch-1.21-16.el9.noarch. 134 kB/s | 24 kB 00:00 2023-12-19T05:36:23.678 INFO:teuthology.orchestra.run.smithi155.stdout:(68/154): python3-jsonpointer-2.0-4.el9.noarch. 241 kB/s | 18 kB 00:00 2023-12-19T05:36:23.704 INFO:teuthology.orchestra.run.smithi155.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 633 kB/s | 32 kB 00:00 2023-12-19T05:36:23.729 INFO:teuthology.orchestra.run.smithi155.stdout:(70/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-12-19T05:36:23.888 INFO:teuthology.orchestra.run.smithi155.stdout:(71/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2023-12-19T05:36:23.913 INFO:teuthology.orchestra.run.smithi155.stdout:(72/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 217 kB 00:00 2023-12-19T05:36:23.938 INFO:teuthology.orchestra.run.smithi155.stdout:(73/154): python3-oauthlib-3.1.1-5.el9.noarch.r 844 kB/s | 174 kB 00:00 2023-12-19T05:36:23.972 INFO:teuthology.orchestra.run.smithi155.stdout:(74/154): python3-prettytable-0.7.2-27.el9.noar 498 kB/s | 41 kB 00:00 2023-12-19T05:36:23.997 INFO:teuthology.orchestra.run.smithi155.stdout:(75/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.2 MB/s | 132 kB 00:00 2023-12-19T05:36:24.022 INFO:teuthology.orchestra.run.smithi155.stdout:(76/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2023-12-19T05:36:24.047 INFO:teuthology.orchestra.run.smithi155.stdout:(77/154): python3-pytz-2021.1-5.el9.noarch.rpm 633 kB/s | 47 kB 00:00 2023-12-19T05:36:24.073 INFO:teuthology.orchestra.run.smithi155.stdout:(78/154): python3-requests-oauthlib-1.3.0-12.el 855 kB/s | 43 kB 00:00 2023-12-19T05:36:24.681 INFO:teuthology.orchestra.run.smithi155.stdout:(79/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2023-12-19T05:36:24.706 INFO:teuthology.orchestra.run.smithi155.stdout:(80/154): python3-toml-0.10.2-6.el9.noarch.rpm 59 kB/s | 39 kB 00:00 2023-12-19T05:36:24.732 INFO:teuthology.orchestra.run.smithi155.stdout:(81/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 62 kB/s | 41 kB 00:00 2023-12-19T05:36:24.798 INFO:teuthology.orchestra.run.smithi155.stdout:(82/154): uuid-1.6.2-55.el9.x86_64.rpm 853 kB/s | 56 kB 00:00 2023-12-19T05:36:24.832 INFO:teuthology.orchestra.run.smithi155.stdout:(83/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 853 kB/s | 85 kB 00:00 2023-12-19T05:36:24.866 INFO:teuthology.orchestra.run.smithi155.stdout:(84/154): socat-1.7.4.1-5.el9.x86_64.rpm 2.2 MB/s | 300 kB 00:00 2023-12-19T05:36:24.891 INFO:teuthology.orchestra.run.smithi155.stdout:(85/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 678 kB/s | 63 kB 00:00 2023-12-19T05:36:24.916 INFO:teuthology.orchestra.run.smithi155.stdout:(86/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 528 kB/s | 44 kB 00:00 2023-12-19T05:36:24.942 INFO:teuthology.orchestra.run.smithi155.stdout:(87/154): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-12-19T05:36:24.985 INFO:teuthology.orchestra.run.smithi155.stdout:(88/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 8.5 MB/s | 803 kB 00:00 2023-12-19T05:36:25.009 INFO:teuthology.orchestra.run.smithi155.stdout:(89/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.1 MB/s | 195 kB 00:00 2023-12-19T05:36:25.034 INFO:teuthology.orchestra.run.smithi155.stdout:(90/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2023-12-19T05:36:25.085 INFO:teuthology.orchestra.run.smithi155.stdout:(91/154): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2023-12-19T05:36:25.110 INFO:teuthology.orchestra.run.smithi155.stdout:(92/154): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 103 kB 00:00 2023-12-19T05:36:25.135 INFO:teuthology.orchestra.run.smithi155.stdout:(93/154): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2023-12-19T05:36:25.160 INFO:teuthology.orchestra.run.smithi155.stdout:(94/154): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-12-19T05:36:25.186 INFO:teuthology.orchestra.run.smithi155.stdout:(95/154): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-12-19T05:36:25.419 INFO:teuthology.orchestra.run.smithi155.stdout:(96/154): python3-devel-3.9.17-2.el9.x86_64.rpm 950 kB/s | 245 kB 00:00 2023-12-19T05:36:25.537 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 20 MB 00:02 2023-12-19T05:36:25.569 INFO:teuthology.orchestra.run.smithi155.stdout:(97/154): fmt-8.1.1-5.el9.x86_64.rpm 289 kB/s | 111 kB 00:00 2023-12-19T05:36:25.636 INFO:teuthology.orchestra.run.smithi155.stdout:(98/154): openssl-devel-3.0.7-25.el9.x86_64.rpm 8.2 MB/s | 4.1 MB 00:00 2023-12-19T05:36:25.670 INFO:teuthology.orchestra.run.smithi155.stdout:(99/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.2 MB/s | 309 kB 00:00 2023-12-19T05:36:26.620 INFO:teuthology.orchestra.run.smithi155.stdout:(100/154): libarrow-9.0.0-10.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2023-12-19T05:36:26.645 INFO:teuthology.orchestra.run.smithi155.stdout:(101/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 26 kB/s | 26 kB 00:01 2023-12-19T05:36:26.670 INFO:teuthology.orchestra.run.smithi155.stdout:(102/154): liboath-2.6.7-2.el9.x86_64.rpm 49 kB/s | 49 kB 00:01 2023-12-19T05:36:26.704 INFO:teuthology.orchestra.run.smithi155.stdout:(103/154): libunwind-1.6.2-1.el9.x86_64.rpm 809 kB/s | 67 kB 00:00 2023-12-19T05:36:27.013 INFO:teuthology.orchestra.run.smithi155.stdout:(104/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.4 MB/s | 838 kB 00:00 2023-12-19T05:36:27.121 INFO:teuthology.orchestra.run.smithi155.stdout:(105/154): python3-asyncssh-2.13.2-3.el9.noarch 1.2 MB/s | 548 kB 00:00 2023-12-19T05:36:27.147 INFO:teuthology.orchestra.run.smithi155.stdout:(106/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 98 kB/s | 43 kB 00:00 2023-12-19T05:36:27.172 INFO:teuthology.orchestra.run.smithi155.stdout:(107/154): python3-cachetools-4.2.4-1.el9.noarc 203 kB/s | 32 kB 00:00 2023-12-19T05:36:27.222 INFO:teuthology.orchestra.run.smithi155.stdout:(108/154): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2023-12-19T05:36:27.248 INFO:teuthology.orchestra.run.smithi155.stdout:(109/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2023-12-19T05:36:27.473 INFO:teuthology.orchestra.run.smithi155.stdout:(110/154): python3-cherrypy-18.6.1-2.el9.noarch 1.2 MB/s | 358 kB 00:00 2023-12-19T05:36:27.606 INFO:teuthology.orchestra.run.smithi155.stdout:(111/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 790 kB/s | 303 kB 00:00 2023-12-19T05:36:27.632 INFO:teuthology.orchestra.run.smithi155.stdout:(112/154): python3-colorama-0.4.4-12.el9.noarch 92 kB/s | 35 kB 00:00 2023-12-19T05:36:27.690 INFO:teuthology.orchestra.run.smithi155.stdout:(113/154): python3-google-auth-2.23.4-1.el9.noa 909 kB/s | 197 kB 00:00 2023-12-19T05:36:27.716 INFO:teuthology.orchestra.run.smithi155.stdout:(114/154): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2023-12-19T05:36:27.741 INFO:teuthology.orchestra.run.smithi155.stdout:(115/154): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2023-12-19T05:36:27.766 INFO:teuthology.orchestra.run.smithi155.stdout:(116/154): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2023-12-19T05:36:27.800 INFO:teuthology.orchestra.run.smithi155.stdout:(117/154): python3-jaraco-functools-3.5.0-2.el9 333 kB/s | 19 kB 00:00 2023-12-19T05:36:27.825 INFO:teuthology.orchestra.run.smithi155.stdout:(118/154): python3-jaraco-text-3.2.0-6.el9.noar 235 kB/s | 20 kB 00:00 2023-12-19T05:36:27.850 INFO:teuthology.orchestra.run.smithi155.stdout:(119/154): python3-jwt+crypto-2.4.0-1.el9.noarc 108 kB/s | 9.0 kB 00:00 2023-12-19T05:36:27.875 INFO:teuthology.orchestra.run.smithi155.stdout:(120/154): python3-jwt-2.4.0-1.el9.noarch.rpm 543 kB/s | 41 kB 00:00 2023-12-19T05:36:28.301 INFO:teuthology.orchestra.run.smithi155.stdout:(121/154): python3-kubernetes-26.1.0-2.el9.noar 2.1 MB/s | 1.0 MB 00:00 2023-12-19T05:36:28.326 INFO:teuthology.orchestra.run.smithi155.stdout:(122/154): python3-logutils-0.3.5-21.el9.noarch 97 kB/s | 46 kB 00:00 2023-12-19T05:36:28.360 INFO:teuthology.orchestra.run.smithi155.stdout:(123/154): python3-more-itertools-8.12.0-2.el9. 163 kB/s | 79 kB 00:00 2023-12-19T05:36:28.393 INFO:teuthology.orchestra.run.smithi155.stdout:(124/154): python3-natsort-7.1.1-5.el9.noarch.r 629 kB/s | 58 kB 00:00 2023-12-19T05:36:28.585 INFO:teuthology.orchestra.run.smithi155.stdout:(125/154): python3-portend-3.1.0-2.el9.noarch.r 73 kB/s | 16 kB 00:00 2023-12-19T05:36:28.619 INFO:teuthology.orchestra.run.smithi155.stdout:(126/154): python3-pecan-1.4.2-3.el9.noarch.rpm 1.0 MB/s | 272 kB 00:00 2023-12-19T05:36:28.636 INFO:teuthology.orchestra.run.smithi155.stdout:(127/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 371 kB/s | 90 kB 00:00 2023-12-19T05:36:28.661 INFO:teuthology.orchestra.run.smithi155.stdout:(128/154): python3-pyperclip-1.8.2-2.el9.noarch 377 kB/s | 28 kB 00:00 2023-12-19T05:36:28.695 INFO:teuthology.orchestra.run.smithi155.stdout:(129/154): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2023-12-19T05:36:28.795 INFO:teuthology.orchestra.run.smithi155.stdout:(130/154): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2023-12-19T05:36:28.875 INFO:teuthology.orchestra.run.smithi155.stdout:(131/154): python3-rsa-4.9-2.el9.noarch.rpm 276 kB/s | 59 kB 00:00 2023-12-19T05:36:28.929 INFO:teuthology.orchestra.run.smithi155.stdout:(132/154): python3-tempora-5.0.0-2.el9.noarch.r 153 kB/s | 36 kB 00:00 2023-12-19T05:36:28.954 INFO:teuthology.orchestra.run.smithi155.stdout:(133/154): python3-typing-extensions-4.4.0-2.el 321 kB/s | 51 kB 00:00 2023-12-19T05:36:29.088 INFO:teuthology.orchestra.run.smithi155.stdout:(134/154): python3-webob-1.8.7-6.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2023-12-19T05:36:29.113 INFO:teuthology.orchestra.run.smithi155.stdout:(135/154): python3-websocket-client-1.2.3-2.el9 567 kB/s | 90 kB 00:00 2023-12-19T05:36:29.281 INFO:teuthology.orchestra.run.smithi120.stdout: Preparing : 1/1 2023-12-19T05:36:29.330 INFO:teuthology.orchestra.run.smithi155.stdout:(136/154): python3-werkzeug-2.0.3-3.el9.1.noarc 1.1 MB/s | 427 kB 00:00 2023-12-19T05:36:29.407 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-19T05:36:29.434 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-19T05:36:29.472 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-19T05:36:29.509 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-19T05:36:29.514 INFO:teuthology.orchestra.run.smithi155.stdout:(137/154): python3-zc-lockfile-2.0-10.el9.noarc 47 kB/s | 20 kB 00:00 2023-12-19T05:36:29.531 INFO:teuthology.orchestra.run.smithi155.stdout:(138/154): re2-20211101-3.el9.x86_64.rpm 459 kB/s | 192 kB 00:00 2023-12-19T05:36:29.535 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-19T05:36:29.576 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-19T05:36:29.822 INFO:teuthology.orchestra.run.smithi155.stdout:(139/154): librbd1-18.2.0-1377.g24e2e32a.el9.x8 10 MB/s | 3.0 MB 00:00 2023-12-19T05:36:29.856 INFO:teuthology.orchestra.run.smithi155.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-19T05:36:29.885 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-19T05:36:29.898 INFO:teuthology.orchestra.run.smithi155.stdout:(141/154): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-12-19T05:36:29.940 INFO:teuthology.orchestra.run.smithi155.stdout:(142/154): elfutils-debuginfod-client-0.190-1.e 872 kB/s | 36 kB 00:00 2023-12-19T05:36:29.961 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:36:29.999 INFO:teuthology.orchestra.run.smithi155.stdout:(143/154): librados2-18.2.0-1377.g24e2e32a.el9. 6.8 MB/s | 3.3 MB 00:00 2023-12-19T05:36:30.024 INFO:teuthology.orchestra.run.smithi155.stdout:(144/154): elfutils-libelf-0.190-1.el9.x86_64.r 2.3 MB/s | 192 kB 00:00 2023-12-19T05:36:30.049 INFO:teuthology.orchestra.run.smithi155.stdout:(145/154): elfutils-libs-0.190-1.el9.x86_64.rpm 5.0 MB/s | 255 kB 00:00 2023-12-19T05:36:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:36:30.075 INFO:teuthology.orchestra.run.smithi155.stdout:(146/154): libacl-2.3.1-4.el9.x86_64.rpm 441 kB/s | 22 kB 00:00 2023-12-19T05:36:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:36:30.100 INFO:teuthology.orchestra.run.smithi155.stdout:(147/154): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2023-12-19T05:36:30.142 INFO:teuthology.orchestra.run.smithi155.stdout:(148/154): thrift-0.15.0-2.el9.x86_64.rpm 1.9 MB/s | 1.6 MB 00:00 2023-12-19T05:36:30.177 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:36:30.216 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T05:36:30.264 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-19T05:36:30.429 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-19T05:36:30.481 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-19T05:36:30.492 INFO:teuthology.orchestra.run.smithi155.stdout:(149/154): NetworkManager-team-1.45.7-1.el9.x86 123 kB/s | 43 kB 00:00 2023-12-19T05:36:30.509 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:36:30.609 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:36:30.636 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T05:36:30.749 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T05:36:30.759 INFO:teuthology.orchestra.run.smithi155.stdout:(150/154): NetworkManager-tui-1.45.7-1.el9.x86_ 924 kB/s | 246 kB 00:00 2023-12-19T05:36:30.873 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T05:36:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T05:36:30.968 INFO:teuthology.orchestra.run.smithi155.stdout:(151/154): NetworkManager-libnm-1.45.7-1.el9.x8 2.0 MB/s | 1.8 MB 00:00 2023-12-19T05:36:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:36:31.009 INFO:teuthology.orchestra.run.smithi155.stdout:(152/154): NetworkManager-1.45.7-1.el9.x86_64.r 2.4 MB/s | 2.3 MB 00:00 2023-12-19T05:36:31.059 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:36:31.093 INFO:teuthology.orchestra.run.smithi155.stdout:(153/154): openssl-3.0.7-25.el9.x86_64.rpm 3.6 MB/s | 1.2 MB 00:00 2023-12-19T05:36:31.103 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-12-19T05:36:31.260 INFO:teuthology.orchestra.run.smithi155.stdout:(154/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 7.4 MB/s | 2.2 MB 00:00 2023-12-19T05:36:31.265 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2023-12-19T05:36:31.265 INFO:teuthology.orchestra.run.smithi155.stdout:Total 13 MB/s | 200 MB 00:15 2023-12-19T05:36:31.278 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:36:31.376 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-19T05:36:31.405 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-19T05:36:31.436 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2023-12-19T05:36:31.475 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-19T05:36:31.528 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-19T05:36:31.559 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-19T05:36:31.603 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-19T05:36:31.626 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2023-12-19T05:36:31.627 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2023-12-19T05:36:31.643 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-19T05:36:31.724 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-19T05:36:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-19T05:36:31.787 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-19T05:36:31.855 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-19T05:36:31.892 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 29/169 2023-12-19T05:36:31.935 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 30/169 2023-12-19T05:36:32.007 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 31/169 2023-12-19T05:36:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-19T05:36:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-19T05:36:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-19T05:36:32.823 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-19T05:36:32.864 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-19T05:36:32.905 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-19T05:36:32.942 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 38/169 2023-12-19T05:36:32.984 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-19T05:36:33.117 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-19T05:36:33.149 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2023-12-19T05:36:33.149 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2023-12-19T05:36:33.160 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-19T05:36:33.266 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-19T05:36:33.297 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-19T05:36:33.352 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-19T05:36:33.424 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-19T05:36:33.465 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-19T05:36:33.501 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-19T05:36:33.548 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-19T05:36:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-19T05:36:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-19T05:36:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-19T05:36:33.789 INFO:teuthology.orchestra.run.smithi188.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T05:36:33.791 INFO:teuthology.orchestra.run.smithi188.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-19T05:36:33.801 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-19T05:36:33.811 INFO:teuthology.orchestra.run.smithi188.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-19T05:36:33.812 INFO:teuthology.orchestra.run.smithi188.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-19T05:36:33.814 INFO:teuthology.orchestra.run.smithi188.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T05:36:33.815 INFO:teuthology.orchestra.run.smithi188.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-19T05:36:33.817 INFO:teuthology.orchestra.run.smithi188.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T05:36:33.821 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-19T05:36:33.822 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T05:36:33.858 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-19T05:36:33.888 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-19T05:36:33.902 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-19T05:36:33.924 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2023-12-19T05:36:33.924 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-12-19T05:36:33.925 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2023-12-19T05:36:33.925 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-19T05:36:33.925 INFO:teuthology.orchestra.run.smithi188.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-19T05:36:33.925 INFO:teuthology.orchestra.run.smithi188.stdout: ceph x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 6.5 k 2023-12-19T05:36:33.925 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 5.2 M 2023-12-19T05:36:33.925 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 839 k 2023-12-19T05:36:33.925 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 142 k 2023-12-19T05:36:33.926 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 1.4 M 2023-12-19T05:36:33.926 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 132 k 2023-12-19T05:36:33.926 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 1.8 M 2023-12-19T05:36:33.926 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 7.4 M 2023-12-19T05:36:33.926 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 50 k 2023-12-19T05:36:33.926 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 7.7 M 2023-12-19T05:36:33.927 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 40 M 2023-12-19T05:36:33.927 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 262 k 2023-12-19T05:36:33.927 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 221 k 2023-12-19T05:36:33.927 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 219 k 2023-12-19T05:36:33.927 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-shell x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 27 k 2023-12-19T05:36:33.927 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-top noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 18 k 2023-12-19T05:36:33.927 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-19T05:36:33.928 INFO:teuthology.orchestra.run.smithi188.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-19T05:36:33.928 INFO:teuthology.orchestra.run.smithi188.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-19T05:36:33.928 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 31 k 2023-12-19T05:36:33.928 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 658 k 2023-12-19T05:36:33.928 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 127 k 2023-12-19T05:36:33.928 INFO:teuthology.orchestra.run.smithi188.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-19T05:36:33.928 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-19T05:36:33.928 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-19T05:36:33.929 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-19T05:36:33.929 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-19T05:36:33.929 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-19T05:36:33.929 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 162 k 2023-12-19T05:36:33.929 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 319 k 2023-12-19T05:36:33.929 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 297 k 2023-12-19T05:36:33.929 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 99 k 2023-12-19T05:36:33.930 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 87 k 2023-12-19T05:36:33.930 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T05:36:33.930 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 171 k 2023-12-19T05:36:33.930 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-19T05:36:33.930 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrading: 2023-12-19T05:36:33.930 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-19T05:36:33.931 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-19T05:36:33.931 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-19T05:36:33.931 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-19T05:36:33.931 INFO:teuthology.orchestra.run.smithi188.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-19T05:36:33.931 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-19T05:36:33.931 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-19T05:36:33.931 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-19T05:36:33.932 INFO:teuthology.orchestra.run.smithi188.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-19T05:36:33.932 INFO:teuthology.orchestra.run.smithi188.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-19T05:36:33.932 INFO:teuthology.orchestra.run.smithi188.stdout: librados2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.3 M 2023-12-19T05:36:33.932 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 3.0 M 2023-12-19T05:36:33.932 INFO:teuthology.orchestra.run.smithi188.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-19T05:36:33.932 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-19T05:36:33.932 INFO:teuthology.orchestra.run.smithi188.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-19T05:36:33.932 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2023-12-19T05:36:33.933 INFO:teuthology.orchestra.run.smithi188.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-19T05:36:33.933 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-19T05:36:33.933 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T05:36:33.933 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 23 k 2023-12-19T05:36:33.933 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 2.1 M 2023-12-19T05:36:33.933 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 242 k 2023-12-19T05:36:33.933 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.4 M 2023-12-19T05:36:33.933 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 18 M 2023-12-19T05:36:33.934 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1377.g24e2e32a.el9 ceph-noarch 15 k 2023-12-19T05:36:33.934 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 24 k 2023-12-19T05:36:33.934 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-19T05:36:33.934 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-19T05:36:33.934 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-19T05:36:33.934 INFO:teuthology.orchestra.run.smithi188.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-19T05:36:33.935 INFO:teuthology.orchestra.run.smithi188.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-19T05:36:33.935 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-19T05:36:33.935 INFO:teuthology.orchestra.run.smithi188.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-19T05:36:33.935 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-19T05:36:33.935 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-19T05:36:33.935 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 166 k 2023-12-19T05:36:33.936 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-19T05:36:33.936 INFO:teuthology.orchestra.run.smithi188.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-19T05:36:33.936 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-19T05:36:33.936 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-19T05:36:33.936 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-19T05:36:33.936 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 474 k 2023-12-19T05:36:33.936 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-19T05:36:33.937 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2 x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 4.5 M 2023-12-19T05:36:33.937 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-19T05:36:33.937 INFO:teuthology.orchestra.run.smithi188.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-19T05:36:33.937 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-19T05:36:33.937 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-19T05:36:33.937 INFO:teuthology.orchestra.run.smithi188.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-19T05:36:33.937 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-19T05:36:33.938 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-19T05:36:33.938 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-19T05:36:33.938 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-19T05:36:33.938 INFO:teuthology.orchestra.run.smithi188.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-19T05:36:33.938 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-19T05:36:33.938 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-19T05:36:33.939 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-19T05:36:33.939 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 45 k 2023-12-19T05:36:33.939 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common x86_64 2:18.2.0-1377.g24e2e32a.el9 ceph 124 k 2023-12-19T05:36:33.939 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-19T05:36:33.940 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-19T05:36:33.940 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-19T05:36:33.940 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-19T05:36:33.940 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-19T05:36:33.940 INFO:teuthology.orchestra.run.smithi188.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-19T05:36:33.940 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-19T05:36:33.941 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-19T05:36:33.941 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-19T05:36:33.941 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-19T05:36:33.941 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-19T05:36:33.941 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-19T05:36:33.941 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-19T05:36:33.942 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-19T05:36:33.942 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-19T05:36:33.942 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-19T05:36:33.942 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-19T05:36:33.942 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-19T05:36:33.942 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-19T05:36:33.942 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-19T05:36:33.942 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-19T05:36:33.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-19T05:36:33.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-19T05:36:33.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-19T05:36:33.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-19T05:36:33.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-19T05:36:33.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-19T05:36:33.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-19T05:36:33.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-19T05:36:33.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-19T05:36:33.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-19T05:36:33.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-19T05:36:33.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-19T05:36:33.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-19T05:36:33.943 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-19T05:36:33.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-19T05:36:33.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-19T05:36:33.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-19T05:36:33.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-19T05:36:33.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-19T05:36:33.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-19T05:36:33.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-19T05:36:33.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-19T05:36:33.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-19T05:36:33.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-19T05:36:33.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-19T05:36:33.944 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-19T05:36:33.945 INFO:teuthology.orchestra.run.smithi188.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-19T05:36:33.945 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-19T05:36:33.945 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-19T05:36:33.945 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-19T05:36:33.945 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-19T05:36:33.945 INFO:teuthology.orchestra.run.smithi188.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-19T05:36:33.946 INFO:teuthology.orchestra.run.smithi188.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-19T05:36:33.946 INFO:teuthology.orchestra.run.smithi188.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-19T05:36:33.946 INFO:teuthology.orchestra.run.smithi188.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-19T05:36:33.946 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-19T05:36:33.946 INFO:teuthology.orchestra.run.smithi188.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-19T05:36:33.946 INFO:teuthology.orchestra.run.smithi188.stdout:Installing weak dependencies: 2023-12-19T05:36:33.946 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-19T05:36:33.947 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:36:33.947 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-19T05:36:33.947 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2023-12-19T05:36:33.947 INFO:teuthology.orchestra.run.smithi188.stdout:Install 139 Packages 2023-12-19T05:36:33.947 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrade 15 Packages 2023-12-19T05:36:33.947 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:36:33.948 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-19T05:36:33.949 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 200 M 2023-12-19T05:36:33.949 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-19T05:36:34.023 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-19T05:36:34.063 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-19T05:36:34.103 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-19T05:36:34.129 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-19T05:36:34.156 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-19T05:36:34.248 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-19T05:36:34.290 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-19T05:36:34.339 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-19T05:36:34.395 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-19T05:36:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-19T05:36:34.587 INFO:teuthology.orchestra.run.smithi188.stdout:(1/154): ceph-18.2.0-1377.g24e2e32a.el9.x86_64. 20 kB/s | 6.5 kB 00:00 2023-12-19T05:36:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-19T05:36:34.759 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-19T05:36:34.798 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-19T05:36:34.827 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-19T05:36:34.860 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-19T05:36:34.893 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-19T05:36:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-19T05:36:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-19T05:36:35.069 INFO:teuthology.orchestra.run.smithi188.stdout:(2/154): ceph-base-18.2.0-1377.g24e2e32a.el9.x8 6.5 MB/s | 5.2 MB 00:00 2023-12-19T05:36:35.138 INFO:teuthology.orchestra.run.smithi188.stdout:(3/154): ceph-immutable-object-cache-18.2.0-137 2.1 MB/s | 142 kB 00:00 2023-12-19T05:36:35.237 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-19T05:36:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-19T05:36:35.316 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-19T05:36:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-19T05:36:35.380 INFO:teuthology.orchestra.run.smithi188.stdout:(4/154): ceph-mds-18.2.0-1377.g24e2e32a.el9.x86 8.7 MB/s | 2.1 MB 00:00 2023-12-19T05:36:35.426 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-19T05:36:35.446 INFO:teuthology.orchestra.run.smithi188.stdout:(5/154): ceph-fuse-18.2.0-1377.g24e2e32a.el9.x8 978 kB/s | 839 kB 00:00 2023-12-19T05:36:35.456 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-19T05:36:35.489 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-19T05:36:35.531 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-19T05:36:35.564 INFO:teuthology.orchestra.run.smithi188.stdout:(6/154): ceph-mgr-18.2.0-1377.g24e2e32a.el9.x86 7.9 MB/s | 1.4 MB 00:00 2023-12-19T05:36:35.566 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-19T05:36:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-19T05:36:35.693 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-19T05:36:35.793 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-19T05:36:35.860 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-19T05:36:35.880 INFO:teuthology.orchestra.run.smithi188.stdout:(7/154): ceph-common-18.2.0-1377.g24e2e32a.el9. 11 MB/s | 18 MB 00:01 2023-12-19T05:36:36.572 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-19T05:36:36.597 INFO:teuthology.orchestra.run.smithi188.stdout:(8/154): ceph-radosgw-18.2.0-1377.g24e2e32a.el9 11 MB/s | 7.7 MB 00:00 2023-12-19T05:36:36.625 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-19T05:36:36.658 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-19T05:36:36.664 INFO:teuthology.orchestra.run.smithi188.stdout:(9/154): ceph-selinux-18.2.0-1377.g24e2e32a.el9 368 kB/s | 24 kB 00:00 2023-12-19T05:36:36.706 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-19T05:36:36.786 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-19T05:36:36.826 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-19T05:36:36.906 INFO:teuthology.orchestra.run.smithi188.stdout:(10/154): ceph-osd-18.2.0-1377.g24e2e32a.el9.x8 13 MB/s | 18 MB 00:01 2023-12-19T05:36:36.964 INFO:teuthology.orchestra.run.smithi188.stdout:(11/154): cephfs-mirror-18.2.0-1377.g24e2e32a.e 3.8 MB/s | 219 kB 00:00 2023-12-19T05:36:37.002 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-19T05:36:37.023 INFO:teuthology.orchestra.run.smithi188.stdout:(12/154): cephfs-shell-18.2.0-1377.g24e2e32a.el 468 kB/s | 27 kB 00:00 2023-12-19T05:36:37.041 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-19T05:36:37.117 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-19T05:36:37.199 INFO:teuthology.orchestra.run.smithi188.stdout:(13/154): ceph-mon-18.2.0-1377.g24e2e32a.el9.x8 2.5 MB/s | 4.4 MB 00:01 2023-12-19T05:36:37.224 INFO:teuthology.orchestra.run.smithi188.stdout:(14/154): libcephfs-devel-18.2.0-1377.g24e2e32a 155 kB/s | 31 kB 00:00 2023-12-19T05:36:37.274 INFO:teuthology.orchestra.run.smithi188.stdout:(15/154): libcephsqlite-18.2.0-1377.g24e2e32a.e 3.3 MB/s | 166 kB 00:00 2023-12-19T05:36:37.324 INFO:teuthology.orchestra.run.smithi188.stdout:(16/154): librados-devel-18.2.0-1377.g24e2e32a. 2.5 MB/s | 127 kB 00:00 2023-12-19T05:36:37.366 INFO:teuthology.orchestra.run.smithi188.stdout:(17/154): libcephfs2-18.2.0-1377.g24e2e32a.el9. 3.9 MB/s | 658 kB 00:00 2023-12-19T05:36:37.417 INFO:teuthology.orchestra.run.smithi188.stdout:(18/154): libradosstriper1-18.2.0-1377.g24e2e32 5.1 MB/s | 474 kB 00:00 2023-12-19T05:36:37.492 INFO:teuthology.orchestra.run.smithi188.stdout:(19/154): python3-ceph-argparse-18.2.0-1377.g24 608 kB/s | 45 kB 00:00 2023-12-19T05:36:37.576 INFO:teuthology.orchestra.run.smithi188.stdout:(20/154): python3-ceph-common-18.2.0-1377.g24e2 1.5 MB/s | 124 kB 00:00 2023-12-19T05:36:37.659 INFO:teuthology.orchestra.run.smithi188.stdout:(21/154): python3-cephfs-18.2.0-1377.g24e2e32a. 1.9 MB/s | 162 kB 00:00 2023-12-19T05:36:37.739 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-19T05:36:37.751 INFO:teuthology.orchestra.run.smithi188.stdout:(22/154): python3-rados-18.2.0-1377.g24e2e32a.e 3.5 MB/s | 319 kB 00:00 2023-12-19T05:36:37.854 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-19T05:36:37.860 INFO:teuthology.orchestra.run.smithi188.stdout:(23/154): python3-rbd-18.2.0-1377.g24e2e32a.el9 2.7 MB/s | 297 kB 00:00 2023-12-19T05:36:37.927 INFO:teuthology.orchestra.run.smithi188.stdout:(24/154): python3-rgw-18.2.0-1377.g24e2e32a.el9 1.5 MB/s | 99 kB 00:00 2023-12-19T05:36:37.994 INFO:teuthology.orchestra.run.smithi188.stdout:(25/154): rbd-fuse-18.2.0-1377.g24e2e32a.el9.x8 1.3 MB/s | 87 kB 00:00 2023-12-19T05:36:38.203 INFO:teuthology.orchestra.run.smithi188.stdout:(26/154): librgw2-18.2.0-1377.g24e2e32a.el9.x86 5.3 MB/s | 4.5 MB 00:00 2023-12-19T05:36:38.319 INFO:teuthology.orchestra.run.smithi188.stdout:(27/154): rbd-mirror-18.2.0-1377.g24e2e32a.el9. 9.2 MB/s | 3.0 MB 00:00 2023-12-19T05:36:38.353 INFO:teuthology.orchestra.run.smithi188.stdout:(28/154): rbd-nbd-18.2.0-1377.g24e2e32a.el9.x86 1.1 MB/s | 171 kB 00:00 2023-12-19T05:36:38.378 INFO:teuthology.orchestra.run.smithi188.stdout:(29/154): ceph-grafana-dashboards-18.2.0-1377.g 402 kB/s | 23 kB 00:00 2023-12-19T05:36:38.437 INFO:teuthology.orchestra.run.smithi188.stdout:(30/154): ceph-mgr-cephadm-18.2.0-1377.g24e2e32 1.6 MB/s | 132 kB 00:00 2023-12-19T05:36:38.579 INFO:teuthology.orchestra.run.smithi188.stdout:(31/154): ceph-mgr-dashboard-18.2.0-1377.g24e2e 8.8 MB/s | 1.8 MB 00:00 2023-12-19T05:36:38.654 INFO:teuthology.orchestra.run.smithi188.stdout:(32/154): ceph-mgr-modules-core-18.2.0-1377.g24 3.2 MB/s | 242 kB 00:00 2023-12-19T05:36:38.721 INFO:teuthology.orchestra.run.smithi188.stdout:(33/154): ceph-mgr-rook-18.2.0-1377.g24e2e32a.e 761 kB/s | 50 kB 00:00 2023-12-19T05:36:38.788 INFO:teuthology.orchestra.run.smithi188.stdout:(34/154): ceph-prometheus-alerts-18.2.0-1377.g2 223 kB/s | 15 kB 00:00 2023-12-19T05:36:39.060 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-19T05:36:39.129 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2023-12-19T05:36:39.152 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-19T05:36:39.183 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-19T05:36:39.214 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-19T05:36:39.243 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-19T05:36:39.270 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-19T05:36:39.276 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-19T05:36:39.288 INFO:teuthology.orchestra.run.smithi188.stdout:(35/154): ceph-test-18.2.0-1377.g24e2e32a.el9.x 15 MB/s | 40 MB 00:02 2023-12-19T05:36:39.297 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-19T05:36:39.322 INFO:teuthology.orchestra.run.smithi188.stdout:(36/154): ceph-volume-18.2.0-1377.g24e2e32a.el9 492 kB/s | 262 kB 00:00 2023-12-19T05:36:39.344 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-19T05:36:39.355 INFO:teuthology.orchestra.run.smithi188.stdout:(37/154): cephadm-18.2.0-1377.g24e2e32a.el9.noa 3.3 MB/s | 221 kB 00:00 2023-12-19T05:36:39.381 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-19T05:36:39.381 INFO:teuthology.orchestra.run.smithi188.stdout:(38/154): cephfs-top-18.2.0-1377.g24e2e32a.el9. 314 kB/s | 18 kB 00:00 2023-12-19T05:36:39.407 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-19T05:36:39.448 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-19T05:36:39.574 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-19T05:36:39.606 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T05:36:39.696 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T05:36:39.723 INFO:teuthology.orchestra.run.smithi188.stdout:(39/154): ceph-mgr-diskprediction-local-18.2.0- 5.7 MB/s | 7.4 MB 00:01 2023-12-19T05:36:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/169 2023-12-19T05:36:39.772 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-19T05:36:39.773 INFO:teuthology.orchestra.run.smithi188.stdout:(40/154): automake-1.16.2-8.el9.noarch.rpm 1.6 MB/s | 662 kB 00:00 2023-12-19T05:36:39.815 INFO:teuthology.orchestra.run.smithi188.stdout:(41/154): bison-3.7.4-5.el9.x86_64.rpm 2.1 MB/s | 920 kB 00:00 2023-12-19T05:36:39.840 INFO:teuthology.orchestra.run.smithi188.stdout:(42/154): boost-program-options-1.75.0-8.el9.x8 971 kB/s | 106 kB 00:00 2023-12-19T05:36:39.844 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-19T05:36:39.865 INFO:teuthology.orchestra.run.smithi188.stdout:(43/154): elfutils-libelf-devel-0.190-1.el9.x86 240 kB/s | 21 kB 00:00 2023-12-19T05:36:39.874 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:36:39.891 INFO:teuthology.orchestra.run.smithi188.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 649 kB/s | 32 kB 00:00 2023-12-19T05:36:39.968 INFO:teuthology.orchestra.run.smithi188.stdout:(45/154): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 307 kB 00:00 2023-12-19T05:36:39.989 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:36:40.017 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:36:40.100 INFO:teuthology.orchestra.run.smithi188.stdout:(46/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2023-12-19T05:36:40.107 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:36:40.125 INFO:teuthology.orchestra.run.smithi188.stdout:(47/154): flexiblas-openblas-openmp-3.0.4-8.el9 76 kB/s | 17 kB 00:00 2023-12-19T05:36:40.138 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T05:36:40.150 INFO:teuthology.orchestra.run.smithi188.stdout:(48/154): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 186 kB 00:00 2023-12-19T05:36:40.167 INFO:teuthology.orchestra.run.smithi188.stdout:(49/154): libaio-devel-0.3.111-13.el9.x86_64.rp 248 kB/s | 10 kB 00:00 2023-12-19T05:36:40.173 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-19T05:36:40.178 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-19T05:36:40.183 INFO:teuthology.orchestra.run.smithi188.stdout:(50/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2023-12-19T05:36:40.200 INFO:teuthology.orchestra.run.smithi188.stdout:(51/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 895 kB/s | 44 kB 00:00 2023-12-19T05:36:40.268 INFO:teuthology.orchestra.run.smithi188.stdout:(52/154): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 661 kB 00:00 2023-12-19T05:36:40.326 INFO:teuthology.orchestra.run.smithi188.stdout:(53/154): libtool-2.4.6-45.el9.x86_64.rpm 4.0 MB/s | 578 kB 00:00 2023-12-19T05:36:40.351 INFO:teuthology.orchestra.run.smithi188.stdout:(54/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 163 kB/s | 24 kB 00:00 2023-12-19T05:36:40.356 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-19T05:36:40.368 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T05:36:40.377 INFO:teuthology.orchestra.run.smithi188.stdout:(55/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 439 kB/s | 46 kB 00:00 2023-12-19T05:36:40.410 INFO:teuthology.orchestra.run.smithi188.stdout:(56/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-12-19T05:36:40.411 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-19T05:36:40.439 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:36:40.444 INFO:teuthology.orchestra.run.smithi188.stdout:(57/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.3 MB/s | 217 kB 00:00 2023-12-19T05:36:40.469 INFO:teuthology.orchestra.run.smithi188.stdout:(58/154): openblas-0.3.21-2.el9.x86_64.rpm 375 kB/s | 34 kB 00:00 2023-12-19T05:36:40.532 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:36:40.539 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T05:36:40.557 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T05:36:40.561 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/169 2023-12-19T05:36:40.689 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T05:36:40.711 INFO:teuthology.orchestra.run.smithi188.stdout:(59/154): openblas-openmp-0.3.21-2.el9.x86_64.r 16 MB/s | 4.7 MB 00:00 2023-12-19T05:36:40.761 INFO:teuthology.orchestra.run.smithi188.stdout:(60/154): postgresql-contrib-13.11-1.el9.x86_64 2.9 MB/s | 811 kB 00:00 2023-12-19T05:36:40.796 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T05:36:40.820 INFO:teuthology.orchestra.run.smithi188.stdout:(61/154): postgresql-13.11-1.el9.x86_64.rpm 4.5 MB/s | 1.5 MB 00:00 2023-12-19T05:36:40.845 INFO:teuthology.orchestra.run.smithi188.stdout:(62/154): postgresql-private-libs-13.11-1.el9.x 1.0 MB/s | 134 kB 00:00 2023-12-19T05:36:40.871 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T05:36:40.944 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:36:40.990 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:36:41.070 INFO:teuthology.orchestra.run.smithi188.stdout:(63/154): postgresql-server-13.11-1.el9.x86_64. 19 MB/s | 5.7 MB 00:00 2023-12-19T05:36:41.121 INFO:teuthology.orchestra.run.smithi188.stdout:(64/154): python3-attrs-20.3.0-7.el9.noarch.rpm 300 kB/s | 78 kB 00:00 2023-12-19T05:36:41.214 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:36:41.308 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-19T05:36:41.313 INFO:teuthology.orchestra.run.smithi188.stdout:(65/154): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 5.8 MB 00:00 2023-12-19T05:36:41.345 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-19T05:36:41.371 INFO:teuthology.orchestra.run.smithi188.stdout:(66/154): python3-jinja2-2.11.3-4.el9.noarch.rp 774 kB/s | 228 kB 00:00 2023-12-19T05:36:41.396 INFO:teuthology.orchestra.run.smithi188.stdout:(67/154): python3-jsonpatch-1.21-16.el9.noarch. 94 kB/s | 24 kB 00:00 2023-12-19T05:36:41.413 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-19T05:36:41.422 INFO:teuthology.orchestra.run.smithi188.stdout:(68/154): python3-jsonpointer-2.0-4.el9.noarch. 171 kB/s | 18 kB 00:00 2023-12-19T05:36:41.447 INFO:teuthology.orchestra.run.smithi188.stdout:(69/154): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2023-12-19T05:36:41.467 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-19T05:36:41.472 INFO:teuthology.orchestra.run.smithi188.stdout:(70/154): python3-markupsafe-1.1.1-12.el9.x86_6 427 kB/s | 32 kB 00:00 2023-12-19T05:36:41.498 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-19T05:36:41.533 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-19T05:36:41.573 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-19T05:36:41.642 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-19T05:36:41.677 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-19T05:36:41.705 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-19T05:36:41.722 INFO:teuthology.orchestra.run.smithi188.stdout:(71/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 4.8 MB 00:00 2023-12-19T05:36:41.756 INFO:teuthology.orchestra.run.smithi188.stdout:(72/154): python3-oauthlib-3.1.1-5.el9.noarch.r 655 kB/s | 174 kB 00:00 2023-12-19T05:36:41.774 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-19T05:36:41.793 INFO:teuthology.orchestra.run.smithi188.stdout:(73/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 724 kB/s | 217 kB 00:00 2023-12-19T05:36:41.810 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 29/169 2023-12-19T05:36:41.815 INFO:teuthology.orchestra.run.smithi188.stdout:(74/154): python3-prettytable-0.7.2-27.el9.noar 739 kB/s | 41 kB 00:00 2023-12-19T05:36:41.840 INFO:teuthology.orchestra.run.smithi188.stdout:(75/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 132 kB 00:00 2023-12-19T05:36:41.853 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 30/169 2023-12-19T05:36:41.865 INFO:teuthology.orchestra.run.smithi188.stdout:(76/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.8 MB/s | 211 kB 00:00 2023-12-19T05:36:41.899 INFO:teuthology.orchestra.run.smithi188.stdout:(77/154): python3-pytz-2021.1-5.el9.noarch.rpm 844 kB/s | 47 kB 00:00 2023-12-19T05:36:41.924 INFO:teuthology.orchestra.run.smithi188.stdout:(78/154): python3-requests-oauthlib-1.3.0-12.el 528 kB/s | 43 kB 00:00 2023-12-19T05:36:41.926 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 31/169 2023-12-19T05:36:42.059 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-19T05:36:42.122 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-19T05:36:42.258 INFO:teuthology.orchestra.run.smithi188.stdout:(79/154): python3-toml-0.10.2-6.el9.noarch.rpm 121 kB/s | 39 kB 00:00 2023-12-19T05:36:42.283 INFO:teuthology.orchestra.run.smithi188.stdout:(80/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 119 kB/s | 41 kB 00:00 2023-12-19T05:36:42.601 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:36:42.617 INFO:teuthology.orchestra.run.smithi188.stdout:(81/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2023-12-19T05:36:42.642 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:36:42.642 INFO:teuthology.orchestra.run.smithi188.stdout:(82/154): uuid-1.6.2-55.el9.x86_64.rpm 165 kB/s | 56 kB 00:00 2023-12-19T05:36:42.648 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-19T05:36:42.676 INFO:teuthology.orchestra.run.smithi188.stdout:(83/154): socat-1.7.4.1-5.el9.x86_64.rpm 799 kB/s | 300 kB 00:00 2023-12-19T05:36:42.701 INFO:teuthology.orchestra.run.smithi188.stdout:(84/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.0 MB/s | 85 kB 00:00 2023-12-19T05:36:42.726 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-19T05:36:42.747 INFO:teuthology.orchestra.run.smithi188.stdout:(85/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 618 kB/s | 63 kB 00:00 2023-12-19T05:36:42.757 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-19T05:36:42.785 INFO:teuthology.orchestra.run.smithi188.stdout:(86/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 537 kB/s | 44 kB 00:00 2023-12-19T05:36:42.806 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-19T05:36:42.810 INFO:teuthology.orchestra.run.smithi188.stdout:(87/154): fuse-2.9.9-15.el9.x86_64.rpm 735 kB/s | 79 kB 00:00 2023-12-19T05:36:42.844 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 38/169 2023-12-19T05:36:42.851 INFO:teuthology.orchestra.run.smithi188.stdout:(88/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 7.6 MB/s | 803 kB 00:00 2023-12-19T05:36:42.886 INFO:teuthology.orchestra.run.smithi188.stdout:(89/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.8 MB/s | 195 kB 00:00 2023-12-19T05:36:42.886 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-19T05:36:42.911 INFO:teuthology.orchestra.run.smithi188.stdout:(90/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 241 kB 00:00 2023-12-19T05:36:42.961 INFO:teuthology.orchestra.run.smithi188.stdout:(91/154): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2023-12-19T05:36:42.986 INFO:teuthology.orchestra.run.smithi188.stdout:(92/154): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2023-12-19T05:36:43.011 INFO:teuthology.orchestra.run.smithi188.stdout:(93/154): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 124 kB 00:00 2023-12-19T05:36:43.033 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-19T05:36:43.037 INFO:teuthology.orchestra.run.smithi188.stdout:(94/154): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-12-19T05:36:43.079 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-19T05:36:43.092 INFO:teuthology.orchestra.run.smithi188.stdout:(95/154): python3-urllib3-1.26.5-4.el9.noarch.r 2.3 MB/s | 187 kB 00:00 2023-12-19T05:36:43.176 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:36:43.186 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-19T05:36:43.225 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-19T05:36:43.229 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T05:36:43.278 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-19T05:36:43.310 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T05:36:43.311 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T05:36:43.311 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T05:36:43.311 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:36:43.321 INFO:teuthology.orchestra.run.smithi188.stdout:(96/154): python3-devel-3.9.17-2.el9.x86_64.rpm 875 kB/s | 245 kB 00:00 2023-12-19T05:36:43.338 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T05:36:43.351 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-19T05:36:43.383 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-19T05:36:43.429 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-19T05:36:43.454 INFO:teuthology.orchestra.run.smithi188.stdout:(97/154): fmt-8.1.1-5.el9.x86_64.rpm 307 kB/s | 111 kB 00:00 2023-12-19T05:36:43.474 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-19T05:36:43.527 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-19T05:36:43.570 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-19T05:36:43.612 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-19T05:36:43.756 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-19T05:36:43.854 INFO:teuthology.orchestra.run.smithi188.stdout:(98/154): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2023-12-19T05:36:43.905 INFO:teuthology.orchestra.run.smithi188.stdout:(99/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 530 kB/s | 309 kB 00:00 2023-12-19T05:36:43.930 INFO:teuthology.orchestra.run.smithi188.stdout:(100/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 350 kB/s | 26 kB 00:00 2023-12-19T05:36:43.955 INFO:teuthology.orchestra.run.smithi188.stdout:(101/154): liboath-2.6.7-2.el9.x86_64.rpm 978 kB/s | 49 kB 00:00 2023-12-19T05:36:43.961 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-19T05:36:43.991 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-19T05:36:43.998 INFO:teuthology.orchestra.run.smithi188.stdout:(102/154): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2023-12-19T05:36:44.033 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-19T05:36:44.089 INFO:teuthology.orchestra.run.smithi188.stdout:(103/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.2 MB/s | 838 kB 00:00 2023-12-19T05:36:44.127 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-19T05:36:44.157 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-19T05:36:44.181 INFO:teuthology.orchestra.run.smithi188.stdout:(104/154): python3-asyncssh-2.13.2-3.el9.noarch 2.9 MB/s | 548 kB 00:00 2023-12-19T05:36:44.197 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-19T05:36:44.206 INFO:teuthology.orchestra.run.smithi188.stdout:(105/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 374 kB/s | 43 kB 00:00 2023-12-19T05:36:44.223 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-19T05:36:44.232 INFO:teuthology.orchestra.run.smithi188.stdout:(106/154): python3-cachetools-4.2.4-1.el9.noarc 652 kB/s | 32 kB 00:00 2023-12-19T05:36:44.250 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-19T05:36:44.257 INFO:teuthology.orchestra.run.smithi188.stdout:(107/154): python3-certifi-2021.10.8-2.el9.noar 303 kB/s | 15 kB 00:00 2023-12-19T05:36:44.342 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-19T05:36:44.365 INFO:teuthology.orchestra.run.smithi188.stdout:(108/154): openssl-devel-3.0.7-25.el9.x86_64.rp 3.0 MB/s | 4.1 MB 00:01 2023-12-19T05:36:44.384 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-19T05:36:44.391 INFO:teuthology.orchestra.run.smithi188.stdout:(109/154): python3-cheroot-8.6.0-4.el9.noarch.r 1.1 MB/s | 172 kB 00:00 2023-12-19T05:36:44.425 INFO:teuthology.orchestra.run.smithi188.stdout:(110/154): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2023-12-19T05:36:44.432 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-19T05:36:44.488 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-19T05:36:44.533 INFO:teuthology.orchestra.run.smithi188.stdout:(111/154): python3-colorama-0.4.4-12.el9.noarch 250 kB/s | 35 kB 00:00 2023-12-19T05:36:44.575 INFO:teuthology.orchestra.run.smithi188.stdout:(112/154): python3-google-auth-2.23.4-1.el9.noa 2.4 MB/s | 197 kB 00:00 2023-12-19T05:36:44.600 INFO:teuthology.orchestra.run.smithi188.stdout:(113/154): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2023-12-19T05:36:44.668 INFO:teuthology.orchestra.run.smithi188.stdout:(114/154): python3-jaraco-classes-3.2.1-5.el9.n 194 kB/s | 18 kB 00:00 2023-12-19T05:36:44.672 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-19T05:36:44.693 INFO:teuthology.orchestra.run.smithi188.stdout:(115/154): python3-jaraco-collections-3.0.0-8.e 253 kB/s | 23 kB 00:00 2023-12-19T05:36:44.722 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-19T05:36:44.743 INFO:teuthology.orchestra.run.smithi188.stdout:(116/154): python3-jaraco-functools-3.5.0-2.el9 261 kB/s | 19 kB 00:00 2023-12-19T05:36:44.785 INFO:teuthology.orchestra.run.smithi188.stdout:(117/154): python3-jaraco-text-3.2.0-6.el9.noar 215 kB/s | 20 kB 00:00 2023-12-19T05:36:44.819 INFO:teuthology.orchestra.run.smithi188.stdout:(118/154): python3-jwt+crypto-2.4.0-1.el9.noarc 121 kB/s | 9.0 kB 00:00 2023-12-19T05:36:44.850 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-19T05:36:44.885 INFO:teuthology.orchestra.run.smithi188.stdout:(119/154): python3-jwt-2.4.0-1.el9.noarch.rpm 410 kB/s | 41 kB 00:00 2023-12-19T05:36:44.891 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-19T05:36:44.919 INFO:teuthology.orchestra.run.smithi188.stdout:(120/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 549 kB/s | 303 kB 00:00 2023-12-19T05:36:44.921 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-19T05:36:44.953 INFO:teuthology.orchestra.run.smithi188.stdout:(121/154): python3-logutils-0.3.5-21.el9.noarch 701 kB/s | 46 kB 00:00 2023-12-19T05:36:44.963 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-19T05:36:44.978 INFO:teuthology.orchestra.run.smithi188.stdout:(122/154): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2023-12-19T05:36:44.994 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-19T05:36:45.011 INFO:teuthology.orchestra.run.smithi188.stdout:(123/154): python3-natsort-7.1.1-5.el9.noarch.r 1.0 MB/s | 58 kB 00:00 2023-12-19T05:36:45.026 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-19T05:36:45.046 INFO:teuthology.orchestra.run.smithi188.stdout:(124/154): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2023-12-19T05:36:45.053 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-19T05:36:45.073 INFO:teuthology.orchestra.run.smithi188.stdout:(125/154): python3-portend-3.1.0-2.el9.noarch.r 284 kB/s | 16 kB 00:00 2023-12-19T05:36:45.087 INFO:teuthology.orchestra.run.smithi188.stdout:(126/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2023-12-19T05:36:45.088 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-19T05:36:45.113 INFO:teuthology.orchestra.run.smithi188.stdout:(127/154): python3-pyperclip-1.8.2-2.el9.noarch 688 kB/s | 28 kB 00:00 2023-12-19T05:36:45.127 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-19T05:36:45.138 INFO:teuthology.orchestra.run.smithi188.stdout:(128/154): python3-repoze-lru-0.7-16.el9.noarch 624 kB/s | 31 kB 00:00 2023-12-19T05:36:45.159 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-19T05:36:45.171 INFO:teuthology.orchestra.run.smithi188.stdout:(129/154): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2023-12-19T05:36:45.189 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-19T05:36:45.230 INFO:teuthology.orchestra.run.smithi188.stdout:(130/154): python3-rsa-4.9-2.el9.noarch.rpm 650 kB/s | 59 kB 00:00 2023-12-19T05:36:45.272 INFO:teuthology.orchestra.run.smithi188.stdout:(131/154): python3-tempora-5.0.0-2.el9.noarch.r 358 kB/s | 36 kB 00:00 2023-12-19T05:36:45.273 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-19T05:36:45.298 INFO:teuthology.orchestra.run.smithi188.stdout:(132/154): python3-typing-extensions-4.4.0-2.el 767 kB/s | 51 kB 00:00 2023-12-19T05:36:45.308 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-19T05:36:45.342 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-19T05:36:45.348 INFO:teuthology.orchestra.run.smithi188.stdout:(133/154): python3-kubernetes-26.1.0-2.el9.noar 1.9 MB/s | 1.0 MB 00:00 2023-12-19T05:36:45.373 INFO:teuthology.orchestra.run.smithi188.stdout:(134/154): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2023-12-19T05:36:45.382 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-19T05:36:45.407 INFO:teuthology.orchestra.run.smithi188.stdout:(135/154): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2023-12-19T05:36:45.417 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-19T05:36:45.432 INFO:teuthology.orchestra.run.smithi188.stdout:(136/154): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2023-12-19T05:36:45.466 INFO:teuthology.orchestra.run.smithi188.stdout:(137/154): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2023-12-19T05:36:45.506 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-19T05:36:45.537 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-19T05:36:45.591 INFO:teuthology.orchestra.run.smithi188.stdout:(138/154): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2023-12-19T05:36:45.633 INFO:teuthology.orchestra.run.smithi188.stdout:(139/154): python3-werkzeug-2.0.3-3.el9.1.noarc 1.5 MB/s | 427 kB 00:00 2023-12-19T05:36:45.638 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-19T05:36:45.667 INFO:teuthology.orchestra.run.smithi188.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-19T05:36:45.687 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-19T05:36:45.709 INFO:teuthology.orchestra.run.smithi188.stdout:(141/154): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-12-19T05:36:45.751 INFO:teuthology.orchestra.run.smithi188.stdout:(142/154): elfutils-debuginfod-client-0.190-1.e 895 kB/s | 36 kB 00:00 2023-12-19T05:36:45.792 INFO:teuthology.orchestra.run.smithi188.stdout:(143/154): elfutils-libelf-0.190-1.el9.x86_64.r 4.6 MB/s | 192 kB 00:00 2023-12-19T05:36:45.851 INFO:teuthology.orchestra.run.smithi188.stdout:(144/154): elfutils-libs-0.190-1.el9.x86_64.rpm 4.4 MB/s | 255 kB 00:00 2023-12-19T05:36:45.914 INFO:teuthology.orchestra.run.smithi188.stdout:(145/154): libacl-2.3.1-4.el9.x86_64.rpm 360 kB/s | 22 kB 00:00 2023-12-19T05:36:45.993 INFO:teuthology.orchestra.run.smithi188.stdout:(146/154): librbd1-18.2.0-1377.g24e2e32a.el9.x8 7.5 MB/s | 3.0 MB 00:00 2023-12-19T05:36:46.027 INFO:teuthology.orchestra.run.smithi188.stdout:(147/154): xfsdump-3.1.12-4.el9.x86_64.rpm 2.8 MB/s | 321 kB 00:00 2023-12-19T05:36:46.119 INFO:teuthology.orchestra.run.smithi188.stdout:(148/154): librados2-18.2.0-1377.g24e2e32a.el9. 5.0 MB/s | 3.3 MB 00:00 2023-12-19T05:36:46.417 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-19T05:36:46.468 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-19T05:36:46.477 INFO:teuthology.orchestra.run.smithi188.stdout:(149/154): NetworkManager-team-1.45.7-1.el9.x86 121 kB/s | 43 kB 00:00 2023-12-19T05:36:46.502 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-19T05:36:46.550 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-19T05:36:46.638 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-19T05:36:46.670 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-19T05:36:46.794 INFO:teuthology.orchestra.run.smithi188.stdout:(150/154): NetworkManager-tui-1.45.7-1.el9.x86_ 781 kB/s | 246 kB 00:00 2023-12-19T05:36:46.850 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-19T05:36:46.876 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-19T05:36:46.955 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-19T05:36:46.970 INFO:teuthology.orchestra.run.smithi188.stdout:(151/154): NetworkManager-libnm-1.45.7-1.el9.x8 1.9 MB/s | 1.8 MB 00:00 2023-12-19T05:36:47.046 INFO:teuthology.orchestra.run.smithi188.stdout:(152/154): NetworkManager-1.45.7-1.el9.x86_64.r 2.2 MB/s | 2.3 MB 00:01 2023-12-19T05:36:47.212 INFO:teuthology.orchestra.run.smithi188.stdout:(153/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 8.9 MB/s | 2.2 MB 00:00 2023-12-19T05:36:47.254 INFO:teuthology.orchestra.run.smithi188.stdout:(154/154): openssl-3.0.7-25.el9.x86_64.rpm 2.6 MB/s | 1.2 MB 00:00 2023-12-19T05:36:47.268 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-19T05:36:47.268 INFO:teuthology.orchestra.run.smithi188.stdout:Total 15 MB/s | 200 MB 00:13 2023-12-19T05:36:47.591 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-19T05:36:47.694 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-19T05:36:47.707 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-19T05:36:47.976 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-19T05:36:47.976 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-19T05:36:48.937 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-19T05:36:49.019 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-19T05:36:49.050 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-19T05:36:49.081 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-19T05:36:49.110 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-19T05:36:49.143 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-19T05:36:49.442 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-19T05:36:49.481 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T05:36:49.563 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T05:36:49.594 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/169 2023-12-19T05:36:49.630 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-19T05:36:50.029 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-19T05:36:50.059 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T05:36:50.139 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T05:36:50.161 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/169 2023-12-19T05:36:50.350 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-19T05:36:50.351 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-19T05:36:52.182 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:36:52.216 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:36:52.747 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:36:52.778 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T05:36:52.866 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T05:36:52.866 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T05:36:52.867 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T05:36:52.867 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:36:52.896 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T05:36:54.693 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T05:36:54.693 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /sys 2023-12-19T05:36:54.693 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /proc 2023-12-19T05:36:54.693 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /mnt 2023-12-19T05:36:54.693 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /var/tmp 2023-12-19T05:36:54.693 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /home 2023-12-19T05:36:54.693 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /root 2023-12-19T05:36:54.693 INFO:teuthology.orchestra.run.smithi120.stdout:skipping the directory /tmp 2023-12-19T05:36:54.694 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:36:54.865 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T05:36:54.881 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T05:36:54.881 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:36:54.881 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T05:36:54.881 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:36:56.427 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T05:36:56.452 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T05:36:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:36:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T05:36:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T05:36:56.453 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T05:36:56.453 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:36:56.652 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T05:36:56.675 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T05:36:56.675 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:36:56.675 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T05:36:56.675 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T05:36:56.675 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T05:36:56.675 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:36:56.937 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-19T05:36:57.120 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T05:36:57.142 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T05:36:57.143 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:36:57.143 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T05:36:57.143 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T05:36:57.143 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T05:36:57.143 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:36:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-19T05:36:57.195 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-19T05:36:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-19T05:36:57.287 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-19T05:36:57.349 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-19T05:36:57.386 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-19T05:36:57.484 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-19T05:36:57.634 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T05:36:57.662 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T05:36:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 120/169 2023-12-19T05:36:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 121/169 2023-12-19T05:36:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T05:36:57.902 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-19T05:36:57.950 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:36:57.996 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T05:36:58.020 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T05:36:58.169 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:36:58.210 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:36:58.335 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:36:58.408 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T05:36:58.481 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-19T05:36:58.784 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-19T05:36:58.849 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-19T05:36:58.874 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:36:58.979 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T05:36:59.004 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T05:36:59.029 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:36:59.085 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T05:36:59.104 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T05:36:59.259 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 125/169 2023-12-19T05:36:59.298 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T05:36:59.321 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T05:36:59.321 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:36:59.321 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T05:36:59.321 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T05:36:59.321 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T05:36:59.321 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:36:59.365 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T05:36:59.376 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T05:36:59.421 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 128/169 2023-12-19T05:36:59.434 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 15/169 2023-12-19T05:36:59.629 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T05:36:59.701 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-19T05:36:59.879 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:36:59.940 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:37:00.122 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-19T05:37:00.150 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T05:37:00.172 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T05:37:00.172 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:00.172 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T05:37:00.172 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T05:37:00.173 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T05:37:00.173 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:00.210 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T05:37:00.232 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T05:37:00.232 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:00.232 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T05:37:00.232 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:00.268 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-19T05:37:00.285 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T05:37:00.308 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T05:37:00.308 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:00.308 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-19T05:37:00.308 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T05:37:00.308 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T05:37:00.308 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:00.434 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-19T05:37:00.505 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-19T05:37:00.603 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T05:37:00.625 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T05:37:00.625 INFO:teuthology.orchestra.run.smithi120.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:00.625 INFO:teuthology.orchestra.run.smithi120.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T05:37:00.626 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T05:37:00.626 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T05:37:00.626 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:00.626 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-19T05:37:00.863 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-19T05:37:00.910 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-19T05:37:00.973 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-19T05:37:01.033 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-19T05:37:01.147 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-19T05:37:01.202 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-19T05:37:01.237 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-19T05:37:01.352 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-19T05:37:01.399 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 29/169 2023-12-19T05:37:01.435 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 30/169 2023-12-19T05:37:01.534 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 31/169 2023-12-19T05:37:01.719 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-19T05:37:01.792 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-19T05:37:02.489 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-19T05:37:02.625 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-19T05:37:02.685 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-19T05:37:02.734 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-19T05:37:02.781 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 38/169 2023-12-19T05:37:02.844 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-19T05:37:03.044 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-19T05:37:03.104 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-19T05:37:03.250 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-19T05:37:03.290 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-19T05:37:03.356 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-19T05:37:03.443 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-19T05:37:03.483 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-19T05:37:03.523 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-19T05:37:03.589 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-19T05:37:03.647 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-19T05:37:03.712 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-19T05:37:03.780 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-19T05:37:03.978 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-19T05:37:04.038 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-19T05:37:04.075 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-19T05:37:04.123 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-19T05:37:04.252 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-19T05:37:04.283 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T05:37:04.283 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2023-12-19T05:37:04.283 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2023-12-19T05:37:04.283 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2023-12-19T05:37:04.283 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2023-12-19T05:37:04.283 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2023-12-19T05:37:04.283 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /root 2023-12-19T05:37:04.283 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2023-12-19T05:37:04.283 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:04.290 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/169 2023-12-19T05:37:04.331 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/169 2023-12-19T05:37:04.334 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-19T05:37:04.372 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/169 2023-12-19T05:37:04.387 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-19T05:37:04.404 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-19T05:37:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-19T05:37:04.431 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-19T05:37:04.442 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T05:37:04.458 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T05:37:04.458 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:04.458 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T05:37:04.458 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:04.464 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-19T05:37:04.610 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 139/169 2023-12-19T05:37:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-19T05:37:04.688 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-19T05:37:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-19T05:37:04.761 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-19T05:37:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 141/169 2023-12-19T05:37:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 142/169 2023-12-19T05:37:04.850 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-19T05:37:04.860 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-19T05:37:04.902 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T05:37:04.947 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-19T05:37:04.976 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-19T05:37:05.014 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-19T05:37:05.134 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-19T05:37:05.200 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-19T05:37:05.375 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-19T05:37:05.436 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-19T05:37:05.460 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-19T05:37:05.500 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-19T05:37:05.550 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-19T05:37:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:37:05.596 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-19T05:37:05.597 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:37:05.617 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:37:05.640 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-19T05:37:05.722 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-19T05:37:05.875 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-19T05:37:05.954 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-19T05:37:06.003 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T05:37:06.006 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-19T05:37:06.034 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T05:37:06.034 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:06.035 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T05:37:06.035 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T05:37:06.035 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T05:37:06.035 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:06.166 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-19T05:37:06.210 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-19T05:37:06.239 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T05:37:06.245 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-19T05:37:06.261 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T05:37:06.261 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:06.262 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T05:37:06.262 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T05:37:06.262 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T05:37:06.262 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:06.308 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-19T05:37:06.347 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-19T05:37:06.426 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 149/169 2023-12-19T05:37:06.519 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-19T05:37:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-19T05:37:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-19T05:37:06.571 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-19T05:37:06.602 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-19T05:37:06.682 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-19T05:37:06.714 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-19T05:37:06.723 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T05:37:06.732 INFO:teuthology.orchestra.run.smithi120.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-19T05:37:06.745 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T05:37:06.745 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:06.746 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T05:37:06.746 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T05:37:06.746 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T05:37:06.746 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:06.757 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-19T05:37:06.782 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-19T05:37:06.785 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-19T05:37:06.809 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-19T05:37:06.809 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T05:37:06.833 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-19T05:37:06.877 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T05:37:06.905 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-19T05:37:06.943 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-19T05:37:06.969 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-19T05:37:06.969 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T05:37:07.045 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T05:37:07.070 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T05:37:07.076 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:37:07.077 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:37:07.256 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:37:07.257 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:37:07.280 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T05:37:07.307 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T05:37:07.336 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 120/169 2023-12-19T05:37:07.340 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:37:07.364 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-19T05:37:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-19T05:37:07.398 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 121/169 2023-12-19T05:37:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-19T05:37:07.422 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T05:37:07.471 INFO:teuthology.orchestra.run.smithi120.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T05:37:07.644 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T05:37:07.690 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T05:37:07.741 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-19T05:37:07.793 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-19T05:37:07.834 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-19T05:37:07.892 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-19T05:37:08.002 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-19T05:37:08.052 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-19T05:37:08.319 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-19T05:37:08.357 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-19T05:37:08.456 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-19T05:37:08.652 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T05:37:08.682 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T05:37:08.782 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T05:37:08.928 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 125/169 2023-12-19T05:37:08.969 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T05:37:08.992 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T05:37:08.993 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:08.993 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T05:37:08.993 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T05:37:08.993 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T05:37:08.993 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:09.037 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T05:37:09.049 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T05:37:09.085 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 128/169 2023-12-19T05:37:09.280 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-19T05:37:09.404 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-19T05:37:09.788 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-19T05:37:09.822 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T05:37:09.844 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T05:37:09.844 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:09.844 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T05:37:09.844 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T05:37:09.845 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T05:37:09.845 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:09.889 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T05:37:09.911 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T05:37:09.911 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:09.911 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T05:37:09.911 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:09.957 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T05:37:09.978 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T05:37:09.979 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:09.979 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-19T05:37:09.979 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T05:37:09.979 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T05:37:09.979 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:10.274 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T05:37:10.296 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T05:37:10.297 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:10.297 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T05:37:10.297 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T05:37:10.297 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T05:37:10.297 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:10.992 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-19T05:37:11.095 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-19T05:37:11.135 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-19T05:37:11.165 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-19T05:37:11.238 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-19T05:37:11.284 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-19T05:37:11.669 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-19T05:37:11.703 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T05:37:11.825 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 105/169 2023-12-19T05:37:11.868 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 106/169 2023-12-19T05:37:11.949 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-19T05:37:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T05:37:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/169 2023-12-19T05:37:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/169 2023-12-19T05:37:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/169 2023-12-19T05:37:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/169 2023-12-19T05:37:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/169 2023-12-19T05:37:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/169 2023-12-19T05:37:11.994 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/169 2023-12-19T05:37:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:37:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:37:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T05:37:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/169 2023-12-19T05:37:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/169 2023-12-19T05:37:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/169 2023-12-19T05:37:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:37:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/169 2023-12-19T05:37:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/169 2023-12-19T05:37:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/169 2023-12-19T05:37:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/169 2023-12-19T05:37:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/169 2023-12-19T05:37:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/169 2023-12-19T05:37:11.995 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/169 2023-12-19T05:37:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/169 2023-12-19T05:37:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/169 2023-12-19T05:37:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/169 2023-12-19T05:37:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/169 2023-12-19T05:37:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/169 2023-12-19T05:37:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/169 2023-12-19T05:37:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/169 2023-12-19T05:37:11.996 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/169 2023-12-19T05:37:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/169 2023-12-19T05:37:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/169 2023-12-19T05:37:12.012 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/169 2023-12-19T05:37:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/169 2023-12-19T05:37:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/169 2023-12-19T05:37:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/169 2023-12-19T05:37:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/169 2023-12-19T05:37:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/169 2023-12-19T05:37:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/169 2023-12-19T05:37:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/169 2023-12-19T05:37:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-19T05:37:12.013 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-19T05:37:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-19T05:37:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-19T05:37:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-19T05:37:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-19T05:37:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-19T05:37:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-19T05:37:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-19T05:37:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-19T05:37:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-19T05:37:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-19T05:37:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-19T05:37:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-19T05:37:12.014 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-19T05:37:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-19T05:37:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-19T05:37:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-19T05:37:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-19T05:37:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-19T05:37:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-19T05:37:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-19T05:37:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-19T05:37:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-19T05:37:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-19T05:37:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-19T05:37:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-19T05:37:12.015 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-19T05:37:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-19T05:37:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-19T05:37:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-19T05:37:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-19T05:37:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-19T05:37:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-19T05:37:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-19T05:37:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-19T05:37:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-19T05:37:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-19T05:37:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-19T05:37:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-19T05:37:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-19T05:37:12.016 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-19T05:37:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-19T05:37:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-19T05:37:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-19T05:37:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-19T05:37:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-19T05:37:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-19T05:37:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-19T05:37:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-19T05:37:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-19T05:37:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-19T05:37:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-19T05:37:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-19T05:37:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-19T05:37:12.017 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-19T05:37:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-19T05:37:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-19T05:37:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-19T05:37:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-19T05:37:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-19T05:37:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-19T05:37:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-19T05:37:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-19T05:37:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-19T05:37:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-19T05:37:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-19T05:37:12.018 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-19T05:37:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-19T05:37:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-19T05:37:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-19T05:37:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-19T05:37:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-19T05:37:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-19T05:37:12.019 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-19T05:37:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-19T05:37:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-19T05:37:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-19T05:37:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-19T05:37:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-19T05:37:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-19T05:37:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-19T05:37:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-19T05:37:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-19T05:37:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-19T05:37:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-19T05:37:12.020 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-19T05:37:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-19T05:37:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-19T05:37:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-19T05:37:12.021 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-19T05:37:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-19T05:37:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-19T05:37:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-19T05:37:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-19T05:37:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-19T05:37:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-19T05:37:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-19T05:37:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-19T05:37:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-19T05:37:12.022 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/169 2023-12-19T05:37:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-19T05:37:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/169 2023-12-19T05:37:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-19T05:37:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T05:37:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-19T05:37:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-19T05:37:12.023 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-19T05:37:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-19T05:37:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-19T05:37:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-19T05:37:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-19T05:37:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-19T05:37:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-19T05:37:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-19T05:37:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-19T05:37:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-19T05:37:12.024 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-19T05:37:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-19T05:37:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-19T05:37:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-19T05:37:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-19T05:37:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-19T05:37:12.025 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T05:37:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-19T05:37:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:37:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-19T05:37:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-19T05:37:12.026 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-19T05:37:12.433 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-19T05:37:13.021 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T05:37:13.150 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 109/169 2023-12-19T05:37:13.184 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 110/169 2023-12-19T05:37:13.961 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/169 2023-12-19T05:37:14.002 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/169 2023-12-19T05:37:14.042 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/169 2023-12-19T05:37:14.075 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-19T05:37:14.102 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-19T05:37:14.281 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 139/169 2023-12-19T05:37:14.398 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-19T05:37:14.433 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 141/169 2023-12-19T05:37:14.466 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 142/169 2023-12-19T05:37:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-19T05:37:14.508 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:14.509 INFO:teuthology.orchestra.run.smithi120.stdout:Upgraded: 2023-12-19T05:37:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-19T05:37:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-19T05:37:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-19T05:37:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-19T05:37:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: acl-2.3.1-4.el9.x86_64 2023-12-19T05:37:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-19T05:37:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-19T05:37:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-19T05:37:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-19T05:37:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-19T05:37:14.509 INFO:teuthology.orchestra.run.smithi120.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout:Installed: 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: automake-1.16.2-8.el9.noarch 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: bison-3.7.4-5.el9.x86_64 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.510 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.511 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.511 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:14.511 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:14.511 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:14.511 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:14.511 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:14.511 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.511 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.511 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:14.511 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.511 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.511 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.511 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:14.512 INFO:teuthology.orchestra.run.smithi120.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:14.512 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.512 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.512 INFO:teuthology.orchestra.run.smithi120.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:14.512 INFO:teuthology.orchestra.run.smithi120.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-19T05:37:14.512 INFO:teuthology.orchestra.run.smithi120.stdout: flex-2.6.4-9.el9.x86_64 2023-12-19T05:37:14.512 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T05:37:14.512 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T05:37:14.512 INFO:teuthology.orchestra.run.smithi120.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T05:37:14.512 INFO:teuthology.orchestra.run.smithi120.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-19T05:37:14.512 INFO:teuthology.orchestra.run.smithi120.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-19T05:37:14.513 INFO:teuthology.orchestra.run.smithi120.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T05:37:14.513 INFO:teuthology.orchestra.run.smithi120.stdout: jq-1.6-16.el9.x86_64 2023-12-19T05:37:14.513 INFO:teuthology.orchestra.run.smithi120.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-19T05:37:14.513 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T05:37:14.513 INFO:teuthology.orchestra.run.smithi120.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T05:37:14.513 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.513 INFO:teuthology.orchestra.run.smithi120.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.514 INFO:teuthology.orchestra.run.smithi120.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.514 INFO:teuthology.orchestra.run.smithi120.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T05:37:14.514 INFO:teuthology.orchestra.run.smithi120.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T05:37:14.514 INFO:teuthology.orchestra.run.smithi120.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T05:37:14.514 INFO:teuthology.orchestra.run.smithi120.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T05:37:14.514 INFO:teuthology.orchestra.run.smithi120.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T05:37:14.514 INFO:teuthology.orchestra.run.smithi120.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.514 INFO:teuthology.orchestra.run.smithi120.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.514 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T05:37:14.514 INFO:teuthology.orchestra.run.smithi120.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.514 INFO:teuthology.orchestra.run.smithi120.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-19T05:37:14.515 INFO:teuthology.orchestra.run.smithi120.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T05:37:14.515 INFO:teuthology.orchestra.run.smithi120.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-19T05:37:14.515 INFO:teuthology.orchestra.run.smithi120.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-19T05:37:14.515 INFO:teuthology.orchestra.run.smithi120.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T05:37:14.515 INFO:teuthology.orchestra.run.smithi120.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T05:37:14.515 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T05:37:14.515 INFO:teuthology.orchestra.run.smithi120.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T05:37:14.515 INFO:teuthology.orchestra.run.smithi120.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-19T05:37:14.515 INFO:teuthology.orchestra.run.smithi120.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T05:37:14.515 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-13.11-1.el9.x86_64 2023-12-19T05:37:14.515 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-19T05:37:14.515 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-19T05:37:14.515 INFO:teuthology.orchestra.run.smithi120.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-19T05:37:14.515 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T05:37:14.516 INFO:teuthology.orchestra.run.smithi120.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-19T05:37:14.516 INFO:teuthology.orchestra.run.smithi120.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T05:37:14.516 INFO:teuthology.orchestra.run.smithi120.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T05:37:14.516 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T05:37:14.516 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.516 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.516 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.516 INFO:teuthology.orchestra.run.smithi120.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T05:37:14.516 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T05:37:14.516 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T05:37:14.516 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T05:37:14.516 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-19T05:37:14.517 INFO:teuthology.orchestra.run.smithi120.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-19T05:37:14.517 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T05:37:14.517 INFO:teuthology.orchestra.run.smithi120.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T05:37:14.517 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T05:37:14.517 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T05:37:14.517 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T05:37:14.517 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T05:37:14.517 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T05:37:14.517 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T05:37:14.517 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T05:37:14.517 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T05:37:14.517 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T05:37:14.517 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T05:37:14.518 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T05:37:14.518 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T05:37:14.518 INFO:teuthology.orchestra.run.smithi120.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T05:37:14.518 INFO:teuthology.orchestra.run.smithi120.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T05:37:14.518 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T05:37:14.518 INFO:teuthology.orchestra.run.smithi120.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T05:37:14.518 INFO:teuthology.orchestra.run.smithi120.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T05:37:14.518 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T05:37:14.518 INFO:teuthology.orchestra.run.smithi120.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T05:37:14.518 INFO:teuthology.orchestra.run.smithi120.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T05:37:14.518 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T05:37:14.518 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T05:37:14.518 INFO:teuthology.orchestra.run.smithi120.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T05:37:14.519 INFO:teuthology.orchestra.run.smithi120.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T05:37:14.519 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T05:37:14.519 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T05:37:14.519 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T05:37:14.519 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T05:37:14.519 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-19T05:37:14.519 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T05:37:14.519 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.519 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.519 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T05:37:14.519 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T05:37:14.519 INFO:teuthology.orchestra.run.smithi120.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T05:37:14.519 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T05:37:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T05:37:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T05:37:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T05:37:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T05:37:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T05:37:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T05:37:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-19T05:37:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T05:37:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T05:37:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T05:37:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T05:37:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.520 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.521 INFO:teuthology.orchestra.run.smithi120.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:14.521 INFO:teuthology.orchestra.run.smithi120.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T05:37:14.521 INFO:teuthology.orchestra.run.smithi120.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T05:37:14.521 INFO:teuthology.orchestra.run.smithi120.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T05:37:14.521 INFO:teuthology.orchestra.run.smithi120.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-19T05:37:14.521 INFO:teuthology.orchestra.run.smithi120.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-19T05:37:14.521 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T05:37:14.522 INFO:teuthology.orchestra.run.smithi120.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-19T05:37:14.522 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:14.522 INFO:teuthology.orchestra.run.smithi120.stdout:Complete! 2023-12-19T05:37:14.522 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-19T05:37:14.573 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T05:37:14.617 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-19T05:37:14.655 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-19T05:37:14.701 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-19T05:37:15.047 DEBUG:teuthology.parallel:result is None 2023-12-19T05:37:15.281 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:37:15.318 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:37:15.336 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:37:15.573 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:37:15.620 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:37:16.151 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 149/169 2023-12-19T05:37:16.256 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-19T05:37:16.262 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 111/169 2023-12-19T05:37:16.305 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-19T05:37:16.310 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T05:37:16.371 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-19T05:37:16.452 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-19T05:37:16.484 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-19T05:37:16.505 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 112/169 2023-12-19T05:37:16.505 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-19T05:37:16.505 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-19T05:37:16.505 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:16.509 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-19T05:37:16.535 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-19T05:37:16.562 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-19T05:37:16.562 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T05:37:16.569 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T05:37:16.654 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T05:37:16.683 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-19T05:37:16.713 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-19T05:37:16.738 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-19T05:37:16.738 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T05:37:16.822 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T05:37:16.847 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T05:37:16.853 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:37:16.853 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:37:17.034 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:37:17.034 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:37:17.117 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:37:17.142 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-19T05:37:17.167 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-19T05:37:17.192 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-19T05:37:17.255 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T05:37:21.645 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T05:37:21.645 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/169 2023-12-19T05:37:21.645 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/169 2023-12-19T05:37:21.645 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/169 2023-12-19T05:37:21.645 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/169 2023-12-19T05:37:21.645 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/169 2023-12-19T05:37:21.645 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/169 2023-12-19T05:37:21.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/169 2023-12-19T05:37:21.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:37:21.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:37:21.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T05:37:21.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/169 2023-12-19T05:37:21.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/169 2023-12-19T05:37:21.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/169 2023-12-19T05:37:21.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:37:21.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/169 2023-12-19T05:37:21.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/169 2023-12-19T05:37:21.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/169 2023-12-19T05:37:21.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/169 2023-12-19T05:37:21.646 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/169 2023-12-19T05:37:21.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/169 2023-12-19T05:37:21.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/169 2023-12-19T05:37:21.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/169 2023-12-19T05:37:21.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/169 2023-12-19T05:37:21.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/169 2023-12-19T05:37:21.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/169 2023-12-19T05:37:21.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/169 2023-12-19T05:37:21.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/169 2023-12-19T05:37:21.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/169 2023-12-19T05:37:21.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/169 2023-12-19T05:37:21.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/169 2023-12-19T05:37:21.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/169 2023-12-19T05:37:21.647 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/169 2023-12-19T05:37:21.659 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/169 2023-12-19T05:37:21.660 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/169 2023-12-19T05:37:21.660 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/169 2023-12-19T05:37:21.660 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/169 2023-12-19T05:37:21.660 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/169 2023-12-19T05:37:21.660 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/169 2023-12-19T05:37:21.660 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/169 2023-12-19T05:37:21.660 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-19T05:37:21.660 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-19T05:37:21.660 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-19T05:37:21.660 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-19T05:37:21.660 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-19T05:37:21.660 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-19T05:37:21.660 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-19T05:37:21.661 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-19T05:37:21.661 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-19T05:37:21.661 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-19T05:37:21.661 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-19T05:37:21.661 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-19T05:37:21.661 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-19T05:37:21.661 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-19T05:37:21.661 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-19T05:37:21.661 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-19T05:37:21.661 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-19T05:37:21.661 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-19T05:37:21.661 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-19T05:37:21.661 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-19T05:37:21.662 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-19T05:37:21.662 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-19T05:37:21.662 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-19T05:37:21.662 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-19T05:37:21.662 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-19T05:37:21.662 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-19T05:37:21.662 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-19T05:37:21.662 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-19T05:37:21.662 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-19T05:37:21.662 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-19T05:37:21.662 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-19T05:37:21.662 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-19T05:37:21.662 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-19T05:37:21.663 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-19T05:37:21.663 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-19T05:37:21.663 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-19T05:37:21.663 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-19T05:37:21.663 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-19T05:37:21.663 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-19T05:37:21.663 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-19T05:37:21.663 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-19T05:37:21.663 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-19T05:37:21.663 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-19T05:37:21.663 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-19T05:37:21.663 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-19T05:37:21.663 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-19T05:37:21.663 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-19T05:37:21.664 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-19T05:37:21.664 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-19T05:37:21.664 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-19T05:37:21.664 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-19T05:37:21.664 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-19T05:37:21.664 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-19T05:37:21.664 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-19T05:37:21.664 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-19T05:37:21.664 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-19T05:37:21.664 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-19T05:37:21.664 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-19T05:37:21.664 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-19T05:37:21.664 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-19T05:37:21.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-19T05:37:21.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-19T05:37:21.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-19T05:37:21.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-19T05:37:21.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-19T05:37:21.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-19T05:37:21.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-19T05:37:21.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-19T05:37:21.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-19T05:37:21.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-19T05:37:21.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-19T05:37:21.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-19T05:37:21.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-19T05:37:21.665 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-19T05:37:21.666 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-19T05:37:21.666 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-19T05:37:21.666 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-19T05:37:21.666 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-19T05:37:21.666 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-19T05:37:21.666 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-19T05:37:21.666 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-19T05:37:21.666 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-19T05:37:21.666 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-19T05:37:21.666 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-19T05:37:21.666 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-19T05:37:21.666 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-19T05:37:21.666 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-19T05:37:21.666 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-19T05:37:21.667 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-19T05:37:21.667 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-19T05:37:21.667 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-19T05:37:21.667 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-19T05:37:21.667 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-19T05:37:21.667 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-19T05:37:21.667 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-19T05:37:21.667 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-19T05:37:21.667 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-19T05:37:21.667 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-19T05:37:21.667 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-19T05:37:21.667 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-19T05:37:21.667 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-19T05:37:21.668 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-19T05:37:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-19T05:37:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-19T05:37:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-19T05:37:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-19T05:37:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-19T05:37:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-19T05:37:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-19T05:37:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T05:37:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-19T05:37:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:37:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-19T05:37:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-19T05:37:21.669 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-19T05:37:24.146 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-19T05:37:24.147 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:24.147 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2023-12-19T05:37:24.147 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-19T05:37:24.147 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-19T05:37:24.147 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-19T05:37:24.147 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-19T05:37:24.147 INFO:teuthology.orchestra.run.smithi155.stdout: acl-2.3.1-4.el9.x86_64 2023-12-19T05:37:24.147 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-19T05:37:24.147 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-19T05:37:24.147 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-19T05:37:24.147 INFO:teuthology.orchestra.run.smithi155.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-19T05:37:24.147 INFO:teuthology.orchestra.run.smithi155.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-19T05:37:24.147 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.148 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.148 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-19T05:37:24.148 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-19T05:37:24.148 INFO:teuthology.orchestra.run.smithi155.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-19T05:37:24.148 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2023-12-19T05:37:24.148 INFO:teuthology.orchestra.run.smithi155.stdout: automake-1.16.2-8.el9.noarch 2023-12-19T05:37:24.148 INFO:teuthology.orchestra.run.smithi155.stdout: bison-3.7.4-5.el9.x86_64 2023-12-19T05:37:24.148 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T05:37:24.148 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.148 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.148 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.148 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.148 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:24.148 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.149 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.149 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.149 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:24.149 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:24.149 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:24.149 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:24.149 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:24.149 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.149 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.149 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:24.149 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.149 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.150 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.150 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:24.150 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:24.150 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.150 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.150 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:24.150 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-19T05:37:24.150 INFO:teuthology.orchestra.run.smithi155.stdout: flex-2.6.4-9.el9.x86_64 2023-12-19T05:37:24.150 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T05:37:24.150 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T05:37:24.150 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T05:37:24.150 INFO:teuthology.orchestra.run.smithi155.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-19T05:37:24.151 INFO:teuthology.orchestra.run.smithi155.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-19T05:37:24.151 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T05:37:24.151 INFO:teuthology.orchestra.run.smithi155.stdout: jq-1.6-16.el9.x86_64 2023-12-19T05:37:24.151 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-19T05:37:24.151 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T05:37:24.151 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T05:37:24.151 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.151 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.151 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.151 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T05:37:24.151 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T05:37:24.151 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T05:37:24.151 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T05:37:24.151 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T05:37:24.152 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.152 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.152 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T05:37:24.152 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.152 INFO:teuthology.orchestra.run.smithi155.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-19T05:37:24.152 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T05:37:24.152 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-19T05:37:24.152 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-19T05:37:24.152 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T05:37:24.152 INFO:teuthology.orchestra.run.smithi155.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T05:37:24.152 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T05:37:24.152 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T05:37:24.152 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-19T05:37:24.152 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T05:37:24.153 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-13.11-1.el9.x86_64 2023-12-19T05:37:24.153 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-19T05:37:24.153 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-19T05:37:24.153 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-19T05:37:24.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T05:37:24.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-19T05:37:24.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T05:37:24.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T05:37:24.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T05:37:24.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.153 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T05:37:24.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T05:37:24.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T05:37:24.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T05:37:24.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-19T05:37:24.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-19T05:37:24.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T05:37:24.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T05:37:24.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T05:37:24.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T05:37:24.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T05:37:24.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T05:37:24.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T05:37:24.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T05:37:24.154 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T05:37:24.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T05:37:24.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T05:37:24.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T05:37:24.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T05:37:24.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T05:37:24.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T05:37:24.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T05:37:24.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T05:37:24.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T05:37:24.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T05:37:24.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T05:37:24.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T05:37:24.155 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T05:37:24.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T05:37:24.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T05:37:24.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T05:37:24.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T05:37:24.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T05:37:24.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T05:37:24.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T05:37:24.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T05:37:24.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-19T05:37:24.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T05:37:24.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.156 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T05:37:24.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T05:37:24.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T05:37:24.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.157 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T05:37:24.158 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T05:37:24.158 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T05:37:24.158 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T05:37:24.158 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T05:37:24.158 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T05:37:24.158 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T05:37:24.158 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-19T05:37:24.158 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T05:37:24.158 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T05:37:24.159 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T05:37:24.159 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T05:37:24.159 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.159 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.159 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:24.159 INFO:teuthology.orchestra.run.smithi155.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T05:37:24.159 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T05:37:24.159 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T05:37:24.159 INFO:teuthology.orchestra.run.smithi155.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-19T05:37:24.159 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-19T05:37:24.159 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T05:37:24.160 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-19T05:37:24.160 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:24.160 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2023-12-19T05:37:24.733 DEBUG:teuthology.parallel:result is None 2023-12-19T05:37:29.127 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 113/169 2023-12-19T05:37:29.127 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /sys 2023-12-19T05:37:29.128 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /proc 2023-12-19T05:37:29.128 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /mnt 2023-12-19T05:37:29.128 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /var/tmp 2023-12-19T05:37:29.128 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /home 2023-12-19T05:37:29.128 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /root 2023-12-19T05:37:29.128 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /tmp 2023-12-19T05:37:29.128 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:29.341 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T05:37:29.388 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 114/169 2023-12-19T05:37:29.389 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:29.389 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-19T05:37:29.389 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:31.043 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T05:37:31.127 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 115/169 2023-12-19T05:37:31.127 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:31.127 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-19T05:37:31.127 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T05:37:31.127 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-19T05:37:31.128 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:31.360 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T05:37:31.442 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 116/169 2023-12-19T05:37:31.442 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:31.442 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-19T05:37:31.442 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T05:37:31.443 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-19T05:37:31.443 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:31.960 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T05:37:32.049 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 117/169 2023-12-19T05:37:32.049 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:32.049 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-19T05:37:32.049 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T05:37:32.050 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-19T05:37:32.050 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:32.190 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-19T05:37:32.866 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T05:37:32.900 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 119/169 2023-12-19T05:37:32.946 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 120/169 2023-12-19T05:37:33.060 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 121/169 2023-12-19T05:37:33.095 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T05:37:33.418 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 122/169 2023-12-19T05:37:33.454 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T05:37:34.584 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 123/169 2023-12-19T05:37:34.621 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T05:37:34.766 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 124/169 2023-12-19T05:37:34.961 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 125/169 2023-12-19T05:37:34.990 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T05:37:35.060 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 126/169 2023-12-19T05:37:35.060 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:35.060 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-19T05:37:35.060 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T05:37:35.061 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-19T05:37:35.061 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:35.149 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T05:37:35.189 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 127/169 2023-12-19T05:37:35.284 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 128/169 2023-12-19T05:37:36.127 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-19T05:37:36.184 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T05:37:36.264 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 130/169 2023-12-19T05:37:36.264 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:36.264 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-19T05:37:36.264 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T05:37:36.264 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-19T05:37:36.264 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:36.326 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T05:37:36.399 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 131/169 2023-12-19T05:37:36.399 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:36.399 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-19T05:37:36.399 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:36.478 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 132/169 2023-12-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-19T05:37:36.556 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:36.927 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T05:37:37.000 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 133/169 2023-12-19T05:37:37.000 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-19T05:37:37.000 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-19T05:37:37.000 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T05:37:37.000 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-19T05:37:37.000 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:41.049 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 134/169 2023-12-19T05:37:41.098 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 135/169 2023-12-19T05:37:41.153 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 136/169 2023-12-19T05:37:41.190 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-19T05:37:41.222 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-19T05:37:41.512 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 139/169 2023-12-19T05:37:41.631 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-19T05:37:41.690 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 141/169 2023-12-19T05:37:41.729 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 142/169 2023-12-19T05:37:41.829 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-19T05:37:41.891 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T05:37:41.939 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-19T05:37:41.991 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-19T05:37:42.074 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-19T05:37:43.038 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:37:43.100 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:37:43.156 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-19T05:37:44.509 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 149/169 2023-12-19T05:37:44.643 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-19T05:37:44.744 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-19T05:37:44.825 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-19T05:37:45.000 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-19T05:37:45.047 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-19T05:37:45.080 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-19T05:37:45.114 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-19T05:37:45.181 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-19T05:37:45.181 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T05:37:45.322 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-19T05:37:45.373 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-19T05:37:45.419 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-19T05:37:45.451 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-19T05:37:45.451 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T05:37:45.655 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-19T05:37:45.686 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T05:37:45.735 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:37:45.735 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:37:46.068 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-19T05:37:46.069 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:37:46.244 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:37:46.280 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-19T05:37:46.314 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-19T05:37:46.349 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-19T05:37:46.475 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T05:37:46.769 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-19T05:37:46.769 INFO:teuthology.orchestra.run.smithi188.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-19T05:37:46.769 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:51.712 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 1/169 2023-12-19T05:37:51.713 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2/169 2023-12-19T05:37:51.713 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 3/169 2023-12-19T05:37:51.713 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 4/169 2023-12-19T05:37:51.713 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1377.g24e2e 5/169 2023-12-19T05:37:51.713 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 6/169 2023-12-19T05:37:51.713 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 7/169 2023-12-19T05:37:51.713 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 8/169 2023-12-19T05:37:51.713 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 9/169 2023-12-19T05:37:51.713 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 10/169 2023-12-19T05:37:51.713 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 11/169 2023-12-19T05:37:51.713 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 12/169 2023-12-19T05:37:51.714 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 13/169 2023-12-19T05:37:51.714 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 14/169 2023-12-19T05:37:51.714 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_ 15/169 2023-12-19T05:37:51.714 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 16/169 2023-12-19T05:37:51.714 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 17/169 2023-12-19T05:37:51.714 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_6 18/169 2023-12-19T05:37:51.714 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86 19/169 2023-12-19T05:37:51.714 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 20/169 2023-12-19T05:37:51.714 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el 21/169 2023-12-19T05:37:51.714 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9. 22/169 2023-12-19T05:37:51.714 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_6 23/169 2023-12-19T05:37:51.714 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 24/169 2023-12-19T05:37:51.715 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 25/169 2023-12-19T05:37:51.715 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 26/169 2023-12-19T05:37:51.715 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 27/169 2023-12-19T05:37:51.715 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 28/169 2023-12-19T05:37:51.715 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 29/169 2023-12-19T05:37:51.727 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a. 30/169 2023-12-19T05:37:51.728 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noa 31/169 2023-12-19T05:37:51.728 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.n 32/169 2023-12-19T05:37:51.728 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e 33/169 2023-12-19T05:37:51.728 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el 34/169 2023-12-19T05:37:51.728 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 35/169 2023-12-19T05:37:51.728 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.e 36/169 2023-12-19T05:37:51.728 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 37/169 2023-12-19T05:37:51.728 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 38/169 2023-12-19T05:37:51.728 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 39/169 2023-12-19T05:37:51.728 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-19T05:37:51.728 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-19T05:37:51.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-19T05:37:51.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-19T05:37:51.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-19T05:37:51.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-19T05:37:51.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-19T05:37:51.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-19T05:37:51.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-19T05:37:51.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-19T05:37:51.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-19T05:37:51.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-19T05:37:51.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-19T05:37:51.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-19T05:37:51.729 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-19T05:37:51.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-19T05:37:51.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-19T05:37:51.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-19T05:37:51.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-19T05:37:51.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-19T05:37:51.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-19T05:37:51.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-19T05:37:51.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-19T05:37:51.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-19T05:37:51.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-19T05:37:51.730 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-19T05:37:51.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-19T05:37:51.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-19T05:37:51.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-19T05:37:51.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-19T05:37:51.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-19T05:37:51.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-19T05:37:51.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-19T05:37:51.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-19T05:37:51.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-19T05:37:51.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-19T05:37:51.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-19T05:37:51.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-19T05:37:51.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-19T05:37:51.731 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-19T05:37:51.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-19T05:37:51.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-19T05:37:51.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-19T05:37:51.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-19T05:37:51.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-19T05:37:51.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-19T05:37:51.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-19T05:37:51.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-19T05:37:51.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-19T05:37:51.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-19T05:37:51.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-19T05:37:51.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-19T05:37:51.732 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-19T05:37:51.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-19T05:37:51.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-19T05:37:51.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-19T05:37:51.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-19T05:37:51.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-19T05:37:51.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-19T05:37:51.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-19T05:37:51.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-19T05:37:51.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-19T05:37:51.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-19T05:37:51.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-19T05:37:51.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-19T05:37:51.733 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-19T05:37:51.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-19T05:37:51.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-19T05:37:51.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-19T05:37:51.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-19T05:37:51.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-19T05:37:51.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-19T05:37:51.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-19T05:37:51.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-19T05:37:51.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-19T05:37:51.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-19T05:37:51.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-19T05:37:51.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-19T05:37:51.734 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-19T05:37:51.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-19T05:37:51.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-19T05:37:51.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-19T05:37:51.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-19T05:37:51.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-19T05:37:51.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-19T05:37:51.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-19T05:37:51.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-19T05:37:51.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-19T05:37:51.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-19T05:37:51.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-19T05:37:51.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-19T05:37:51.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-19T05:37:51.735 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-19T05:37:51.736 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-19T05:37:51.736 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-19T05:37:51.736 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-19T05:37:51.736 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-19T05:37:51.736 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-19T05:37:51.736 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-19T05:37:51.736 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-19T05:37:51.736 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 140/169 2023-12-19T05:37:51.736 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-19T05:37:51.736 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 142/169 2023-12-19T05:37:51.736 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-19T05:37:51.736 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-19T05:37:51.736 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-19T05:37:51.737 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-19T05:37:51.737 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-19T05:37:51.737 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-19T05:37:51.737 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-19T05:37:51.737 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-19T05:37:51.737 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-19T05:37:51.737 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-19T05:37:51.737 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-19T05:37:51.737 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-19T05:37:51.737 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-19T05:37:51.737 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-19T05:37:51.737 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-19T05:37:51.737 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-19T05:37:51.738 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-19T05:37:51.738 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-19T05:37:51.738 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-19T05:37:51.738 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-19T05:37:51.738 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-19T05:37:51.738 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-19T05:37:51.738 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-19T05:37:51.738 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-19T05:37:51.738 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-19T05:37:51.738 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-19T05:37:54.089 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-19T05:37:54.089 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:54.090 INFO:teuthology.orchestra.run.smithi188.stdout:Upgraded: 2023-12-19T05:37:54.090 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-19T05:37:54.090 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-19T05:37:54.090 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-19T05:37:54.090 INFO:teuthology.orchestra.run.smithi188.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-19T05:37:54.090 INFO:teuthology.orchestra.run.smithi188.stdout: acl-2.3.1-4.el9.x86_64 2023-12-19T05:37:54.090 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-19T05:37:54.090 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-19T05:37:54.090 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-19T05:37:54.090 INFO:teuthology.orchestra.run.smithi188.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-19T05:37:54.090 INFO:teuthology.orchestra.run.smithi188.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-19T05:37:54.091 INFO:teuthology.orchestra.run.smithi188.stdout: librados2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.091 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.091 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-19T05:37:54.091 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-19T05:37:54.091 INFO:teuthology.orchestra.run.smithi188.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-19T05:37:54.091 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-19T05:37:54.091 INFO:teuthology.orchestra.run.smithi188.stdout: automake-1.16.2-8.el9.noarch 2023-12-19T05:37:54.091 INFO:teuthology.orchestra.run.smithi188.stdout: bison-3.7.4-5.el9.x86_64 2023-12-19T05:37:54.091 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-19T05:37:54.091 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.091 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.091 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.091 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.092 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:54.092 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.092 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.092 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.092 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:54.092 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:54.092 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:54.092 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:54.092 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:54.092 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.092 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.092 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:54.093 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.093 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.093 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.093 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:54.093 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:54.093 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.093 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-shell-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.093 INFO:teuthology.orchestra.run.smithi188.stdout: cephfs-top-2:18.2.0-1377.g24e2e32a.el9.noarch 2023-12-19T05:37:54.093 INFO:teuthology.orchestra.run.smithi188.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-19T05:37:54.093 INFO:teuthology.orchestra.run.smithi188.stdout: flex-2.6.4-9.el9.x86_64 2023-12-19T05:37:54.093 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-19T05:37:54.093 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-19T05:37:54.093 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-19T05:37:54.094 INFO:teuthology.orchestra.run.smithi188.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-19T05:37:54.094 INFO:teuthology.orchestra.run.smithi188.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-19T05:37:54.094 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-19T05:37:54.094 INFO:teuthology.orchestra.run.smithi188.stdout: jq-1.6-16.el9.x86_64 2023-12-19T05:37:54.094 INFO:teuthology.orchestra.run.smithi188.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-19T05:37:54.094 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-19T05:37:54.094 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-19T05:37:54.094 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.094 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.094 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.094 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-19T05:37:54.094 INFO:teuthology.orchestra.run.smithi188.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-19T05:37:54.094 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-19T05:37:54.095 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-19T05:37:54.095 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-19T05:37:54.095 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.095 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.095 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-19T05:37:54.095 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.095 INFO:teuthology.orchestra.run.smithi188.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-19T05:37:54.095 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-19T05:37:54.095 INFO:teuthology.orchestra.run.smithi188.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-19T05:37:54.095 INFO:teuthology.orchestra.run.smithi188.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-19T05:37:54.095 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-19T05:37:54.095 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-19T05:37:54.095 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-19T05:37:54.095 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-19T05:37:54.096 INFO:teuthology.orchestra.run.smithi188.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-19T05:37:54.096 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-19T05:37:54.096 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-13.11-1.el9.x86_64 2023-12-19T05:37:54.096 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-19T05:37:54.096 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-19T05:37:54.096 INFO:teuthology.orchestra.run.smithi188.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-19T05:37:54.096 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-19T05:37:54.096 INFO:teuthology.orchestra.run.smithi188.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-19T05:37:54.096 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-19T05:37:54.096 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-19T05:37:54.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-19T05:37:54.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-19T05:37:54.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-19T05:37:54.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-19T05:37:54.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-19T05:37:54.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-19T05:37:54.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-19T05:37:54.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-19T05:37:54.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-19T05:37:54.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-19T05:37:54.097 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-19T05:37:54.098 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-19T05:37:54.098 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-19T05:37:54.098 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-19T05:37:54.098 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-19T05:37:54.098 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-19T05:37:54.098 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-19T05:37:54.098 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-19T05:37:54.098 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-19T05:37:54.098 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-19T05:37:54.098 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-19T05:37:54.098 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-19T05:37:54.098 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-19T05:37:54.098 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-19T05:37:54.098 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-19T05:37:54.099 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-19T05:37:54.099 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-19T05:37:54.099 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-19T05:37:54.099 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-19T05:37:54.099 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-19T05:37:54.099 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply-3.11-14.el9.noarch 2023-12-19T05:37:54.099 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-19T05:37:54.099 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-19T05:37:54.099 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-19T05:37:54.099 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-19T05:37:54.099 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-19T05:37:54.099 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-19T05:37:54.099 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-19T05:37:54.099 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-19T05:37:54.100 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-19T05:37:54.101 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-19T05:37:54.101 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-19T05:37:54.101 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-19T05:37:54.101 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.101 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.101 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd-2:18.2.0-1377.g24e2e32a.el9.x86_64 2023-12-19T05:37:54.101 INFO:teuthology.orchestra.run.smithi188.stdout: re2-1:20211101-3.el9.x86_64 2023-12-19T05:37:54.101 INFO:teuthology.orchestra.run.smithi188.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-19T05:37:54.101 INFO:teuthology.orchestra.run.smithi188.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-19T05:37:54.101 INFO:teuthology.orchestra.run.smithi188.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-19T05:37:54.101 INFO:teuthology.orchestra.run.smithi188.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-19T05:37:54.101 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-19T05:37:54.102 INFO:teuthology.orchestra.run.smithi188.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-19T05:37:54.102 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:54.102 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-19T05:37:54.684 DEBUG:teuthology.parallel:result is None 2023-12-19T05:37:54.685 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T05:37:54.905 DEBUG:teuthology.orchestra.run.smithi120:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T05:37:54.930 INFO:teuthology.orchestra.run.smithi120.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-19T05:37:54.931 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-19T05:37:54.931 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-19T05:37:54.933 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T05:37:55.151 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T05:37:55.177 INFO:teuthology.orchestra.run.smithi155.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-19T05:37:55.177 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-19T05:37:55.177 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-19T05:37:55.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=24e2e32ab893c11f7e31ee84381b2f961d1b317c 2023-12-19T05:37:55.396 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-19T05:37:55.457 INFO:teuthology.orchestra.run.smithi188.stdout:18.2.0-1377.g24e2e32a.el9 2023-12-19T05:37:55.457 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1377.g24e2e32a.el9 2023-12-19T05:37:55.457 INFO:teuthology.task.install:The correct ceph version 18.2.0-1377.g24e2e32a is installed. 2023-12-19T05:37:55.459 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-19T05:37:55.459 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:37:55.459 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T05:37:55.495 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:37:55.495 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T05:37:55.530 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:37:55.530 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T05:37:55.612 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-19T05:37:55.612 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:37:55.612 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T05:37:55.644 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T05:37:55.714 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:37:55.715 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T05:37:55.748 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T05:37:55.818 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:37:55.818 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T05:37:55.894 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T05:37:56.013 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-19T05:37:56.013 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:37:56.013 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T05:37:56.045 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T05:37:56.114 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:37:56.115 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T05:37:56.143 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T05:37:56.211 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:37:56.211 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T05:37:56.293 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T05:37:56.410 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-19T05:37:56.410 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:37:56.410 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T05:37:56.439 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T05:37:56.505 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:37:56.506 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T05:37:56.534 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T05:37:56.602 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:37:56.602 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T05:37:56.693 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T05:37:56.822 INFO:teuthology.run_tasks:Running task ceph... 2023-12-19T05:37:56.918 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-19T05:37:56.919 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2023-12-19T05:37:56.922 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /var/log/ceph 2023-12-19T05:37:56.925 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 777 /var/log/ceph 2023-12-19T05:37:57.009 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-19T05:37:57.009 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T05:37:57.013 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T05:37:57.015 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T05:37:57.087 INFO:tasks.ceph:Creating extra log directories... 2023-12-19T05:37:57.087 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T05:37:57.089 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T05:37:57.091 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T05:37:57.166 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-19T05:37:57.166 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-19T05:37:57.166 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-19T05:37:57.167 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:37:57.167 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T05:37:57.184 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T05:37:57.299 DEBUG:teuthology.orchestra.run.smithi120:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-19T05:37:57.326 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:37:57.326 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T05:37:57.341 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T05:37:57.460 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-19T05:37:57.487 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:37:57.487 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T05:37:57.530 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T05:37:57.733 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-19T05:37:57.813 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-19T05:37:57.813 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-19T05:37:57.814 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi/7495666', 'branch': 'rishabh-mdscap-reef', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common}', 'email': None, 'first_in_suite': False, 'job_id': '7495666', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-12-19_05:09:22-fs-rishabh-mdscap-reef-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-mdscap-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mdscap-reef', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 9974, 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'sleep_before_teardown': 0, 'subset': '301/512', 'suite': 'fs', 'suite_branch': 'rishabh-mdscap-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_24e2e32ab893c11f7e31ee84381b2f961d1b317c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNKYPxCG5tfyB7VJv1zQilOS7o1Qd6nKauCYBYgHZDXUtgFB2X4aazON73bL3PW+CoFRVbQXuaczqAM6dqGJJ9o=', 'smithi155.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGM8PnFWmnVtm4CsgmmeHNSXUyIbfYxX5Flw1cdrqGhFn1cJL0LRNzMSisn5eyiQspNCc6Z19PWNoXpQ1a25vDA=', 'smithi188.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFOi3SwN1u8ImHtE7fhfdgUeNPv7jH8ti5mSueEPNoTZcb5Bpm4LqDDMJqC+iolCegUGgDWvL6junwJVdA2ZXFA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '24e2e32ab893c11f7e31ee84381b2f961d1b317c', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-19_05:09:22', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-19T05:37:57.815 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T05:37:57.817 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T05:37:57.819 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T05:37:57.858 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T05:37:57.873 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T05:37:57.875 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T05:37:57.970 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:37:57.970 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T05:37:57.985 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T05:37:57.986 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2023-12-19T05:37:58.041 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T05:37:58.041 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:37:58.041 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-12-19T05:37:58.041 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:37:58.041 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:37:58.041 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2023-12-19 05:37:07.788810670 +0000 2023-12-19T05:37:58.042 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2023-12-19 05:31:09.247478679 +0000 2023-12-19T05:37:58.042 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2023-12-19 05:31:09.247478679 +0000 2023-12-19T05:37:58.042 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2023-12-19 05:31:09.247478679 +0000 2023-12-19T05:37:58.042 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T05:37:58.107 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2023-12-19T05:37:58.107 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2023-12-19T05:37:58.107 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000184279 s, 2.8 MB/s 2023-12-19T05:37:58.108 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T05:37:58.165 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2023-12-19T05:37:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T05:37:58.219 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:37:58.219 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-12-19T05:37:58.220 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:37:58.220 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:37:58.220 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2023-12-19 05:37:07.788810670 +0000 2023-12-19T05:37:58.220 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2023-12-19 05:31:09.782466753 +0000 2023-12-19T05:37:58.220 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2023-12-19 05:31:09.782466753 +0000 2023-12-19T05:37:58.220 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2023-12-19 05:31:09.782466753 +0000 2023-12-19T05:37:58.220 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T05:37:58.285 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2023-12-19T05:37:58.286 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2023-12-19T05:37:58.286 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000203019 s, 2.5 MB/s 2023-12-19T05:37:58.287 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T05:37:58.342 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2023-12-19T05:37:58.397 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T05:37:58.398 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:37:58.398 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-12-19T05:37:58.398 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:37:58.398 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:37:58.398 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2023-12-19 05:37:07.788810670 +0000 2023-12-19T05:37:58.398 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2023-12-19 05:31:10.280455652 +0000 2023-12-19T05:37:58.398 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2023-12-19 05:31:10.280455652 +0000 2023-12-19T05:37:58.398 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2023-12-19 05:31:10.280455652 +0000 2023-12-19T05:37:58.398 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T05:37:58.463 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2023-12-19T05:37:58.464 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2023-12-19T05:37:58.464 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000191479 s, 2.7 MB/s 2023-12-19T05:37:58.465 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T05:37:58.520 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2023-12-19T05:37:58.575 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T05:37:58.576 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:37:58.576 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 5h/5d Inode: 720 Links: 1 2023-12-19T05:37:58.576 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:37:58.576 INFO:teuthology.orchestra.run.smithi120.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:37:58.576 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2023-12-19 05:37:07.789810648 +0000 2023-12-19T05:37:58.576 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2023-12-19 05:31:10.814443748 +0000 2023-12-19T05:37:58.576 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2023-12-19 05:31:10.814443748 +0000 2023-12-19T05:37:58.576 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: 2023-12-19 05:31:10.814443748 +0000 2023-12-19T05:37:58.576 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T05:37:58.641 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2023-12-19T05:37:58.641 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2023-12-19T05:37:58.641 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000196847 s, 2.6 MB/s 2023-12-19T05:37:58.642 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T05:37:58.698 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T05:37:58.698 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:37:58.698 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T05:37:58.716 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T05:37:58.716 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2023-12-19T05:37:58.772 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T05:37:58.772 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:37:58.772 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-12-19T05:37:58.772 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:37:58.772 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:37:58.773 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-12-19 05:37:17.575364710 +0000 2023-12-19T05:37:58.773 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-12-19 05:31:08.479518423 +0000 2023-12-19T05:37:58.773 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-12-19 05:31:08.479518423 +0000 2023-12-19T05:37:58.773 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2023-12-19 05:31:08.479518423 +0000 2023-12-19T05:37:58.773 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T05:37:58.840 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-12-19T05:37:58.840 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-12-19T05:37:58.840 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000213331 s, 2.4 MB/s 2023-12-19T05:37:58.842 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T05:37:58.898 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2023-12-19T05:37:58.954 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T05:37:58.954 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:37:58.954 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-12-19T05:37:58.954 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:37:58.954 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:37:58.955 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-12-19 05:37:17.575364710 +0000 2023-12-19T05:37:58.955 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-12-19 05:31:09.015507708 +0000 2023-12-19T05:37:58.955 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-12-19 05:31:09.015507708 +0000 2023-12-19T05:37:58.955 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2023-12-19 05:31:09.015507708 +0000 2023-12-19T05:37:58.955 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T05:37:59.021 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-12-19T05:37:59.021 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-12-19T05:37:59.021 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000232292 s, 2.2 MB/s 2023-12-19T05:37:59.022 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T05:37:59.079 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2023-12-19T05:37:59.134 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T05:37:59.135 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:37:59.135 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 699 Links: 1 2023-12-19T05:37:59.135 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:37:59.135 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:37:59.135 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-12-19 05:37:17.576364691 +0000 2023-12-19T05:37:59.135 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-12-19 05:31:09.545497113 +0000 2023-12-19T05:37:59.135 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-12-19 05:31:09.545497113 +0000 2023-12-19T05:37:59.135 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2023-12-19 05:31:09.545497113 +0000 2023-12-19T05:37:59.136 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T05:37:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-12-19T05:37:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-12-19T05:37:59.201 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000186038 s, 2.8 MB/s 2023-12-19T05:37:59.203 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T05:37:59.258 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2023-12-19T05:37:59.313 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T05:37:59.313 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T05:37:59.313 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 717 Links: 1 2023-12-19T05:37:59.313 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T05:37:59.313 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2023-12-19T05:37:59.313 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2023-12-19 05:37:17.576364691 +0000 2023-12-19T05:37:59.314 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2023-12-19 05:31:10.084486338 +0000 2023-12-19T05:37:59.314 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2023-12-19 05:31:10.084486338 +0000 2023-12-19T05:37:59.314 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2023-12-19 05:31:10.084486338 +0000 2023-12-19T05:37:59.314 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T05:37:59.379 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2023-12-19T05:37:59.379 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2023-12-19T05:37:59.379 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000206818 s, 2.5 MB/s 2023-12-19T05:37:59.380 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T05:37:59.436 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T05:37:59.436 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T05:37:59.436 INFO:tasks.ceph:Generating config... 2023-12-19T05:37:59.437 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-19T05:37:59.438 INFO:tasks.ceph:[client] debug client = 20 2023-12-19T05:37:59.438 INFO:tasks.ceph:[client] debug ms = 1 2023-12-19T05:37:59.438 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-19T05:37:59.438 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-19T05:37:59.438 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-12-19T05:37:59.438 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-19T05:37:59.438 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-19T05:37:59.438 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-19T05:37:59.438 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-19T05:37:59.438 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-19T05:37:59.438 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-19T05:37:59.438 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-19T05:37:59.438 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-19T05:37:59.439 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-19T05:37:59.439 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-19T05:37:59.439 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-19T05:37:59.439 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-19T05:37:59.439 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-19T05:37:59.439 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-19T05:37:59.439 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-19T05:37:59.439 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-19T05:37:59.439 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-19T05:37:59.439 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-19T05:37:59.439 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-19T05:37:59.439 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-19T05:37:59.439 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-19T05:37:59.439 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-19T05:37:59.439 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-19T05:37:59.440 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-19T05:37:59.440 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-19T05:37:59.440 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-19T05:37:59.440 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-19T05:37:59.440 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-19T05:37:59.440 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-19T05:37:59.440 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-19T05:37:59.440 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-19T05:37:59.440 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-19T05:37:59.440 INFO:tasks.ceph:Setting up mon.a... 2023-12-19T05:37:59.440 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-19T05:37:59.512 INFO:teuthology.orchestra.run.smithi120.stdout:creating /etc/ceph/ceph.keyring 2023-12-19T05:37:59.516 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-19T05:37:59.562 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T05:37:59.589 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.120'), ('mon.b', '172.21.15.155'), ('mon.c', '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]')] 2023-12-19T05:37:59.589 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.120,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]', 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-19T05:37:59.590 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:37:59.590 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T05:37:59.644 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.120 --add b 172.21.15.155 --addv c '[v2:172.21.15.155:3301,v1:172.21.15.155:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:37:59.728 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:37:59.728 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: generated fsid 90961127-a1a1-4949-bae3-e6c73f63cc7e 2023-12-19T05:37:59.728 INFO:teuthology.orchestra.run.smithi120.stdout:setting min_mon_release = pacific 2023-12-19T05:37:59.728 INFO:teuthology.orchestra.run.smithi120.stdout:epoch 0 2023-12-19T05:37:59.728 INFO:teuthology.orchestra.run.smithi120.stdout:fsid 90961127-a1a1-4949-bae3-e6c73f63cc7e 2023-12-19T05:37:59.728 INFO:teuthology.orchestra.run.smithi120.stdout:last_changed 2023-12-19T05:37:59.727967+0000 2023-12-19T05:37:59.728 INFO:teuthology.orchestra.run.smithi120.stdout:created 2023-12-19T05:37:59.727967+0000 2023-12-19T05:37:59.728 INFO:teuthology.orchestra.run.smithi120.stdout:min_mon_release 16 (pacific) 2023-12-19T05:37:59.728 INFO:teuthology.orchestra.run.smithi120.stdout:election_strategy: 1 2023-12-19T05:37:59.728 INFO:teuthology.orchestra.run.smithi120.stdout:0: [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] mon.a 2023-12-19T05:37:59.728 INFO:teuthology.orchestra.run.smithi120.stdout:1: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2023-12-19T05:37:59.729 INFO:teuthology.orchestra.run.smithi120.stdout:2: [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] mon.c 2023-12-19T05:37:59.729 INFO:teuthology.orchestra.run.smithi120.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-19T05:37:59.730 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T05:37:59.743 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 90961127-a1a1-4949-bae3-e6c73f63cc7e... 2023-12-19T05:37:59.744 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T05:37:59.786 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T05:37:59.788 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T05:37:59.833 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2023-12-19T05:37:59.833 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2023-12-19T05:37:59.833 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T05:37:59.834 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2023-12-19T05:37:59.834 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.834 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2023-12-19T05:37:59.834 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.834 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2023-12-19T05:37:59.834 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.834 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2023-12-19T05:37:59.834 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2023-12-19T05:37:59.834 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.834 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2023-12-19T05:37:59.834 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2023-12-19T05:37:59.835 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.835 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T05:37:59.835 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2023-12-19T05:37:59.835 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.835 INFO:teuthology.orchestra.run.smithi120.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T05:37:59.835 INFO:teuthology.orchestra.run.smithi120.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T05:37:59.835 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.835 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2023-12-19T05:37:59.835 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.835 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2023-12-19T05:37:59.835 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2023-12-19T05:37:59.835 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2023-12-19T05:37:59.835 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2023-12-19T05:37:59.835 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2023-12-19T05:37:59.836 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2023-12-19T05:37:59.836 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2023-12-19T05:37:59.836 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T05:37:59.836 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T05:37:59.836 INFO:teuthology.orchestra.run.smithi120.stdout: mon_allow_pool_size_one = true 2023-12-19T05:37:59.836 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.836 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T05:37:59.836 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.836 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2023-12-19T05:37:59.836 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.836 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2023-12-19T05:37:59.836 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.837 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2023-12-19T05:37:59.837 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2023-12-19T05:37:59.837 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2023-12-19T05:37:59.838 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = "172.21.15.120,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2023-12-19T05:37:59.838 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn min per osd = 0 2023-12-19T05:37:59.838 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = 90961127-a1a1-4949-bae3-e6c73f63cc7e 2023-12-19T05:37:59.838 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.838 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2023-12-19T05:37:59.838 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2023-12-19T05:37:59.838 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.838 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2023-12-19T05:37:59.838 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2023-12-19T05:37:59.838 INFO:teuthology.orchestra.run.smithi120.stdout: osd mclock profile = high_recovery_ops 2023-12-19T05:37:59.838 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.839 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2023-12-19T05:37:59.839 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2023-12-19T05:37:59.839 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.839 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2023-12-19T05:37:59.839 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2023-12-19T05:37:59.839 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2023-12-19T05:37:59.839 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.839 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2023-12-19T05:37:59.839 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2023-12-19T05:37:59.839 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.839 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2023-12-19T05:37:59.839 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.839 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2023-12-19T05:37:59.840 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.840 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2023-12-19T05:37:59.840 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.840 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2023-12-19T05:37:59.840 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2023-12-19T05:37:59.840 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.840 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2023-12-19T05:37:59.840 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2023-12-19T05:37:59.840 INFO:teuthology.orchestra.run.smithi120.stdout: bdev async discard = True 2023-12-19T05:37:59.840 INFO:teuthology.orchestra.run.smithi120.stdout: bdev enable discard = True 2023-12-19T05:37:59.841 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore allocator = bitmap 2023-12-19T05:37:59.841 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2023-12-19T05:37:59.841 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2023-12-19T05:37:59.841 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 1/20 2023-12-19T05:37:59.841 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 1/20 2023-12-19T05:37:59.841 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2023-12-19T05:37:59.841 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2023-12-19T05:37:59.841 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 4/10 2023-12-19T05:37:59.841 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T05:37:59.841 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2023-12-19T05:37:59.841 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2023-12-19T05:37:59.841 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2023-12-19T05:37:59.842 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2023-12-19T05:37:59.842 INFO:teuthology.orchestra.run.smithi120.stdout: osd op complaint time = 180 2023-12-19T05:37:59.842 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.842 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2023-12-19T05:37:59.842 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2023-12-19T05:37:59.842 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2023-12-19T05:37:59.842 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2023-12-19T05:37:59.842 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2023-12-19T05:37:59.842 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2023-12-19T05:37:59.842 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2023-12-19T05:37:59.842 INFO:teuthology.orchestra.run.smithi120.stdout: mgr/telemetry/nag = false 2023-12-19T05:37:59.842 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.842 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2023-12-19T05:37:59.842 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2023-12-19T05:37:59.843 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2023-12-19T05:37:59.843 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2023-12-19T05:37:59.843 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2023-12-19T05:37:59.843 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2023-12-19T05:37:59.843 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2023-12-19T05:37:59.843 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2023-12-19T05:37:59.843 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2023-12-19T05:37:59.843 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2023-12-19T05:37:59.843 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2023-12-19T05:37:59.843 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.843 INFO:teuthology.orchestra.run.smithi120.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T05:37:59.843 INFO:teuthology.orchestra.run.smithi120.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T05:37:59.843 INFO:teuthology.orchestra.run.smithi120.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout: # 1m isn't quite enough 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout: mon_down_mkfs_grace = 2m 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_filestore_osds = false 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout: mon op complaint time = 120 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = true 2023-12-19T05:37:59.844 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2023-12-19T05:37:59.845 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T05:37:59.845 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T05:37:59.845 INFO:teuthology.orchestra.run.smithi120.stdout: client mount timeout = 600 2023-12-19T05:37:59.845 INFO:teuthology.orchestra.run.smithi120.stdout: debug client = 20 2023-12-19T05:37:59.845 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2023-12-19T05:37:59.845 INFO:teuthology.orchestra.run.smithi120.stdout: rados mon op timeout = 900 2023-12-19T05:37:59.845 INFO:teuthology.orchestra.run.smithi120.stdout: rados osd op timeout = 900 2023-12-19T05:37:59.845 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2023-12-19T05:37:59.845 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.b] 2023-12-19T05:37:59.845 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.c] 2023-12-19T05:37:59.845 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a] 2023-12-19T05:37:59.845 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.c] 2023-12-19T05:37:59.845 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.b] 2023-12-19T05:37:59.845 INFO:teuthology.orchestra.run.smithi120.stdout:[mds] 2023-12-19T05:37:59.846 INFO:teuthology.orchestra.run.smithi120.stdout: debug mds = 20 2023-12-19T05:37:59.846 INFO:teuthology.orchestra.run.smithi120.stdout: debug mds balancer = 20 2023-12-19T05:37:59.846 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2023-12-19T05:37:59.846 INFO:teuthology.orchestra.run.smithi120.stdout: mds debug frag = True 2023-12-19T05:37:59.846 INFO:teuthology.orchestra.run.smithi120.stdout: mds debug scatterstat = True 2023-12-19T05:37:59.846 INFO:teuthology.orchestra.run.smithi120.stdout: mds op complaint time = 180 2023-12-19T05:37:59.846 INFO:teuthology.orchestra.run.smithi120.stdout: mds verify scatter = True 2023-12-19T05:37:59.846 INFO:teuthology.orchestra.run.smithi120.stdout: osd op complaint time = 180 2023-12-19T05:37:59.846 INFO:teuthology.orchestra.run.smithi120.stdout: rados mon op timeout = 900 2023-12-19T05:37:59.847 INFO:teuthology.orchestra.run.smithi120.stdout: rados osd op timeout = 900 2023-12-19T05:37:59.847 INFO:teuthology.orchestra.run.smithi155.stdout:[global] 2023-12-19T05:37:59.847 INFO:teuthology.orchestra.run.smithi155.stdout: chdir = "" 2023-12-19T05:37:59.847 INFO:teuthology.orchestra.run.smithi155.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T05:37:59.847 INFO:teuthology.orchestra.run.smithi155.stdout: auth supported = cephx 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: filestore xattr use omap = true 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: mon clock drift allowed = 1.000 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: osd crush chooseleaf type = 0 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: auth debug = true 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on old message = true 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: ms die on bug = true 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn max object skew = 0 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.848 INFO:teuthology.orchestra.run.smithi155.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T05:37:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T05:37:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default size = 2 2023-12-19T05:37:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow primary affinity = true 2023-12-19T05:37:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd allow pg remap = true 2023-12-19T05:37:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on legacy crush tunables = false 2023-12-19T05:37:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on crush straw calc version zero = false 2023-12-19T05:37:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on no sortbitwise = false 2023-12-19T05:37:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on osd down out interval zero = false 2023-12-19T05:37:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: mon warn on too few osds = false 2023-12-19T05:37:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T05:37:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T05:37:59.849 INFO:teuthology.orchestra.run.smithi155.stdout: mon_allow_pool_size_one = true 2023-12-19T05:37:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T05:37:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: osd default data pool replay window = 5 2023-12-19T05:37:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: mon allow pool delete = true 2023-12-19T05:37:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: mon cluster log file level = debug 2023-12-19T05:37:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: debug asserts on shutdown = true 2023-12-19T05:37:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: mon health detail to clog = false 2023-12-19T05:37:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: mon host = "172.21.15.120,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2023-12-19T05:37:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: mon pg warn min per osd = 0 2023-12-19T05:37:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: fsid = 90961127-a1a1-4949-bae3-e6c73f63cc7e 2023-12-19T05:37:59.850 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout:[osd] 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: osd journal size = 100 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub load threshold = 5.0 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: osd scrub max interval = 600 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: osd mclock profile = high_recovery_ops 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: osd recover clone overlap = true 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: osd recovery max chunk = 1048576 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug shutdown = true 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug op order = true 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug verify stray on activate = true 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.851 INFO:teuthology.orchestra.run.smithi155.stdout: osd open classes on start = true 2023-12-19T05:37:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug pg log writeout = true 2023-12-19T05:37:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: osd deep scrub update digest min age = 30 2023-12-19T05:37:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: osd map max advance = 10 2023-12-19T05:37:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: journal zero on create = true 2023-12-19T05:37:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: filestore ondisk finisher threads = 3 2023-12-19T05:37:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: filestore apply finisher threads = 3 2023-12-19T05:37:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: bdev debug aio = true 2023-12-19T05:37:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: osd debug misdirected ops = true 2023-12-19T05:37:59.852 INFO:teuthology.orchestra.run.smithi155.stdout: bdev async discard = True 2023-12-19T05:37:59.853 INFO:teuthology.orchestra.run.smithi155.stdout: bdev enable discard = True 2023-12-19T05:37:59.853 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore allocator = bitmap 2023-12-19T05:37:59.853 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore block size = 96636764160 2023-12-19T05:37:59.853 INFO:teuthology.orchestra.run.smithi155.stdout: bluestore fsck on mount = True 2023-12-19T05:37:59.853 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluefs = 1/20 2023-12-19T05:37:59.853 INFO:teuthology.orchestra.run.smithi155.stdout: debug bluestore = 1/20 2023-12-19T05:37:59.853 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-12-19T05:37:59.853 INFO:teuthology.orchestra.run.smithi155.stdout: debug osd = 20 2023-12-19T05:37:59.853 INFO:teuthology.orchestra.run.smithi155.stdout: debug rocksdb = 4/10 2023-12-19T05:37:59.853 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T05:37:59.853 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd full ratio = 0.9 2023-12-19T05:37:59.853 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd nearfull ratio = 0.8 2023-12-19T05:37:59.853 INFO:teuthology.orchestra.run.smithi155.stdout: osd failsafe full ratio = 0.95 2023-12-19T05:37:59.853 INFO:teuthology.orchestra.run.smithi155.stdout: osd objectstore = bluestore 2023-12-19T05:37:59.854 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2023-12-19T05:37:59.854 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.854 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr] 2023-12-19T05:37:59.854 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-12-19T05:37:59.854 INFO:teuthology.orchestra.run.smithi155.stdout: debug mgr = 20 2023-12-19T05:37:59.854 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2023-12-19T05:37:59.854 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2023-12-19T05:37:59.854 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2023-12-19T05:37:59.854 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2023-12-19T05:37:59.854 INFO:teuthology.orchestra.run.smithi155.stdout: mgr/telemetry/nag = false 2023-12-19T05:37:59.854 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.854 INFO:teuthology.orchestra.run.smithi155.stdout:[mon] 2023-12-19T05:37:59.854 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-12-19T05:37:59.854 INFO:teuthology.orchestra.run.smithi155.stdout: debug mon = 20 2023-12-19T05:37:59.855 INFO:teuthology.orchestra.run.smithi155.stdout: debug paxos = 20 2023-12-19T05:37:59.855 INFO:teuthology.orchestra.run.smithi155.stdout: debug auth = 20 2023-12-19T05:37:59.857 INFO:teuthology.orchestra.run.smithi155.stdout: mon data avail warn = 5 2023-12-19T05:37:59.857 INFO:teuthology.orchestra.run.smithi155.stdout: mon mgr mkfs grace = 240 2023-12-19T05:37:59.857 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min pgs per osd = 4 2023-12-19T05:37:59.857 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd reporter subtree level = osd 2023-12-19T05:37:59.857 INFO:teuthology.orchestra.run.smithi155.stdout: mon osd prime pg temp = true 2023-12-19T05:37:59.857 INFO:teuthology.orchestra.run.smithi155.stdout: mon reweight min bytes per osd = 10 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: # 1m isn't quite enough 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: mon_down_mkfs_grace = 2m 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: mon_warn_on_filestore_osds = false 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: mon op complaint time = 120 2023-12-19T05:37:59.858 INFO:teuthology.orchestra.run.smithi155.stdout: 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout:[client] 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout: rgw cache enabled = true 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable ops log = true 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout: rgw enable usage log = true 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout: client mount timeout = 600 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout: debug client = 20 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.a] 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.b] 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout:[mon.c] 2023-12-19T05:37:59.859 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2023-12-19T05:37:59.860 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2023-12-19T05:37:59.860 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2023-12-19T05:37:59.860 INFO:teuthology.orchestra.run.smithi155.stdout:[mds] 2023-12-19T05:37:59.860 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds = 20 2023-12-19T05:37:59.860 INFO:teuthology.orchestra.run.smithi155.stdout: debug mds balancer = 20 2023-12-19T05:37:59.860 INFO:teuthology.orchestra.run.smithi155.stdout: debug ms = 1 2023-12-19T05:37:59.860 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug frag = True 2023-12-19T05:37:59.860 INFO:teuthology.orchestra.run.smithi155.stdout: mds debug scatterstat = True 2023-12-19T05:37:59.860 INFO:teuthology.orchestra.run.smithi155.stdout: mds op complaint time = 180 2023-12-19T05:37:59.860 INFO:teuthology.orchestra.run.smithi155.stdout: mds verify scatter = True 2023-12-19T05:37:59.860 INFO:teuthology.orchestra.run.smithi155.stdout: osd op complaint time = 180 2023-12-19T05:37:59.860 INFO:teuthology.orchestra.run.smithi155.stdout: rados mon op timeout = 900 2023-12-19T05:37:59.860 INFO:teuthology.orchestra.run.smithi155.stdout: rados osd op timeout = 900 2023-12-19T05:37:59.965 INFO:teuthology.orchestra.run.smithi188.stdout:[global] 2023-12-19T05:37:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: chdir = "" 2023-12-19T05:37:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T05:37:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: auth supported = cephx 2023-12-19T05:37:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: filestore xattr use omap = true 2023-12-19T05:37:59.965 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: mon clock drift allowed = 1.000 2023-12-19T05:37:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: osd crush chooseleaf type = 0 2023-12-19T05:37:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: auth debug = true 2023-12-19T05:37:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on old message = true 2023-12-19T05:37:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: ms die on bug = true 2023-12-19T05:37:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T05:37:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn max object skew = 0 2023-12-19T05:37:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T05:37:59.966 INFO:teuthology.orchestra.run.smithi188.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default size = 2 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow primary affinity = true 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd allow pg remap = true 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on legacy crush tunables = false 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on crush straw calc version zero = false 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on no sortbitwise = false 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on osd down out interval zero = false 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: mon warn on too few osds = false 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: mon_allow_pool_size_one = true 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.967 INFO:teuthology.orchestra.run.smithi188.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T05:37:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: osd default data pool replay window = 5 2023-12-19T05:37:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: mon allow pool delete = true 2023-12-19T05:37:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: mon cluster log file level = debug 2023-12-19T05:37:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: debug asserts on shutdown = true 2023-12-19T05:37:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: mon health detail to clog = false 2023-12-19T05:37:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: mon host = "172.21.15.120,172.21.15.155,[v2:172.21.15.155:3301,v1:172.21.15.155:6790]" 2023-12-19T05:37:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: mon pg warn min per osd = 0 2023-12-19T05:37:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: fsid = 90961127-a1a1-4949-bae3-e6c73f63cc7e 2023-12-19T05:37:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.968 INFO:teuthology.orchestra.run.smithi188.stdout:[osd] 2023-12-19T05:37:59.968 INFO:teuthology.orchestra.run.smithi188.stdout: osd journal size = 100 2023-12-19T05:37:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub load threshold = 5.0 2023-12-19T05:37:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: osd scrub max interval = 600 2023-12-19T05:37:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: osd mclock profile = high_recovery_ops 2023-12-19T05:37:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: osd recover clone overlap = true 2023-12-19T05:37:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: osd recovery max chunk = 1048576 2023-12-19T05:37:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug shutdown = true 2023-12-19T05:37:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug op order = true 2023-12-19T05:37:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug verify stray on activate = true 2023-12-19T05:37:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.969 INFO:teuthology.orchestra.run.smithi188.stdout: osd open classes on start = true 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug pg log writeout = true 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: osd deep scrub update digest min age = 30 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: osd map max advance = 10 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: journal zero on create = true 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: filestore ondisk finisher threads = 3 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: filestore apply finisher threads = 3 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: bdev debug aio = true 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: osd debug misdirected ops = true 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: bdev async discard = True 2023-12-19T05:37:59.970 INFO:teuthology.orchestra.run.smithi188.stdout: bdev enable discard = True 2023-12-19T05:37:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore allocator = bitmap 2023-12-19T05:37:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore block size = 96636764160 2023-12-19T05:37:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: bluestore fsck on mount = True 2023-12-19T05:37:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluefs = 1/20 2023-12-19T05:37:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: debug bluestore = 1/20 2023-12-19T05:37:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-12-19T05:37:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: debug osd = 20 2023-12-19T05:37:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: debug rocksdb = 4/10 2023-12-19T05:37:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T05:37:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd full ratio = 0.9 2023-12-19T05:37:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd nearfull ratio = 0.8 2023-12-19T05:37:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: osd failsafe full ratio = 0.95 2023-12-19T05:37:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: osd objectstore = bluestore 2023-12-19T05:37:59.971 INFO:teuthology.orchestra.run.smithi188.stdout: osd op complaint time = 180 2023-12-19T05:37:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.972 INFO:teuthology.orchestra.run.smithi188.stdout:[mgr] 2023-12-19T05:37:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-12-19T05:37:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: debug mgr = 20 2023-12-19T05:37:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2023-12-19T05:37:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2023-12-19T05:37:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2023-12-19T05:37:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2023-12-19T05:37:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: mgr/telemetry/nag = false 2023-12-19T05:37:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.972 INFO:teuthology.orchestra.run.smithi188.stdout:[mon] 2023-12-19T05:37:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-12-19T05:37:59.972 INFO:teuthology.orchestra.run.smithi188.stdout: debug mon = 20 2023-12-19T05:37:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: debug paxos = 20 2023-12-19T05:37:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: debug auth = 20 2023-12-19T05:37:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: mon data avail warn = 5 2023-12-19T05:37:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: mon mgr mkfs grace = 240 2023-12-19T05:37:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min pgs per osd = 4 2023-12-19T05:37:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd reporter subtree level = osd 2023-12-19T05:37:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: mon osd prime pg temp = true 2023-12-19T05:37:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: mon reweight min bytes per osd = 10 2023-12-19T05:37:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T05:37:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T05:37:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T05:37:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.973 INFO:teuthology.orchestra.run.smithi188.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: # 1m isn't quite enough 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: mon_down_mkfs_grace = 2m 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: mon_warn_on_filestore_osds = false 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: mon op complaint time = 120 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout:[client] 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: rgw cache enabled = true 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable ops log = true 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: rgw enable usage log = true 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T05:37:59.974 INFO:teuthology.orchestra.run.smithi188.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T05:37:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: client mount timeout = 600 2023-12-19T05:37:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: debug client = 20 2023-12-19T05:37:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-12-19T05:37:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: rados mon op timeout = 900 2023-12-19T05:37:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: rados osd op timeout = 900 2023-12-19T05:37:59.975 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.a] 2023-12-19T05:37:59.975 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.b] 2023-12-19T05:37:59.975 INFO:teuthology.orchestra.run.smithi188.stdout:[mon.c] 2023-12-19T05:37:59.975 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.a] 2023-12-19T05:37:59.975 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.c] 2023-12-19T05:37:59.975 INFO:teuthology.orchestra.run.smithi188.stdout:[mds.b] 2023-12-19T05:37:59.975 INFO:teuthology.orchestra.run.smithi188.stdout:[mds] 2023-12-19T05:37:59.975 INFO:teuthology.orchestra.run.smithi188.stdout: debug mds = 20 2023-12-19T05:37:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: debug mds balancer = 20 2023-12-19T05:37:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: debug ms = 1 2023-12-19T05:37:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: mds debug frag = True 2023-12-19T05:37:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: mds debug scatterstat = True 2023-12-19T05:37:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: mds op complaint time = 180 2023-12-19T05:37:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: mds verify scatter = True 2023-12-19T05:37:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: osd op complaint time = 180 2023-12-19T05:37:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: rados mon op timeout = 900 2023-12-19T05:37:59.976 INFO:teuthology.orchestra.run.smithi188.stdout: rados osd op timeout = 900 2023-12-19T05:38:00.006 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-19T05:38:00.007 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-19T05:38:00.062 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-19T05:38:00.062 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:00.062 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-19T05:38:00.077 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:00.077 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-19T05:38:00.133 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2023-12-19T05:38:00.133 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:00.133 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T05:38:00.133 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T05:38:00.212 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:00.212 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:00.267 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi155.front.sepia.ceph.com 2023-12-19T05:38:00.268 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:38:00.268 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T05:38:00.268 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T05:38:00.309 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:38:00.309 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:00.364 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi188.front.sepia.ceph.com 2023-12-19T05:38:00.364 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:38:00.364 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T05:38:00.364 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T05:38:00.517 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:38:00.517 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:00.618 INFO:tasks.ceph:Setting up mon nodes... 2023-12-19T05:38:00.619 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-19T05:38:00.619 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T05:38:00.673 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T05:38:00.676 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T05:38:00.739 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T05:38:00.742 INFO:tasks.ceph:Setting up mds nodes... 2023-12-19T05:38:00.742 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T05:38:00.796 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T05:38:00.798 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-19T05:38:00.824 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T05:38:00.918 INFO:teuthology.orchestra.run.smithi120.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T05:38:00.921 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-19T05:38:00.947 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T05:38:01.004 INFO:teuthology.orchestra.run.smithi155.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T05:38:01.007 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-19T05:38:01.034 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-19T05:38:01.034 DEBUG:teuthology.orchestra.run.smithi188:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-19T05:38:01.178 INFO:teuthology.orchestra.run.smithi188.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-19T05:38:01.236 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-19T05:38:01.237 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi155.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T05:38:01.237 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-19T05:38:01.264 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:01.265 INFO:tasks.ceph:role: osd.0 2023-12-19T05:38:01.265 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2023-12-19T05:38:01.265 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T05:38:01.338 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:01.339 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:01.339 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:01.339 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:01.339 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:01.339 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:01.841 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2023-12-19T05:38:01.843 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2023-12-19T05:38:01.843 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-19T05:38:01.994 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-19T05:38:02.030 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-19T05:38:02.099 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:02.099 INFO:tasks.ceph:role: osd.1 2023-12-19T05:38:02.099 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com 2023-12-19T05:38:02.099 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T05:38:02.174 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:02.175 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:02.628 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2023-12-19T05:38:02.630 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2023-12-19T05:38:02.630 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-19T05:38:02.734 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-19T05:38:02.767 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-19T05:38:02.836 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:02.837 INFO:tasks.ceph:role: osd.2 2023-12-19T05:38:02.837 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com 2023-12-19T05:38:02.837 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T05:38:02.912 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:02.912 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:02.913 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:02.913 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:02.913 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:02.913 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:02.913 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:03.415 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2023-12-19T05:38:03.417 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2023-12-19T05:38:03.417 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-19T05:38:03.532 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-19T05:38:03.567 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-19T05:38:03.635 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:03.635 INFO:tasks.ceph:role: osd.3 2023-12-19T05:38:03.635 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com 2023-12-19T05:38:03.635 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T05:38:03.711 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:03.711 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:03.712 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:03.712 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:03.712 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:03.712 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:03.712 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:04.230 INFO:teuthology.orchestra.run.smithi120.stdout:Discarding blocks...Done. 2023-12-19T05:38:04.232 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2023-12-19T05:38:04.233 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-19T05:38:04.374 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-19T05:38:04.409 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:04.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:04.507+0000 7f630f618500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-19T05:38:04.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:04.508+0000 7f630f618500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-19T05:38:04.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:04.508+0000 7f630f618500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T05:38:04.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:04.508+0000 7f630f618500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T05:38:04.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:04.508+0000 7f630f618500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T05:38:04.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:04.508+0000 7f630f618500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-19T05:38:07.351 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-19T05:38:07.378 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:07.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:07.463+0000 7f76fb01f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-19T05:38:07.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:07.463+0000 7f76fb01f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-19T05:38:07.465 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:07.463+0000 7f76fb01f500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T05:38:07.465 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:07.463+0000 7f76fb01f500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T05:38:07.465 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:07.463+0000 7f76fb01f500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T05:38:07.465 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:07.464+0000 7f76fb01f500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-19T05:38:10.321 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-19T05:38:10.352 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:10.445 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:10.443+0000 7f29b220d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-19T05:38:10.445 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:10.444+0000 7f29b220d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-19T05:38:10.445 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:10.444+0000 7f29b220d500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T05:38:10.445 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:10.444+0000 7f29b220d500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T05:38:10.445 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:10.444+0000 7f29b220d500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T05:38:10.445 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:10.444+0000 7f29b220d500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-19T05:38:13.305 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-19T05:38:13.336 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:13.425+0000 7f8a05a12500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-19T05:38:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:13.425+0000 7f8a05a12500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-19T05:38:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:13.425+0000 7f8a05a12500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T05:38:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:13.425+0000 7f8a05a12500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T05:38:13.426 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:13.425+0000 7f8a05a12500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T05:38:13.427 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:13.426+0000 7f8a05a12500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-19T05:38:16.271 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-19T05:38:16.301 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-19T05:38:16.333 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:16.333 INFO:tasks.ceph:role: osd.4 2023-12-19T05:38:16.333 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com 2023-12-19T05:38:16.333 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T05:38:16.410 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:16.410 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:16.410 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:16.410 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:16.410 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:16.410 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:16.410 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:16.411 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:16.411 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:16.411 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:16.914 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-12-19T05:38:16.917 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-12-19T05:38:16.917 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-19T05:38:17.037 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-19T05:38:17.072 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-19T05:38:17.142 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:17.142 INFO:tasks.ceph:role: osd.5 2023-12-19T05:38:17.142 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com 2023-12-19T05:38:17.142 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T05:38:17.219 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:17.219 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:17.219 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:17.219 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:17.219 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:17.219 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:17.219 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:17.219 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:17.219 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:17.219 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:17.676 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-12-19T05:38:17.678 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-12-19T05:38:17.678 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-19T05:38:17.771 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-19T05:38:17.802 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-19T05:38:17.870 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:17.870 INFO:tasks.ceph:role: osd.6 2023-12-19T05:38:17.870 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com 2023-12-19T05:38:17.871 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T05:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:17.945 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:18.424 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-12-19T05:38:18.426 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-12-19T05:38:18.426 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-19T05:38:18.580 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-19T05:38:18.613 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-19T05:38:18.680 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T05:38:18.680 INFO:tasks.ceph:role: osd.7 2023-12-19T05:38:18.680 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com 2023-12-19T05:38:18.681 DEBUG:teuthology.orchestra.run.smithi155:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T05:38:18.755 INFO:teuthology.orchestra.run.smithi155.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T05:38:18.755 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T05:38:18.755 INFO:teuthology.orchestra.run.smithi155.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T05:38:18.755 INFO:teuthology.orchestra.run.smithi155.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-19T05:38:18.756 INFO:teuthology.orchestra.run.smithi155.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T05:38:18.756 INFO:teuthology.orchestra.run.smithi155.stdout: = sunit=0 swidth=0 blks 2023-12-19T05:38:18.756 INFO:teuthology.orchestra.run.smithi155.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T05:38:18.756 INFO:teuthology.orchestra.run.smithi155.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-19T05:38:18.756 INFO:teuthology.orchestra.run.smithi155.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T05:38:18.756 INFO:teuthology.orchestra.run.smithi155.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T05:38:19.273 INFO:teuthology.orchestra.run.smithi155.stdout:Discarding blocks...Done. 2023-12-19T05:38:19.275 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi155.front.sepia.ceph.com -o noatime 2023-12-19T05:38:19.275 DEBUG:teuthology.orchestra.run.smithi155:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-19T05:38:19.423 DEBUG:teuthology.orchestra.run.smithi155:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-19T05:38:19.459 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:19.557 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:19.555+0000 7f4dd614a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-19T05:38:19.557 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:19.556+0000 7f4dd614a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-19T05:38:19.557 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:19.556+0000 7f4dd614a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T05:38:19.557 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:19.556+0000 7f4dd614a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T05:38:19.557 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:19.556+0000 7f4dd614a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T05:38:19.557 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:19.556+0000 7f4dd614a500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-19T05:38:22.405 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-19T05:38:22.436 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:22.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:22.524+0000 7f941a0c7500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-19T05:38:22.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:22.524+0000 7f941a0c7500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-19T05:38:22.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:22.524+0000 7f941a0c7500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T05:38:22.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:22.524+0000 7f941a0c7500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T05:38:22.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:22.524+0000 7f941a0c7500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T05:38:22.526 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:22.525+0000 7f941a0c7500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-19T05:38:25.381 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-19T05:38:25.412 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:25.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:25.502+0000 7f80a421c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-19T05:38:25.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:25.502+0000 7f80a421c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-19T05:38:25.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:25.502+0000 7f80a421c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T05:38:25.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:25.502+0000 7f80a421c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T05:38:25.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:25.502+0000 7f80a421c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T05:38:25.504 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:25.503+0000 7f80a421c500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-19T05:38:27.816 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:38:27.819 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:38:27.821 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:38:28.354 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-19T05:38:28.387 DEBUG:teuthology.orchestra.run.smithi155:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:28.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:28.473+0000 7f3e3d814500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-19T05:38:28.475 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:28.473+0000 7f3e3d814500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-19T05:38:28.476 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:28.473+0000 7f3e3d814500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T05:38:28.476 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:28.473+0000 7f3e3d814500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T05:38:28.476 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:28.473+0000 7f3e3d814500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T05:38:28.476 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:28.475+0000 7f3e3d814500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-19T05:38:31.329 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-19T05:38:31.360 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-19T05:38:31.360 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:31.361 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-19T05:38:31.392 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:31.393 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-19T05:38:31.466 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:31.466 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-19T05:38:31.535 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:31.536 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-19T05:38:31.603 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:31.604 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-19T05:38:31.673 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:31.673 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-19T05:38:31.738 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:31.738 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-19T05:38:31.806 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:38:31.806 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-19T05:38:31.838 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:38:31.838 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-19T05:38:31.908 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:38:31.908 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-19T05:38:31.978 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:38:31.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-19T05:38:32.047 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:38:32.047 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-19T05:38:32.116 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:38:32.116 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-19T05:38:32.184 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:38:32.184 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-19T05:38:32.244 INFO:tasks.ceph:Adding keys to all mons... 2023-12-19T05:38:32.244 DEBUG:teuthology.orchestra.run.smithi120:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T05:38:32.246 DEBUG:teuthology.orchestra.run.smithi155:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T05:38:32.270 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.y] 2023-12-19T05:38:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA4LIFlazgpKBAA8D4QdLpAljXKvLtxWjvHuw== 2023-12-19T05:38:32.270 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a] 2023-12-19T05:38:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA4LIFlc8F3LxAAtQc/udoXqk3pq0IcC+cViw== 2023-12-19T05:38:32.270 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.c] 2023-12-19T05:38:32.270 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA4LIFl8srDNhAA9qbedtbnSlolGsOHP9IZcA== 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.0] 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA8LIFl2qJRHhAA7kSkTAfkgJFh0wCPYqbOUg== 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.1] 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA/LIFl+wisGxAA/r+CrA1ZqSU693Ittudckw== 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.2] 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBCLIFl6KF+GhAAgn7/Jvnpi01GWmcvcmaYVg== 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.3] 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBFLIFlXPllGRAAZUVvuKfBbJejH+DN03V6zg== 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr.x] 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA4LIFlTW0ULBAAj0NtwFW1p8x2i5kR9pdpQQ== 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.b] 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA5LIFlHDlFABAAkG2cQbduDA9LoN4Ak0Ou0w== 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.4] 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBLLIFlSHIvIRAAY8OnjXCsajBJqLwG8u/i5Q== 2023-12-19T05:38:32.271 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.5] 2023-12-19T05:38:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBOLIFlZd5THxAApODY/P86otu/kbcggph47g== 2023-12-19T05:38:32.272 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.6] 2023-12-19T05:38:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBRLIFlHUcEHhAAH7YuWdqiU450ZV6KxZe4+w== 2023-12-19T05:38:32.272 INFO:teuthology.orchestra.run.smithi120.stdout:[osd.7] 2023-12-19T05:38:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQBULIFl+itRHBAAr4A0CVd6+WM+XMIAhSlOyw== 2023-12-19T05:38:32.272 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2023-12-19T05:38:32.272 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA5LIFlE8KoChAAqbXrEdjo97xHJmDZNUV5Vw== 2023-12-19T05:38:32.273 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.y] 2023-12-19T05:38:32.273 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA4LIFlazgpKBAA8D4QdLpAljXKvLtxWjvHuw== 2023-12-19T05:38:32.273 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.a] 2023-12-19T05:38:32.273 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA4LIFlc8F3LxAAtQc/udoXqk3pq0IcC+cViw== 2023-12-19T05:38:32.273 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.c] 2023-12-19T05:38:32.273 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA4LIFl8srDNhAA9qbedtbnSlolGsOHP9IZcA== 2023-12-19T05:38:32.273 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.0] 2023-12-19T05:38:32.273 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA8LIFl2qJRHhAA7kSkTAfkgJFh0wCPYqbOUg== 2023-12-19T05:38:32.274 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.1] 2023-12-19T05:38:32.274 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA/LIFl+wisGxAA/r+CrA1ZqSU693Ittudckw== 2023-12-19T05:38:32.274 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.2] 2023-12-19T05:38:32.274 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBCLIFl6KF+GhAAgn7/Jvnpi01GWmcvcmaYVg== 2023-12-19T05:38:32.274 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.3] 2023-12-19T05:38:32.274 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBFLIFlXPllGRAAZUVvuKfBbJejH+DN03V6zg== 2023-12-19T05:38:32.274 INFO:teuthology.orchestra.run.smithi155.stdout:[mgr.x] 2023-12-19T05:38:32.274 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA4LIFlTW0ULBAAj0NtwFW1p8x2i5kR9pdpQQ== 2023-12-19T05:38:32.274 INFO:teuthology.orchestra.run.smithi155.stdout:[mds.b] 2023-12-19T05:38:32.274 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA5LIFlHDlFABAAkG2cQbduDA9LoN4Ak0Ou0w== 2023-12-19T05:38:32.274 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.4] 2023-12-19T05:38:32.274 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBLLIFlSHIvIRAAY8OnjXCsajBJqLwG8u/i5Q== 2023-12-19T05:38:32.274 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.5] 2023-12-19T05:38:32.274 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBOLIFlZd5THxAApODY/P86otu/kbcggph47g== 2023-12-19T05:38:32.275 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.6] 2023-12-19T05:38:32.275 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBRLIFlHUcEHhAAH7YuWdqiU450ZV6KxZe4+w== 2023-12-19T05:38:32.275 INFO:teuthology.orchestra.run.smithi155.stdout:[osd.7] 2023-12-19T05:38:32.275 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQBULIFl+itRHBAAr4A0CVd6+WM+XMIAhSlOyw== 2023-12-19T05:38:32.275 INFO:teuthology.orchestra.run.smithi155.stdout:[client.0] 2023-12-19T05:38:32.275 INFO:teuthology.orchestra.run.smithi155.stdout: key = AQA5LIFlE8KoChAAqbXrEdjo97xHJmDZNUV5Vw== 2023-12-19T05:38:32.276 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T05:38:32.315 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T05:38:32.367 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T05:38:32.370 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T05:38:32.423 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T05:38:32.426 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T05:38:32.479 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.482 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.533 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.535 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.586 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.589 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.642 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.644 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.696 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T05:38:32.699 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T05:38:32.750 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T05:38:32.752 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T05:38:32.807 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.810 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.862 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.864 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.915 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.917 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.969 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:32.971 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T05:38:33.022 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T05:38:33.024 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T05:38:33.079 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-19T05:38:33.079 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-19T05:38:33.105 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T05:38:33.201 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-19T05:38:33.227 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-19T05:38:33.254 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T05:38:33.351 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-19T05:38:33.378 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-19T05:38:33.445 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T05:38:33.542 DEBUG:teuthology.orchestra.run.smithi155:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-19T05:38:33.569 DEBUG:teuthology.orchestra.run.smithi120:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:33.572 DEBUG:teuthology.orchestra.run.smithi155:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T05:38:33.624 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-19T05:38:33.625 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-19T05:38:33.625 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-19T05:38:33.627 INFO:tasks.ceph.mon.a:Started 2023-12-19T05:38:33.627 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-19T05:38:33.627 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-19T05:38:33.667 INFO:tasks.ceph.mon.b:Started 2023-12-19T05:38:33.667 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-19T05:38:33.668 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-19T05:38:33.671 INFO:tasks.ceph.mon.c:Started 2023-12-19T05:38:33.671 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-19T05:38:33.671 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-19T05:38:33.671 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-19T05:38:33.673 INFO:tasks.ceph.mgr.y:Started 2023-12-19T05:38:33.674 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-19T05:38:33.674 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-19T05:38:33.675 INFO:tasks.ceph.mgr.x:Started 2023-12-19T05:38:33.676 INFO:tasks.ceph:Setting crush tunables to default 2023-12-19T05:38:33.676 DEBUG:teuthology.orchestra.run.smithi120:> sudo ceph --cluster ceph osd crush tunables default 2023-12-19T05:38:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.775+0000 7f33ea4c4640 1 Processor -- start 2023-12-19T05:38:33.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.775+0000 7f33ea4c4640 1 -- start start 2023-12-19T05:38:33.779 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33ea4c4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f33e4144d70 0x7f33e40b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:33.779 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33ea4c4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f33e40bc7e0 0x7f33e40bcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:33.779 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33ea4c4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e4145150 con 0x7f33e414df70 2023-12-19T05:38:33.779 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33ea4c4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e40b9f00 con 0x7f33e4144d70 2023-12-19T05:38:33.779 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33ea4c4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e40b84b0 con 0x7f33e40bc7e0 2023-12-19T05:38:33.779 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33e3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f33e4144d70 0x7f33e40b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:33.779 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33e3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f33e4144d70 0x7f33e40b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60826/0 (socket says 172.21.15.120:60826) 2023-12-19T05:38:33.779 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33e3fff640 1 -- 172.21.15.120:0/3179108645 learned_addr learned my addr 172.21.15.120:0/3179108645 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:33.779 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33e3fff640 1 -- 172.21.15.120:0/3179108645 >> v2:172.21.15.120:3300/0 conn(0x7f33e4144d70 msgr2=0x7f33e40b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T05:38:33.780 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33e3fff640 1 -- 172.21.15.120:0/3179108645 >> v2:172.21.15.120:3300/0 conn(0x7f33e4144d70 msgr2=0x7f33e40b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T05:38:33.780 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33e3fff640 1 --2- 172.21.15.120:0/3179108645 >> v2:172.21.15.120:3300/0 conn(0x7f33e4144d70 0x7f33e40b7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T05:38:33.780 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33e3fff640 1 --2- 172.21.15.120:0/3179108645 >> v2:172.21.15.120:3300/0 conn(0x7f33e4144d70 0x7f33e40b7f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T05:38:33.780 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33e8a61640 1 --2- 172.21.15.120:0/3179108645 >> v2:172.21.15.155:3300/0 conn(0x7f33e40bc7e0 0x7f33e40bcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:33.780 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33e8a61640 1 -- 172.21.15.120:0/3179108645 >> v2:172.21.15.155:3300/0 conn(0x7f33e40bc7e0 msgr2=0x7f33e40bcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-19T05:38:33.780 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33e8a61640 1 -- 172.21.15.120:0/3179108645 >> v2:172.21.15.155:3300/0 conn(0x7f33e40bc7e0 msgr2=0x7f33e40bcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T05:38:33.780 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33e8a61640 1 --2- 172.21.15.120:0/3179108645 >> v2:172.21.15.155:3300/0 conn(0x7f33e40bc7e0 0x7f33e40bcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T05:38:33.780 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.776+0000 7f33e8a61640 1 --2- 172.21.15.120:0/3179108645 >> v2:172.21.15.155:3300/0 conn(0x7f33e40bc7e0 0x7f33e40bcc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T05:38:33.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.965+0000 7f33e2ffd640 1 -- 172.21.15.120:0/3179108645 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480329540 0 0) 0x7f33e4145150 con 0x7f33e414df70 2023-12-19T05:38:33.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.965+0000 7f33e2ffd640 1 -- 172.21.15.120:0/3179108645 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33cc003520 con 0x7f33e414df70 2023-12-19T05:38:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e2ffd640 1 -- 172.21.15.120:0/3179108645 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2637650486 0 0) 0x7f33cc003520 con 0x7f33e414df70 2023-12-19T05:38:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e2ffd640 1 -- 172.21.15.120:0/3179108645 >> v2:172.21.15.155:3300/0 conn(0x7f33e40bc7e0 msgr2=0x7f33e40bcc00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T05:38:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e2ffd640 1 --2- 172.21.15.120:0/3179108645 >> v2:172.21.15.155:3300/0 conn(0x7f33e40bc7e0 0x7f33e40bcc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e2ffd640 1 -- 172.21.15.120:0/3179108645 >> v2:172.21.15.120:3300/0 conn(0x7f33e4144d70 msgr2=0x7f33e40b7f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T05:38:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e2ffd640 1 --2- 172.21.15.120:0/3179108645 >> v2:172.21.15.120:3300/0 conn(0x7f33e4144d70 0x7f33e40b7f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e2ffd640 1 -- 172.21.15.120:0/3179108645 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e40b9080 con 0x7f33e414df70 2023-12-19T05:38:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e2ffd640 1 -- 172.21.15.120:0/3179108645 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f33d8001670 con 0x7f33e414df70 2023-12-19T05:38:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e2ffd640 1 -- 172.21.15.120:0/3179108645 >> v1:172.21.15.155:6789/0 conn(0x7f33e414df70 legacy=0x7f33e40b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e2ffd640 1 --2- 172.21.15.120:0/3179108645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33cc0039f0 0x7f33cc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:33.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e2ffd640 1 --2- 172.21.15.120:0/3179108645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc0047c0 0x7f33cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e2ffd640 1 --2- 172.21.15.120:0/3179108645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc005180 0x7f33cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e2ffd640 1 -- 172.21.15.120:0/3179108645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40b9f00 con 0x7f33cc0039f0 2023-12-19T05:38:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e2ffd640 1 -- 172.21.15.120:0/3179108645 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40b84b0 con 0x7f33cc005180 2023-12-19T05:38:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e2ffd640 1 -- 172.21.15.120:0/3179108645 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc00c0e0 con 0x7f33cc0047c0 2023-12-19T05:38:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.971+0000 7f33e3fff640 1 --2- 172.21.15.120:0/3179108645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33cc0039f0 0x7f33cc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.972+0000 7f33e8a61640 1 --2- 172.21.15.120:0/3179108645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc005180 0x7f33cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.972+0000 7f33e37fe640 1 --2- 172.21.15.120:0/3179108645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc0047c0 0x7f33cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.972+0000 7f33e3fff640 1 -- 172.21.15.120:0/3179108645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc0047c0 msgr2=0x7f33cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.972+0000 7f33e3fff640 1 --2- 172.21.15.120:0/3179108645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33cc0047c0 0x7f33cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.972+0000 7f33e3fff640 1 -- 172.21.15.120:0/3179108645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc005180 msgr2=0x7f33cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.972+0000 7f33e3fff640 1 --2- 172.21.15.120:0/3179108645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc005180 0x7f33cc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.972+0000 7f33e3fff640 1 -- 172.21.15.120:0/3179108645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc003520 con 0x7f33cc0039f0 2023-12-19T05:38:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.972+0000 7f33e8a61640 1 -- 172.21.15.120:0/3179108645 reap_dead start 2023-12-19T05:38:33.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.972+0000 7f33e3fff640 1 --2- 172.21.15.120:0/3179108645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33cc0039f0 0x7f33cc003e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f33d4009890 tx=0x7f33cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dab388df170cc32 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:33.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.973+0000 7f33e2ffd640 1 -- 172.21.15.120:0/3179108645 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4030660 con 0x7f33cc0039f0 2023-12-19T05:38:33.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.973+0000 7f33e2ffd640 1 -- 172.21.15.120:0/3179108645 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d40307c0 con 0x7f33cc0039f0 2023-12-19T05:38:33.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.973+0000 7f33e2ffd640 1 -- 172.21.15.120:0/3179108645 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4030b70 con 0x7f33cc0039f0 2023-12-19T05:38:33.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.973+0000 7f33ea4c4640 1 -- 172.21.15.120:0/3179108645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33cc0039f0 msgr2=0x7f33cc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:33.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.973+0000 7f33ea4c4640 1 --2- 172.21.15.120:0/3179108645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33cc0039f0 0x7f33cc003e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f33d4009890 tx=0x7f33cc0057f0 comp rx=0 tx=0).stop 2023-12-19T05:38:33.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.973+0000 7f33ea4c4640 1 -- 172.21.15.120:0/3179108645 shutdown_connections 2023-12-19T05:38:33.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.973+0000 7f33ea4c4640 1 --2- 172.21.15.120:0/3179108645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33cc0039f0 0x7f33cc003e10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:33.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.973+0000 7f33ea4c4640 1 -- 172.21.15.120:0/3179108645 >> 172.21.15.120:0/3179108645 conn(0x7f33e4071430 msgr2=0x7f33e4071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:33.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.973+0000 7f33ea4c4640 1 -- 172.21.15.120:0/3179108645 shutdown_connections 2023-12-19T05:38:33.981 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.973+0000 7f33ea4c4640 1 -- 172.21.15.120:0/3179108645 wait complete. 2023-12-19T05:38:33.981 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.974+0000 7f33ea4c4640 1 Processor -- start 2023-12-19T05:38:33.981 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.975+0000 7f33ea4c4640 1 -- start start 2023-12-19T05:38:33.981 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.975+0000 7f33ea4c4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc0039f0 0x7f33e4148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:33.981 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.975+0000 7f33ea4c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33e41481f0 0x7f33e414b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:33.981 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.975+0000 7f33ea4c4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33e40aebe0 0x7f33e40af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:33.981 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.975+0000 7f33ea4c4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e414bba0 con 0x7f33e41481f0 2023-12-19T05:38:33.981 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.975+0000 7f33ea4c4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40af5d0 con 0x7f33cc0039f0 2023-12-19T05:38:33.981 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.975+0000 7f33ea4c4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e414afa0 con 0x7f33e40aebe0 2023-12-19T05:38:33.981 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.975+0000 7f33e37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33e41481f0 0x7f33e414b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:33.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.975+0000 7f33e37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33e41481f0 0x7f33e414b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60890/0 (socket says 172.21.15.120:60890) 2023-12-19T05:38:33.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.975+0000 7f33e3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc0039f0 0x7f33e4148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:33.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.975+0000 7f33e37fe640 1 -- 172.21.15.120:0/1426274203 learned_addr learned my addr 172.21.15.120:0/1426274203 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:33.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.975+0000 7f33e8a61640 1 --2- 172.21.15.120:0/1426274203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33e40aebe0 0x7f33e40af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:33.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.976+0000 7f33e37fe640 1 -- 172.21.15.120:0/1426274203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33e40aebe0 msgr2=0x7f33e40af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:33.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.976+0000 7f33e37fe640 1 --2- 172.21.15.120:0/1426274203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33e40aebe0 0x7f33e40af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:33.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.976+0000 7f33e37fe640 1 -- 172.21.15.120:0/1426274203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc0039f0 msgr2=0x7f33e4148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:33.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.976+0000 7f33e37fe640 1 --2- 172.21.15.120:0/1426274203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc0039f0 0x7f33e4148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:33.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.976+0000 7f33e37fe640 1 -- 172.21.15.120:0/1426274203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e414a6e0 con 0x7f33e41481f0 2023-12-19T05:38:33.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.976+0000 7f33e3fff640 1 --2- 172.21.15.120:0/1426274203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc0039f0 0x7f33e4148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:33.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.976+0000 7f33e37fe640 1 --2- 172.21.15.120:0/1426274203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33e41481f0 0x7f33e414b660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f33d800e760 tx=0x7f33d800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:33.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.976+0000 7f33e0ff9640 1 -- 172.21.15.120:0/1426274203 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d800ee10 con 0x7f33e41481f0 2023-12-19T05:38:33.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.976+0000 7f33e0ff9640 1 -- 172.21.15.120:0/1426274203 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d80052e0 con 0x7f33e41481f0 2023-12-19T05:38:33.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.976+0000 7f33ea4c4640 1 -- 172.21.15.120:0/1426274203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e414a950 con 0x7f33e41481f0 2023-12-19T05:38:33.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.976+0000 7f33e0ff9640 1 -- 172.21.15.120:0/1426274203 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d800c660 con 0x7f33e41481f0 2023-12-19T05:38:33.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.976+0000 7f33ea4c4640 1 -- 172.21.15.120:0/1426274203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e40c0f90 con 0x7f33e41481f0 2023-12-19T05:38:33.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.976+0000 7f33e0ff9640 1 -- 172.21.15.120:0/1426274203 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f33d800cac0 con 0x7f33e41481f0 2023-12-19T05:38:33.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.976+0000 7f33e0ff9640 1 -- 172.21.15.120:0/1426274203 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f33d8003e00 con 0x7f33e41481f0 2023-12-19T05:38:33.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.977+0000 7f33ea4c4640 1 -- 172.21.15.120:0/1426274203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e40c1150 con 0x7f33e41481f0 2023-12-19T05:38:33.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:33.979+0000 7f33e0ff9640 1 -- 172.21.15.120:0/1426274203 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f33d80035f0 con 0x7f33e41481f0 2023-12-19T05:38:34.047 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:34.045+0000 7f33ea4c4640 1 -- 172.21.15.120:0/1426274203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f33e41dfa20 con 0x7f33e41481f0 2023-12-19T05:38:34.049 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:34.047+0000 7f33e0ff9640 1 -- 172.21.15.120:0/1426274203 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f33e41dfa20 con 0x7f33e41481f0 2023-12-19T05:38:34.049 INFO:teuthology.orchestra.run.smithi120.stderr:adjusted tunables profile to default 2023-12-19T05:38:34.050 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:34.048+0000 7f33ea4c4640 1 -- 172.21.15.120:0/1426274203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33e41481f0 msgr2=0x7f33e414b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:34.050 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:34.048+0000 7f33ea4c4640 1 --2- 172.21.15.120:0/1426274203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33e41481f0 0x7f33e414b660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f33d800e760 tx=0x7f33d800ec20 comp rx=0 tx=0).stop 2023-12-19T05:38:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:34.048+0000 7f33ea4c4640 1 -- 172.21.15.120:0/1426274203 shutdown_connections 2023-12-19T05:38:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:34.048+0000 7f33ea4c4640 1 --2- 172.21.15.120:0/1426274203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f33e40aebe0 0x7f33e40af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:34.048+0000 7f33ea4c4640 1 --2- 172.21.15.120:0/1426274203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f33e41481f0 0x7f33e414b660 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:34.048+0000 7f33ea4c4640 1 --2- 172.21.15.120:0/1426274203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f33cc0039f0 0x7f33e4148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:34.048+0000 7f33ea4c4640 1 -- 172.21.15.120:0/1426274203 >> 172.21.15.120:0/1426274203 conn(0x7f33e4071430 msgr2=0x7f33e40b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:34.048+0000 7f33ea4c4640 1 -- 172.21.15.120:0/1426274203 shutdown_connections 2023-12-19T05:38:34.051 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:34.048+0000 7f33ea4c4640 1 -- 172.21.15.120:0/1426274203 wait complete. 2023-12-19T05:38:34.061 INFO:tasks.ceph:check_enable_crimson: False 2023-12-19T05:38:34.061 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-19T05:38:34.061 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:34.061 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-19T05:38:34.087 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:34.087 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-19T05:38:34.154 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:34.154 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-19T05:38:34.221 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2023-12-19T05:38:34.221 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-19T05:38:34.289 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:38:34.289 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-19T05:38:34.318 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:38:34.318 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-19T05:38:34.385 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:38:34.385 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-19T05:38:34.393 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:34.392+0000 7f0898443040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T05:38:34.444 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:34.443+0000 7f0898443040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T05:38:34.450 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:34.449+0000 7f328c856040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T05:38:34.452 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2023-12-19T05:38:34.452 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-19T05:38:34.504 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:34.503+0000 7f328c856040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T05:38:34.519 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 79d4cc7c-7096-44fc-a6c2-7fc9234f8f67 0 2023-12-19T05:38:34.659 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.658+0000 7f1f11eb6640 1 Processor -- start 2023-12-19T05:38:34.660 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.658+0000 7f1f11eb6640 1 -- start start 2023-12-19T05:38:34.663 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.659+0000 7f1f11eb6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1f0c142b10 0x7f1f0c06ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:34.663 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.659+0000 7f1f11eb6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c071cf0 0x7f1f0c1487b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:34.663 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.659+0000 7f1f11eb6640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f0c0b5be0 con 0x7f1f0c0b4240 2023-12-19T05:38:34.663 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.659+0000 7f1f11eb6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f0c142ef0 con 0x7f1f0c142b10 2023-12-19T05:38:34.663 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.659+0000 7f1f11eb6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c0b5550 con 0x7f1f0c071cf0 2023-12-19T05:38:34.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.659+0000 7f1f02ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c071cf0 0x7f1f0c1487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:34.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.659+0000 7f1f02ffd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c071cf0 0x7f1f0c1487b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:49924/0 (socket says 172.21.15.155:49924) 2023-12-19T05:38:34.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.659+0000 7f1f02ffd640 1 -- 172.21.15.155:0/1228631230 learned_addr learned my addr 172.21.15.155:0/1228631230 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:34.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.659+0000 7f1f0b7fe640 1 --2- 172.21.15.155:0/1228631230 >> v2:172.21.15.120:3300/0 conn(0x7f1f0c142b10 0x7f1f0c06ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:34.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.659+0000 7f1f02ffd640 1 -- 172.21.15.155:0/1228631230 >> v2:172.21.15.120:3300/0 conn(0x7f1f0c142b10 msgr2=0x7f1f0c06ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:34.664 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.659+0000 7f1f02ffd640 1 --2- 172.21.15.155:0/1228631230 >> v2:172.21.15.120:3300/0 conn(0x7f1f0c142b10 0x7f1f0c06ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.659+0000 7f1f02ffd640 1 -- 172.21.15.155:0/1228631230 >> v1:172.21.15.120:6789/0 conn(0x7f1f0c0b4240 legacy=0x7f1f0c14bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:34.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.659+0000 7f1f02ffd640 1 -- 172.21.15.155:0/1228631230 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c0b57c0 con 0x7f1f0c071cf0 2023-12-19T05:38:34.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.660+0000 7f1f02ffd640 1 --2- 172.21.15.155:0/1228631230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c071cf0 0x7f1f0c1487b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009870 tx=0x7f1ef402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f21fcf15c42de8db server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:34.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.660+0000 7f1f0affd640 1 -- 172.21.15.155:0/1228631230 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4030840 con 0x7f1f0c071cf0 2023-12-19T05:38:34.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.660+0000 7f1f0affd640 1 -- 172.21.15.155:0/1228631230 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef40309a0 con 0x7f1f0c071cf0 2023-12-19T05:38:34.665 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.660+0000 7f1f0affd640 1 -- 172.21.15.155:0/1228631230 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4030d30 con 0x7f1f0c071cf0 2023-12-19T05:38:34.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.661+0000 7f1f11eb6640 1 -- 172.21.15.155:0/1228631230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c071cf0 msgr2=0x7f1f0c1487b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:34.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.661+0000 7f1f11eb6640 1 --2- 172.21.15.155:0/1228631230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c071cf0 0x7f1f0c1487b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009870 tx=0x7f1ef402b980 comp rx=0 tx=0).stop 2023-12-19T05:38:34.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.661+0000 7f1f11eb6640 1 -- 172.21.15.155:0/1228631230 shutdown_connections 2023-12-19T05:38:34.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.661+0000 7f1f11eb6640 1 --2- 172.21.15.155:0/1228631230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c071cf0 0x7f1f0c1487b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.661+0000 7f1f11eb6640 1 --2- 172.21.15.155:0/1228631230 >> v2:172.21.15.120:3300/0 conn(0x7f1f0c142b10 0x7f1f0c06ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.661+0000 7f1f11eb6640 1 -- 172.21.15.155:0/1228631230 >> 172.21.15.155:0/1228631230 conn(0x7f1f0c0b91e0 msgr2=0x7f1f0c0b95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:34.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.661+0000 7f1f11eb6640 1 -- 172.21.15.155:0/1228631230 shutdown_connections 2023-12-19T05:38:34.666 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.661+0000 7f1f11eb6640 1 -- 172.21.15.155:0/1228631230 wait complete. 2023-12-19T05:38:34.667 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.662+0000 7f1f11eb6640 1 Processor -- start 2023-12-19T05:38:34.667 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.662+0000 7f1f11eb6640 1 -- start start 2023-12-19T05:38:34.671 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f11eb6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c0b4240 0x7f1f0c14bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:34.671 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f11eb6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c142b10 0x7f1f0c14a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:34.671 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f11eb6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f0c143820 0x7f1f0c14ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:34.671 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f11eb6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c14c070 con 0x7f1f0c143820 2023-12-19T05:38:34.671 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f11eb6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c13dc70 con 0x7f1f0c142b10 2023-12-19T05:38:34.671 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f11eb6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c14c250 con 0x7f1f0c0b4240 2023-12-19T05:38:34.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f0b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c0b4240 0x7f1f0c14bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:34.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f0b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c0b4240 0x7f1f0c14bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:49938/0 (socket says 172.21.15.155:49938) 2023-12-19T05:38:34.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f0b7fe640 1 -- 172.21.15.155:0/1884938987 learned_addr learned my addr 172.21.15.155:0/1884938987 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:34.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f02ffd640 1 --2- 172.21.15.155:0/1884938987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c142b10 0x7f1f0c14a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:34.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f0bfff640 1 --2- 172.21.15.155:0/1884938987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f0c143820 0x7f1f0c14ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:34.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f0b7fe640 1 -- 172.21.15.155:0/1884938987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c142b10 msgr2=0x7f1f0c14a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:34.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f0b7fe640 1 --2- 172.21.15.155:0/1884938987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c142b10 0x7f1f0c14a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f0b7fe640 1 -- 172.21.15.155:0/1884938987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f0c143820 msgr2=0x7f1f0c14ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:34.672 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f0b7fe640 1 --2- 172.21.15.155:0/1884938987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f0c143820 0x7f1f0c14ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f0b7fe640 1 -- 172.21.15.155:0/1884938987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef40094d0 con 0x7f1f0c0b4240 2023-12-19T05:38:34.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f0bfff640 1 --2- 172.21.15.155:0/1884938987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f0c143820 0x7f1f0c14ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:38:34.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f0b7fe640 1 --2- 172.21.15.155:0/1884938987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c0b4240 0x7f1f0c14bb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00e8a0 tx=0x7f1efc00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:34.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f08ff9640 1 -- 172.21.15.155:0/1884938987 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc0095c0 con 0x7f1f0c0b4240 2023-12-19T05:38:34.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f08ff9640 1 -- 172.21.15.155:0/1884938987 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1efc00c940 con 0x7f1f0c0b4240 2023-12-19T05:38:34.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f11eb6640 1 -- 172.21.15.155:0/1884938987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f0c14c530 con 0x7f1f0c0b4240 2023-12-19T05:38:34.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.663+0000 7f1f08ff9640 1 -- 172.21.15.155:0/1884938987 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00ccb0 con 0x7f1f0c0b4240 2023-12-19T05:38:34.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.664+0000 7f1f11eb6640 1 -- 172.21.15.155:0/1884938987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0c0b35c0 con 0x7f1f0c0b4240 2023-12-19T05:38:34.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.664+0000 7f1f08ff9640 1 -- 172.21.15.155:0/1884938987 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1efc013770 con 0x7f1f0c0b4240 2023-12-19T05:38:34.673 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.664+0000 7f1f08ff9640 1 -- 172.21.15.155:0/1884938987 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1efc01cb90 con 0x7f1f0c0b4240 2023-12-19T05:38:34.674 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.665+0000 7f1f11eb6640 1 -- 172.21.15.155:0/1884938987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f0c14a690 con 0x7f1f0c0b4240 2023-12-19T05:38:34.674 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.667+0000 7f1f08ff9640 1 -- 172.21.15.155:0/1884938987 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f1efc021060 con 0x7f1f0c0b4240 2023-12-19T05:38:34.739 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.738+0000 7f1f11eb6640 1 -- 172.21.15.155:0/1884938987 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "79d4cc7c-7096-44fc-a6c2-7fc9234f8f67", "id": 0} v 0) v1 -- 0x7f1f0c04e080 con 0x7f1f0c0b4240 2023-12-19T05:38:34.742 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.741+0000 7f1f08ff9640 1 -- 172.21.15.155:0/1884938987 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "79d4cc7c-7096-44fc-a6c2-7fc9234f8f67", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1efc017070 con 0x7f1f0c0b4240 2023-12-19T05:38:34.742 INFO:teuthology.orchestra.run.smithi155.stdout:0 2023-12-19T05:38:34.743 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.742+0000 7f1f11eb6640 1 -- 172.21.15.155:0/1884938987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c0b4240 msgr2=0x7f1f0c14bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:34.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.742+0000 7f1f11eb6640 1 --2- 172.21.15.155:0/1884938987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c0b4240 0x7f1f0c14bb30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00e8a0 tx=0x7f1efc00ed60 comp rx=0 tx=0).stop 2023-12-19T05:38:34.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.742+0000 7f1f11eb6640 1 -- 172.21.15.155:0/1884938987 shutdown_connections 2023-12-19T05:38:34.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.742+0000 7f1f11eb6640 1 --2- 172.21.15.155:0/1884938987 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1f0c143820 0x7f1f0c14ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.742+0000 7f1f11eb6640 1 --2- 172.21.15.155:0/1884938987 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c142b10 0x7f1f0c14a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.742+0000 7f1f11eb6640 1 --2- 172.21.15.155:0/1884938987 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1f0c0b4240 0x7f1f0c14bb30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.742+0000 7f1f11eb6640 1 -- 172.21.15.155:0/1884938987 >> 172.21.15.155:0/1884938987 conn(0x7f1f0c0b91e0 msgr2=0x7f1f0c146280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:34.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.742+0000 7f1f11eb6640 1 -- 172.21.15.155:0/1884938987 shutdown_connections 2023-12-19T05:38:34.744 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.742+0000 7f1f11eb6640 1 -- 172.21.15.155:0/1884938987 wait complete. 2023-12-19T05:38:34.754 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new a67bad17-42c7-4fb9-aa1b-27baf6360317 1 2023-12-19T05:38:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.852+0000 7fae32bae640 1 Processor -- start 2023-12-19T05:38:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.852+0000 7fae32bae640 1 -- start start 2023-12-19T05:38:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.853+0000 7fae32bae640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fae2c0b68f0 0x7fae2c0b9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.853+0000 7fae32bae640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae2c142590 0x7fae2c142a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.853+0000 7fae32bae640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae2c142f40 con 0x7fae2c06fe70 2023-12-19T05:38:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.853+0000 7fae32bae640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae2c070400 con 0x7fae2c0b68f0 2023-12-19T05:38:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.853+0000 7fae32bae640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c071210 con 0x7fae2c142590 2023-12-19T05:38:34.857 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.853+0000 7fae3114b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae2c142590 0x7fae2c142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.853+0000 7fae3114b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae2c142590 0x7fae2c142a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:49952/0 (socket says 172.21.15.155:49952) 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.853+0000 7fae3114b640 1 -- 172.21.15.155:0/3881277480 learned_addr learned my addr 172.21.15.155:0/3881277480 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.853+0000 7fae3094a640 1 --2- 172.21.15.155:0/3881277480 >> v2:172.21.15.120:3300/0 conn(0x7fae2c0b68f0 0x7fae2c0b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.853+0000 7fae3114b640 1 -- 172.21.15.155:0/3881277480 >> v2:172.21.15.120:3300/0 conn(0x7fae2c0b68f0 msgr2=0x7fae2c0b9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.853+0000 7fae3114b640 1 --2- 172.21.15.155:0/3881277480 >> v2:172.21.15.120:3300/0 conn(0x7fae2c0b68f0 0x7fae2c0b9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.853+0000 7fae3114b640 1 -- 172.21.15.155:0/3881277480 >> v1:172.21.15.120:6789/0 conn(0x7fae2c06fe70 legacy=0x7fae2c06ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.853+0000 7fae3114b640 1 -- 172.21.15.155:0/3881277480 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c0714f0 con 0x7fae2c142590 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.854+0000 7fae3114b640 1 --2- 172.21.15.155:0/3881277480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae2c142590 0x7fae2c142a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae24009e50 tx=0x7fae2402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d0f46bdb79f12fa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.854+0000 7fae2b7fe640 1 -- 172.21.15.155:0/3881277480 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2402cb00 con 0x7fae2c142590 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.854+0000 7fae2b7fe640 1 -- 172.21.15.155:0/3881277480 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2402cc60 con 0x7fae2c142590 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.854+0000 7fae2b7fe640 1 -- 172.21.15.155:0/3881277480 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae240343f0 con 0x7fae2c142590 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.855+0000 7fae32bae640 1 -- 172.21.15.155:0/3881277480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae2c142590 msgr2=0x7fae2c142a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.855+0000 7fae32bae640 1 --2- 172.21.15.155:0/3881277480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae2c142590 0x7fae2c142a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fae24009e50 tx=0x7fae2402bf60 comp rx=0 tx=0).stop 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.855+0000 7fae32bae640 1 -- 172.21.15.155:0/3881277480 shutdown_connections 2023-12-19T05:38:34.858 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.855+0000 7fae32bae640 1 --2- 172.21.15.155:0/3881277480 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae2c142590 0x7fae2c142a00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.859 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.855+0000 7fae32bae640 1 --2- 172.21.15.155:0/3881277480 >> v2:172.21.15.120:3300/0 conn(0x7fae2c0b68f0 0x7fae2c0b9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.859 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.855+0000 7fae32bae640 1 -- 172.21.15.155:0/3881277480 >> 172.21.15.155:0/3881277480 conn(0x7fae2c0bd070 msgr2=0x7fae2c0bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:34.859 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.855+0000 7fae32bae640 1 -- 172.21.15.155:0/3881277480 shutdown_connections 2023-12-19T05:38:34.859 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.855+0000 7fae32bae640 1 -- 172.21.15.155:0/3881277480 wait complete. 2023-12-19T05:38:34.859 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.856+0000 7fae32bae640 1 Processor -- start 2023-12-19T05:38:34.859 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.856+0000 7fae32bae640 1 -- start start 2023-12-19T05:38:34.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae32bae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae2c06fe70 0x7fae2c1cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:34.862 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae32bae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae2c0b68f0 0x7fae2c148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:34.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae32bae640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae2c142590 0x7fae2c1e1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:34.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae32bae640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c148f90 con 0x7fae2c0b68f0 2023-12-19T05:38:34.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae32bae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c1cf240 con 0x7fae2c06fe70 2023-12-19T05:38:34.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae32bae640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae2c1ced00 con 0x7fae2c142590 2023-12-19T05:38:34.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae3094a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae2c06fe70 0x7fae2c1cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:34.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae3114b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae2c142590 0x7fae2c1e1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:34.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae3094a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae2c06fe70 0x7fae2c1cfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56682/0 (socket says 172.21.15.155:56682) 2023-12-19T05:38:34.863 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae3094a640 1 -- 172.21.15.155:0/3842334142 learned_addr learned my addr 172.21.15.155:0/3842334142 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:34.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae3114b640 1 --2- 172.21.15.155:0/3842334142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae2c142590 0x7fae2c1e1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:49954/0 (socket says 172.21.15.155:49954) 2023-12-19T05:38:34.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae2bfff640 1 --2- 172.21.15.155:0/3842334142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae2c0b68f0 0x7fae2c148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:34.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae3094a640 1 -- 172.21.15.155:0/3842334142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae2c142590 msgr2=0x7fae2c1e1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:34.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae3094a640 1 --2- 172.21.15.155:0/3842334142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae2c142590 0x7fae2c1e1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae3094a640 1 -- 172.21.15.155:0/3842334142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae2c0b68f0 msgr2=0x7fae2c148a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:34.864 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae3094a640 1 --2- 172.21.15.155:0/3842334142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae2c0b68f0 0x7fae2c148a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae3094a640 1 -- 172.21.15.155:0/3842334142 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae24009b30 con 0x7fae2c06fe70 2023-12-19T05:38:34.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae3094a640 1 --2- 172.21.15.155:0/3842334142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae2c06fe70 0x7fae2c1cfca0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fae2000e9b0 tx=0x7fae2000ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:34.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae297fa640 1 -- 172.21.15.155:0/3842334142 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20009670 con 0x7fae2c06fe70 2023-12-19T05:38:34.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae297fa640 1 -- 172.21.15.155:0/3842334142 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2000c9a0 con 0x7fae2c06fe70 2023-12-19T05:38:34.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae297fa640 1 -- 172.21.15.155:0/3842334142 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2000cd50 con 0x7fae2c06fe70 2023-12-19T05:38:34.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.857+0000 7fae32bae640 1 -- 172.21.15.155:0/3842334142 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c1cef60 con 0x7fae2c06fe70 2023-12-19T05:38:34.865 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.858+0000 7fae32bae640 1 -- 172.21.15.155:0/3842334142 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c1e1370 con 0x7fae2c06fe70 2023-12-19T05:38:34.866 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.858+0000 7fae297fa640 1 -- 172.21.15.155:0/3842334142 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fae20005c90 con 0x7fae2c06fe70 2023-12-19T05:38:34.866 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.858+0000 7fae297fa640 1 -- 172.21.15.155:0/3842334142 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fae20013820 con 0x7fae2c06fe70 2023-12-19T05:38:34.866 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.858+0000 7fae32bae640 1 -- 172.21.15.155:0/3842334142 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2c04e080 con 0x7fae2c06fe70 2023-12-19T05:38:34.866 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.861+0000 7fae297fa640 1 -- 172.21.15.155:0/3842334142 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fae20021060 con 0x7fae2c06fe70 2023-12-19T05:38:34.933 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.932+0000 7fae32bae640 1 -- 172.21.15.155:0/3842334142 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a67bad17-42c7-4fb9-aa1b-27baf6360317", "id": 1} v 0) v1 -- 0x7fae2c0bbf50 con 0x7fae2c06fe70 2023-12-19T05:38:34.939 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.938+0000 7fae297fa640 1 -- 172.21.15.155:0/3842334142 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a67bad17-42c7-4fb9-aa1b-27baf6360317", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fae20017070 con 0x7fae2c06fe70 2023-12-19T05:38:34.939 INFO:teuthology.orchestra.run.smithi155.stdout:1 2023-12-19T05:38:34.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.939+0000 7fae32bae640 1 -- 172.21.15.155:0/3842334142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae2c06fe70 msgr2=0x7fae2c1cfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:34.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.939+0000 7fae32bae640 1 --2- 172.21.15.155:0/3842334142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae2c06fe70 0x7fae2c1cfca0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fae2000e9b0 tx=0x7fae2000ee70 comp rx=0 tx=0).stop 2023-12-19T05:38:34.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.939+0000 7fae32bae640 1 -- 172.21.15.155:0/3842334142 shutdown_connections 2023-12-19T05:38:34.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.939+0000 7fae32bae640 1 --2- 172.21.15.155:0/3842334142 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fae2c142590 0x7fae2c1e1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.939+0000 7fae32bae640 1 --2- 172.21.15.155:0/3842334142 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fae2c0b68f0 0x7fae2c148a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.940 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.939+0000 7fae32bae640 1 --2- 172.21.15.155:0/3842334142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fae2c06fe70 0x7fae2c1cfca0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:34.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.939+0000 7fae32bae640 1 -- 172.21.15.155:0/3842334142 >> 172.21.15.155:0/3842334142 conn(0x7fae2c0bd070 msgr2=0x7fae2c0bb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:34.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.939+0000 7fae32bae640 1 -- 172.21.15.155:0/3842334142 shutdown_connections 2023-12-19T05:38:34.941 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:34.939+0000 7fae32bae640 1 -- 172.21.15.155:0/3842334142 wait complete. 2023-12-19T05:38:34.950 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 8b220892-ce97-4c80-98fd-b72839b10837 2 2023-12-19T05:38:34.971 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:34.970+0000 7f0898443040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T05:38:35.022 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:35.021+0000 7f0898443040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T05:38:35.050 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:35.049+0000 7f328c856040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T05:38:35.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.050+0000 7fc932b77640 1 Processor -- start 2023-12-19T05:38:35.051 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.050+0000 7fc932b77640 1 -- start start 2023-12-19T05:38:35.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.051+0000 7fc932b77640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc92c069d00 0x7fc92c14aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.052 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.051+0000 7fc932b77640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c06ba10 con 0x7fc92c1533d0 2023-12-19T05:38:35.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.051+0000 7fc932b77640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92c070e20 con 0x7fc92c0712b0 2023-12-19T05:38:35.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.051+0000 7fc932b77640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92c145270 con 0x7fc92c069d00 2023-12-19T05:38:35.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.051+0000 7fc930913640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc92c069d00 0x7fc92c14aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.051+0000 7fc930913640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc92c069d00 0x7fc92c14aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56698/0 (socket says 172.21.15.155:56698) 2023-12-19T05:38:35.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.051+0000 7fc930913640 1 -- 172.21.15.155:0/3739362986 learned_addr learned my addr 172.21.15.155:0/3739362986 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:35.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.051+0000 7fc930913640 1 -- 172.21.15.155:0/3739362986 >> v1:172.21.15.155:6789/0 conn(0x7fc92c0712b0 legacy=0x7fc92c06a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.051+0000 7fc930913640 1 -- 172.21.15.155:0/3739362986 >> v1:172.21.15.120:6789/0 conn(0x7fc92c1533d0 legacy=0x7fc92c1557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.053 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.051+0000 7fc930913640 1 -- 172.21.15.155:0/3739362986 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c070af0 con 0x7fc92c069d00 2023-12-19T05:38:35.054 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.052+0000 7fc930913640 1 --2- 172.21.15.155:0/3739362986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc92c069d00 0x7fc92c14aa80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc920009870 tx=0x7fc92002ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b80ea9c7b52135cd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:35.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.052+0000 7fc92b7fe640 1 -- 172.21.15.155:0/3739362986 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92002f840 con 0x7fc92c069d00 2023-12-19T05:38:35.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.052+0000 7fc92b7fe640 1 -- 172.21.15.155:0/3739362986 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92002f9a0 con 0x7fc92c069d00 2023-12-19T05:38:35.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.052+0000 7fc92b7fe640 1 -- 172.21.15.155:0/3739362986 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92002fd30 con 0x7fc92c069d00 2023-12-19T05:38:35.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.053+0000 7fc932b77640 1 -- 172.21.15.155:0/3739362986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc92c069d00 msgr2=0x7fc92c14aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.053+0000 7fc932b77640 1 --2- 172.21.15.155:0/3739362986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc92c069d00 0x7fc92c14aa80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc920009870 tx=0x7fc92002ba20 comp rx=0 tx=0).stop 2023-12-19T05:38:35.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.053+0000 7fc932b77640 1 -- 172.21.15.155:0/3739362986 shutdown_connections 2023-12-19T05:38:35.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.053+0000 7fc932b77640 1 --2- 172.21.15.155:0/3739362986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc92c069d00 0x7fc92c14aa80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.053+0000 7fc932b77640 1 -- 172.21.15.155:0/3739362986 >> 172.21.15.155:0/3739362986 conn(0x7fc92c0bd070 msgr2=0x7fc92c0bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:35.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.053+0000 7fc932b77640 1 -- 172.21.15.155:0/3739362986 shutdown_connections 2023-12-19T05:38:35.055 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.053+0000 7fc932b77640 1 -- 172.21.15.155:0/3739362986 wait complete. 2023-12-19T05:38:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.054+0000 7fc932b77640 1 Processor -- start 2023-12-19T05:38:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.054+0000 7fc932b77640 1 -- start start 2023-12-19T05:38:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc932b77640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc92c069d00 0x7fc92c14e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc932b77640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc92c0712b0 0x7fc92c1dfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.058 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc932b77640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc92c1533d0 0x7fc92c13f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc932b77640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c150ab0 con 0x7fc92c0712b0 2023-12-19T05:38:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc932b77640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c1e05e0 con 0x7fc92c1533d0 2023-12-19T05:38:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc932b77640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92c1e08c0 con 0x7fc92c069d00 2023-12-19T05:38:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc930913640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc92c069d00 0x7fc92c14e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc931114640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc92c1533d0 0x7fc92c13f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc930913640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc92c069d00 0x7fc92c14e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:49956/0 (socket says 172.21.15.155:49956) 2023-12-19T05:38:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc930913640 1 -- 172.21.15.155:0/3760300505 learned_addr learned my addr 172.21.15.155:0/3760300505 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc92bfff640 1 --2- 172.21.15.155:0/3760300505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc92c0712b0 0x7fc92c1dfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.059 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc930913640 1 -- 172.21.15.155:0/3760300505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc92c1533d0 msgr2=0x7fc92c13f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc930913640 1 --2- 172.21.15.155:0/3760300505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc92c1533d0 0x7fc92c13f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc930913640 1 -- 172.21.15.155:0/3760300505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc92c0712b0 msgr2=0x7fc92c1dfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc930913640 1 --2- 172.21.15.155:0/3760300505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc92c0712b0 0x7fc92c1dfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc930913640 1 -- 172.21.15.155:0/3760300505 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9200094d0 con 0x7fc92c069d00 2023-12-19T05:38:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc931114640 1 --2- 172.21.15.155:0/3760300505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc92c1533d0 0x7fc92c13f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc930913640 1 --2- 172.21.15.155:0/3760300505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc92c069d00 0x7fc92c14e290 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc920000c00 tx=0x7fc920004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.055+0000 7fc9297fa640 1 -- 172.21.15.155:0/3760300505 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92002f810 con 0x7fc92c069d00 2023-12-19T05:38:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.056+0000 7fc9297fa640 1 -- 172.21.15.155:0/3760300505 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc920041400 con 0x7fc92c069d00 2023-12-19T05:38:35.060 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.056+0000 7fc9297fa640 1 -- 172.21.15.155:0/3760300505 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9200417d0 con 0x7fc92c069d00 2023-12-19T05:38:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.056+0000 7fc932b77640 1 -- 172.21.15.155:0/3760300505 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc92c14f610 con 0x7fc92c069d00 2023-12-19T05:38:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.056+0000 7fc932b77640 1 -- 172.21.15.155:0/3760300505 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92c1e02d0 con 0x7fc92c069d00 2023-12-19T05:38:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.056+0000 7fc9297fa640 1 -- 172.21.15.155:0/3760300505 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc920041c30 con 0x7fc92c069d00 2023-12-19T05:38:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.056+0000 7fc9297fa640 1 -- 172.21.15.155:0/3760300505 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fc92003c070 con 0x7fc92c069d00 2023-12-19T05:38:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.056+0000 7fc932b77640 1 -- 172.21.15.155:0/3760300505 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92c04e080 con 0x7fc92c069d00 2023-12-19T05:38:35.061 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.059+0000 7fc9297fa640 1 -- 172.21.15.155:0/3760300505 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fc92004b460 con 0x7fc92c069d00 2023-12-19T05:38:35.066 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:35.065+0000 7f0898443040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T05:38:35.105 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:35.104+0000 7f328c856040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T05:38:35.119 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:35.118+0000 7f0898443040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T05:38:35.131 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.130+0000 7fc932b77640 1 -- 172.21.15.155:0/3760300505 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8b220892-ce97-4c80-98fd-b72839b10837", "id": 2} v 0) v1 -- 0x7fc92c1e0a00 con 0x7fc92c069d00 2023-12-19T05:38:35.139 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.138+0000 7fc9297fa640 1 -- 172.21.15.155:0/3760300505 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b220892-ce97-4c80-98fd-b72839b10837", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc92c1e0a00 con 0x7fc92c069d00 2023-12-19T05:38:35.139 INFO:teuthology.orchestra.run.smithi155.stdout:2 2023-12-19T05:38:35.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.139+0000 7fc932b77640 1 -- 172.21.15.155:0/3760300505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc92c069d00 msgr2=0x7fc92c14e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.139+0000 7fc932b77640 1 --2- 172.21.15.155:0/3760300505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc92c069d00 0x7fc92c14e290 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc920000c00 tx=0x7fc920004730 comp rx=0 tx=0).stop 2023-12-19T05:38:35.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.139+0000 7fc932b77640 1 -- 172.21.15.155:0/3760300505 shutdown_connections 2023-12-19T05:38:35.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.139+0000 7fc932b77640 1 --2- 172.21.15.155:0/3760300505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc92c1533d0 0x7fc92c13f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.139+0000 7fc932b77640 1 --2- 172.21.15.155:0/3760300505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc92c0712b0 0x7fc92c1dfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.139+0000 7fc932b77640 1 --2- 172.21.15.155:0/3760300505 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc92c069d00 0x7fc92c14e290 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.140 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.139+0000 7fc932b77640 1 -- 172.21.15.155:0/3760300505 >> 172.21.15.155:0/3760300505 conn(0x7fc92c0bd070 msgr2=0x7fc92c0b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:35.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.139+0000 7fc932b77640 1 -- 172.21.15.155:0/3760300505 shutdown_connections 2023-12-19T05:38:35.141 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.139+0000 7fc932b77640 1 -- 172.21.15.155:0/3760300505 wait complete. 2023-12-19T05:38:35.151 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 34b9805c-832b-42bd-aef6-825d587ca48d 3 2023-12-19T05:38:35.152 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:35.151+0000 7f328c856040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T05:38:35.160 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:35.160+0000 7f0898443040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T05:38:35.215 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:35.214+0000 7f328c856040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T05:38:35.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.251+0000 7fb48f461640 1 Processor -- start 2023-12-19T05:38:35.252 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.251+0000 7fb48f461640 1 -- start start 2023-12-19T05:38:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.251+0000 7fb48f461640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb4880bad20 0x7fb4880b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.251+0000 7fb48f461640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb488142980 0x7fb4880b96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.251+0000 7fb48f461640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4880b9c10 0x7fb488070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.251+0000 7fb48f461640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4880b6070 con 0x7fb488142980 2023-12-19T05:38:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.251+0000 7fb48f461640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4880b56d0 con 0x7fb4880bad20 2023-12-19T05:38:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.251+0000 7fb48f461640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880b59b0 con 0x7fb4880b9c10 2023-12-19T05:38:35.254 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.252+0000 7fb48d1fd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb4880bad20 0x7fb4880b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.252+0000 7fb48d1fd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb4880bad20 0x7fb4880b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56712/0 (socket says 172.21.15.155:56712) 2023-12-19T05:38:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.252+0000 7fb48d1fd640 1 -- 172.21.15.155:0/3726478862 learned_addr learned my addr 172.21.15.155:0/3726478862 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.252+0000 7fb48d9fe640 1 --2- 172.21.15.155:0/3726478862 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4880b9c10 0x7fb488070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.252+0000 7fb48c9fc640 1 --2- 172.21.15.155:0/3726478862 >> v2:172.21.15.120:3300/0 conn(0x7fb488142980 0x7fb4880b96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.252+0000 7fb48d1fd640 1 -- 172.21.15.155:0/3726478862 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4880b9c10 msgr2=0x7fb488070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.252+0000 7fb48d1fd640 1 --2- 172.21.15.155:0/3726478862 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4880b9c10 0x7fb488070ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.252+0000 7fb48d1fd640 1 -- 172.21.15.155:0/3726478862 >> v2:172.21.15.120:3300/0 conn(0x7fb488142980 msgr2=0x7fb4880b96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.252+0000 7fb48d1fd640 1 --2- 172.21.15.155:0/3726478862 >> v2:172.21.15.120:3300/0 conn(0x7fb488142980 0x7fb4880b96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.252+0000 7fb48d1fd640 1 -- 172.21.15.155:0/3726478862 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4880b5c90 con 0x7fb4880bad20 2023-12-19T05:38:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.253+0000 7fb48d1fd640 1 --2- 172.21.15.155:0/3726478862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4880bad20 0x7fb4880b4d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb488071fe0 tx=0x7fb48002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1384199cbd4b140e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.253+0000 7fb47ffff640 1 -- 172.21.15.155:0/3726478862 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480031870 con 0x7fb4880bad20 2023-12-19T05:38:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.253+0000 7fb47ffff640 1 -- 172.21.15.155:0/3726478862 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4800319d0 con 0x7fb4880bad20 2023-12-19T05:38:35.255 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.253+0000 7fb47ffff640 1 -- 172.21.15.155:0/3726478862 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480031d60 con 0x7fb4880bad20 2023-12-19T05:38:35.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.253+0000 7fb48f461640 1 -- 172.21.15.155:0/3726478862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4880bad20 msgr2=0x7fb4880b4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.253+0000 7fb48f461640 1 --2- 172.21.15.155:0/3726478862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4880bad20 0x7fb4880b4d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb488071fe0 tx=0x7fb48002b910 comp rx=0 tx=0).stop 2023-12-19T05:38:35.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.253+0000 7fb48f461640 1 -- 172.21.15.155:0/3726478862 shutdown_connections 2023-12-19T05:38:35.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.253+0000 7fb48f461640 1 --2- 172.21.15.155:0/3726478862 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4880b9c10 0x7fb488070ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.253+0000 7fb48f461640 1 --2- 172.21.15.155:0/3726478862 >> v2:172.21.15.120:3300/0 conn(0x7fb488142980 0x7fb4880b96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.253+0000 7fb48f461640 1 --2- 172.21.15.155:0/3726478862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4880bad20 0x7fb4880b4d50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.254+0000 7fb48f461640 1 -- 172.21.15.155:0/3726478862 >> 172.21.15.155:0/3726478862 conn(0x7fb488069d00 msgr2=0x7fb48806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:35.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.254+0000 7fb48f461640 1 -- 172.21.15.155:0/3726478862 shutdown_connections 2023-12-19T05:38:35.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.254+0000 7fb48f461640 1 -- 172.21.15.155:0/3726478862 wait complete. 2023-12-19T05:38:35.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.255+0000 7fb48f461640 1 Processor -- start 2023-12-19T05:38:35.259 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.255+0000 7fb48f461640 1 -- start start 2023-12-19T05:38:35.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.255+0000 7fb48f461640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4880b9c10 0x7fb488138e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.255+0000 7fb48f461640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4880bad20 0x7fb4880bddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.255+0000 7fb48f461640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb488142980 0x7fb488137ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.255+0000 7fb48f461640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881383e0 con 0x7fb488142980 2023-12-19T05:38:35.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.255+0000 7fb48f461640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48813bd20 con 0x7fb4880bad20 2023-12-19T05:38:35.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.255+0000 7fb48f461640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880beb40 con 0x7fb4880b9c10 2023-12-19T05:38:35.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.255+0000 7fb48d1fd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4880b9c10 0x7fb488138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.255+0000 7fb48c9fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4880bad20 0x7fb4880bddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.255+0000 7fb48d1fd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4880b9c10 0x7fb488138e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:49974/0 (socket says 172.21.15.155:49974) 2023-12-19T05:38:35.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.255+0000 7fb48d1fd640 1 -- 172.21.15.155:0/2329602306 learned_addr learned my addr 172.21.15.155:0/2329602306 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:35.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.255+0000 7fb48d9fe640 1 --2- 172.21.15.155:0/2329602306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb488142980 0x7fb488137ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.260 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.256+0000 7fb48c9fc640 1 -- 172.21.15.155:0/2329602306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4880b9c10 msgr2=0x7fb488138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.256+0000 7fb48c9fc640 1 --2- 172.21.15.155:0/2329602306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4880b9c10 0x7fb488138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.256+0000 7fb48c9fc640 1 -- 172.21.15.155:0/2329602306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb488142980 msgr2=0x7fb488137ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.256+0000 7fb48c9fc640 1 --2- 172.21.15.155:0/2329602306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb488142980 0x7fb488137ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.256+0000 7fb48c9fc640 1 -- 172.21.15.155:0/2329602306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800094d0 con 0x7fb4880bad20 2023-12-19T05:38:35.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.256+0000 7fb48c9fc640 1 --2- 172.21.15.155:0/2329602306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4880bad20 0x7fb4880bddf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb47800e870 tx=0x7fb47800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:35.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.256+0000 7fb47dffb640 1 -- 172.21.15.155:0/2329602306 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47800ee60 con 0x7fb4880bad20 2023-12-19T05:38:35.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.256+0000 7fb47dffb640 1 -- 172.21.15.155:0/2329602306 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47800c940 con 0x7fb4880bad20 2023-12-19T05:38:35.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.256+0000 7fb48f461640 1 -- 172.21.15.155:0/2329602306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4880bd030 con 0x7fb4880bad20 2023-12-19T05:38:35.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.256+0000 7fb47dffb640 1 -- 172.21.15.155:0/2329602306 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47800ccd0 con 0x7fb4880bad20 2023-12-19T05:38:35.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.256+0000 7fb48f461640 1 -- 172.21.15.155:0/2329602306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4880bd5f0 con 0x7fb4880bad20 2023-12-19T05:38:35.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.256+0000 7fb47dffb640 1 -- 172.21.15.155:0/2329602306 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb478005c90 con 0x7fb4880bad20 2023-12-19T05:38:35.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.256+0000 7fb47dffb640 1 -- 172.21.15.155:0/2329602306 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fb4780067a0 con 0x7fb4880bad20 2023-12-19T05:38:35.261 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.257+0000 7fb48f461640 1 -- 172.21.15.155:0/2329602306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48804e080 con 0x7fb4880bad20 2023-12-19T05:38:35.262 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:35.259+0000 7f0898443040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-19T05:38:35.262 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.259+0000 7fb47dffb640 1 -- 172.21.15.155:0/2329602306 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fb478021060 con 0x7fb4880bad20 2023-12-19T05:38:35.262 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:35.259+0000 7f328c856040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T05:38:35.329 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:35.328+0000 7f0898443040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T05:38:35.332 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.331+0000 7fb48f461640 1 -- 172.21.15.155:0/2329602306 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "34b9805c-832b-42bd-aef6-825d587ca48d", "id": 3} v 0) v1 -- 0x7fb4880b6580 con 0x7fb4880bad20 2023-12-19T05:38:35.340 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.339+0000 7fb47dffb640 1 -- 172.21.15.155:0/2329602306 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "34b9805c-832b-42bd-aef6-825d587ca48d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb478017070 con 0x7fb4880bad20 2023-12-19T05:38:35.340 INFO:teuthology.orchestra.run.smithi155.stdout:3 2023-12-19T05:38:35.341 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.340+0000 7fb48f461640 1 -- 172.21.15.155:0/2329602306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4880bad20 msgr2=0x7fb4880bddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.341 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.340+0000 7fb48f461640 1 --2- 172.21.15.155:0/2329602306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4880bad20 0x7fb4880bddf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb47800e870 tx=0x7fb47800ed30 comp rx=0 tx=0).stop 2023-12-19T05:38:35.341 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.340+0000 7fb48f461640 1 -- 172.21.15.155:0/2329602306 shutdown_connections 2023-12-19T05:38:35.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.340+0000 7fb48f461640 1 --2- 172.21.15.155:0/2329602306 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb488142980 0x7fb488137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.340+0000 7fb48f461640 1 --2- 172.21.15.155:0/2329602306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4880bad20 0x7fb4880bddf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.340+0000 7fb48f461640 1 --2- 172.21.15.155:0/2329602306 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb4880b9c10 0x7fb488138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.340+0000 7fb48f461640 1 -- 172.21.15.155:0/2329602306 >> 172.21.15.155:0/2329602306 conn(0x7fb488069d00 msgr2=0x7fb4880ba040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:35.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.340+0000 7fb48f461640 1 -- 172.21.15.155:0/2329602306 shutdown_connections 2023-12-19T05:38:35.342 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.340+0000 7fb48f461640 1 -- 172.21.15.155:0/2329602306 wait complete. 2023-12-19T05:38:35.351 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28 4 2023-12-19T05:38:35.368 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:35.367+0000 7f328c856040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-19T05:38:35.374 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:35.373+0000 7f0898443040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T05:38:35.425 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:35.424+0000 7f0898443040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T05:38:35.441 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:35.440+0000 7f328c856040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T05:38:35.452 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.451+0000 7f74c1bf0640 1 Processor -- start 2023-12-19T05:38:35.452 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.451+0000 7f74c1bf0640 1 -- start start 2023-12-19T05:38:35.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.452+0000 7f74c1bf0640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f74bc069d00 0x7f74bc14aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.452+0000 7f74c1bf0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74bc0712b0 0x7f74bc06a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.452+0000 7f74c1bf0640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74bc06ba10 con 0x7f74bc06a620 2023-12-19T05:38:35.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.452+0000 7f74c1bf0640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74bc145270 con 0x7f74bc069d00 2023-12-19T05:38:35.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.452+0000 7f74c1bf0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74bc0b41f0 con 0x7f74bc0712b0 2023-12-19T05:38:35.454 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.452+0000 7f74b2ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74bc0712b0 0x7f74bc06a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.452+0000 7f74b2ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74bc0712b0 0x7f74bc06a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56744/0 (socket says 172.21.15.155:56744) 2023-12-19T05:38:35.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.452+0000 7f74b2ffd640 1 -- 172.21.15.155:0/4169951891 learned_addr learned my addr 172.21.15.155:0/4169951891 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:35.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.452+0000 7f74bb7fe640 1 --2- 172.21.15.155:0/4169951891 >> v2:172.21.15.120:3300/0 conn(0x7f74bc069d00 0x7f74bc14aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.452+0000 7f74b2ffd640 1 -- 172.21.15.155:0/4169951891 >> v2:172.21.15.120:3300/0 conn(0x7f74bc069d00 msgr2=0x7f74bc14aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:35.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.452+0000 7f74b2ffd640 1 --2- 172.21.15.155:0/4169951891 >> v2:172.21.15.120:3300/0 conn(0x7f74bc069d00 0x7f74bc14aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.452+0000 7f74b2ffd640 1 -- 172.21.15.155:0/4169951891 >> v1:172.21.15.155:6789/0 conn(0x7f74bc06a620 legacy=0x7f74bc14e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.452+0000 7f74b2ffd640 1 -- 172.21.15.155:0/4169951891 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc070e20 con 0x7f74bc0712b0 2023-12-19T05:38:35.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.453+0000 7f74b2ffd640 1 --2- 172.21.15.155:0/4169951891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc0712b0 0x7f74bc06a0e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0be170 tx=0x7f74a402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74a447cb483ba337 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:35.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.453+0000 7f74baffd640 1 -- 172.21.15.155:0/4169951891 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4030860 con 0x7f74bc0712b0 2023-12-19T05:38:35.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.453+0000 7f74baffd640 1 -- 172.21.15.155:0/4169951891 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a40309c0 con 0x7f74bc0712b0 2023-12-19T05:38:35.455 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.453+0000 7f74baffd640 1 -- 172.21.15.155:0/4169951891 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4030d50 con 0x7f74bc0712b0 2023-12-19T05:38:35.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.454+0000 7f74c1bf0640 1 -- 172.21.15.155:0/4169951891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc0712b0 msgr2=0x7f74bc06a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.454+0000 7f74c1bf0640 1 --2- 172.21.15.155:0/4169951891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc0712b0 0x7f74bc06a0e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f74bc0be170 tx=0x7f74a402b9a0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.454+0000 7f74c1bf0640 1 -- 172.21.15.155:0/4169951891 shutdown_connections 2023-12-19T05:38:35.458 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.454+0000 7f74c1bf0640 1 --2- 172.21.15.155:0/4169951891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc0712b0 0x7f74bc06a0e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.454+0000 7f74c1bf0640 1 --2- 172.21.15.155:0/4169951891 >> v2:172.21.15.120:3300/0 conn(0x7f74bc069d00 0x7f74bc14aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.454+0000 7f74c1bf0640 1 -- 172.21.15.155:0/4169951891 >> 172.21.15.155:0/4169951891 conn(0x7f74bc0bd070 msgr2=0x7f74bc0bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.454+0000 7f74c1bf0640 1 -- 172.21.15.155:0/4169951891 shutdown_connections 2023-12-19T05:38:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.454+0000 7f74c1bf0640 1 -- 172.21.15.155:0/4169951891 wait complete. 2023-12-19T05:38:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.455+0000 7f74c1bf0640 1 Processor -- start 2023-12-19T05:38:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.455+0000 7f74c1bf0640 1 -- start start 2023-12-19T05:38:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74c1bf0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74bc069d00 0x7f74bc147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74c1bf0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc0712b0 0x7f74bc14e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74c1bf0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc14bc20 0x7f74bc13f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74c1bf0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc14c2f0 con 0x7f74bc069d00 2023-12-19T05:38:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74c1bf0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc1df8c0 con 0x7f74bc0712b0 2023-12-19T05:38:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74c1bf0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc1e0830 con 0x7f74bc14bc20 2023-12-19T05:38:35.459 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74b2ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc0712b0 0x7f74bc14e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74b2ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc0712b0 0x7f74bc14e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56756/0 (socket says 172.21.15.155:56756) 2023-12-19T05:38:35.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74bbfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc14bc20 0x7f74bc13f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74b2ffd640 1 -- 172.21.15.155:0/1723920943 learned_addr learned my addr 172.21.15.155:0/1723920943 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:35.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74bb7fe640 1 --2- 172.21.15.155:0/1723920943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74bc069d00 0x7f74bc147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74b2ffd640 1 -- 172.21.15.155:0/1723920943 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc14bc20 msgr2=0x7f74bc13f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74b2ffd640 1 --2- 172.21.15.155:0/1723920943 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc14bc20 0x7f74bc13f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74b2ffd640 1 -- 172.21.15.155:0/1723920943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74bc069d00 msgr2=0x7f74bc147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74b2ffd640 1 --2- 172.21.15.155:0/1723920943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74bc069d00 0x7f74bc147bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74b2ffd640 1 -- 172.21.15.155:0/1723920943 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a40094d0 con 0x7f74bc0712b0 2023-12-19T05:38:35.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74bbfff640 1 --2- 172.21.15.155:0/1723920943 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc14bc20 0x7f74bc13f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:35.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74b2ffd640 1 --2- 172.21.15.155:0/1723920943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc0712b0 0x7f74bc14e740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f74a4000c00 tx=0x7f74a40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:35.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74b8ff9640 1 -- 172.21.15.155:0/1723920943 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a403e070 con 0x7f74bc0712b0 2023-12-19T05:38:35.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74b8ff9640 1 -- 172.21.15.155:0/1723920943 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a4039990 con 0x7f74bc0712b0 2023-12-19T05:38:35.460 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74c1bf0640 1 -- 172.21.15.155:0/1723920943 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74bc1dfab0 con 0x7f74bc0712b0 2023-12-19T05:38:35.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74b8ff9640 1 -- 172.21.15.155:0/1723920943 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4039d60 con 0x7f74bc0712b0 2023-12-19T05:38:35.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.456+0000 7f74c1bf0640 1 -- 172.21.15.155:0/1723920943 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74bc1e0030 con 0x7f74bc0712b0 2023-12-19T05:38:35.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.457+0000 7f74b8ff9640 1 -- 172.21.15.155:0/1723920943 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f74a404b700 con 0x7f74bc0712b0 2023-12-19T05:38:35.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.457+0000 7f74b8ff9640 1 -- 172.21.15.155:0/1723920943 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f74a4042b30 con 0x7f74bc0712b0 2023-12-19T05:38:35.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.458+0000 7f74c1bf0640 1 -- 172.21.15.155:0/1723920943 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74bc04e080 con 0x7f74bc0712b0 2023-12-19T05:38:35.461 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.460+0000 7f74b8ff9640 1 -- 172.21.15.155:0/1723920943 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f74a4034070 con 0x7f74bc0712b0 2023-12-19T05:38:35.471 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:35.470+0000 7f0898443040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T05:38:35.504 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:35.503+0000 7f328c856040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T05:38:35.550 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.549+0000 7f74c1bf0640 1 -- 172.21.15.155:0/1723920943 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28", "id": 4} v 0) v1 -- 0x7f74bc070730 con 0x7f74bc0712b0 2023-12-19T05:38:35.558 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:35.557+0000 7f328c856040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T05:38:35.558 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.557+0000 7f74b8ff9640 1 -- 172.21.15.155:0/1723920943 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f74a4042dd0 con 0x7f74bc0712b0 2023-12-19T05:38:35.558 INFO:teuthology.orchestra.run.smithi155.stdout:4 2023-12-19T05:38:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.558+0000 7f74c1bf0640 1 -- 172.21.15.155:0/1723920943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc0712b0 msgr2=0x7f74bc14e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.558+0000 7f74c1bf0640 1 --2- 172.21.15.155:0/1723920943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc0712b0 0x7f74bc14e740 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f74a4000c00 tx=0x7f74a40046c0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.558+0000 7f74c1bf0640 1 -- 172.21.15.155:0/1723920943 shutdown_connections 2023-12-19T05:38:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.558+0000 7f74c1bf0640 1 --2- 172.21.15.155:0/1723920943 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74bc14bc20 0x7f74bc13f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.558+0000 7f74c1bf0640 1 --2- 172.21.15.155:0/1723920943 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74bc0712b0 0x7f74bc14e740 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.558+0000 7f74c1bf0640 1 --2- 172.21.15.155:0/1723920943 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74bc069d00 0x7f74bc147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.558+0000 7f74c1bf0640 1 -- 172.21.15.155:0/1723920943 >> 172.21.15.155:0/1723920943 conn(0x7f74bc0bd070 msgr2=0x7f74bc0ba220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.559+0000 7f74c1bf0640 1 -- 172.21.15.155:0/1723920943 shutdown_connections 2023-12-19T05:38:35.560 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.559+0000 7f74c1bf0640 1 -- 172.21.15.155:0/1723920943 wait complete. 2023-12-19T05:38:35.574 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 952d8346-f540-49c5-8d5b-beda607a751e 5 2023-12-19T05:38:35.607 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:35.605+0000 7f328c856040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T05:38:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.705+0000 7fd977cec640 1 Processor -- start 2023-12-19T05:38:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.705+0000 7fd977cec640 1 -- start start 2023-12-19T05:38:35.709 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd977cec640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd970142b90 0x7fd9700b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd977cec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97006ad10 0x7fd970148a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd977cec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd97006b150 0x7fd970148f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd977cec640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd970142f70 con 0x7fd970142b90 2023-12-19T05:38:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd977cec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9700b4b00 con 0x7fd97006b150 2023-12-19T05:38:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd977cec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700b4720 con 0x7fd97006ad10 2023-12-19T05:38:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd976289640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd97006b150 0x7fd970148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd975287640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97006ad10 0x7fd970148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd976289640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd97006b150 0x7fd970148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56758/0 (socket says 172.21.15.155:56758) 2023-12-19T05:38:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd976289640 1 -- 172.21.15.155:0/530779660 learned_addr learned my addr 172.21.15.155:0/530779660 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd975a88640 1 --2- 172.21.15.155:0/530779660 >> v2:172.21.15.120:3300/0 conn(0x7fd970142b90 0x7fd9700b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd976289640 1 -- 172.21.15.155:0/530779660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97006ad10 msgr2=0x7fd970148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd976289640 1 --2- 172.21.15.155:0/530779660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97006ad10 0x7fd970148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.710 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd976289640 1 -- 172.21.15.155:0/530779660 >> v2:172.21.15.120:3300/0 conn(0x7fd970142b90 msgr2=0x7fd9700b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd976289640 1 --2- 172.21.15.155:0/530779660 >> v2:172.21.15.120:3300/0 conn(0x7fd970142b90 0x7fd9700b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd976289640 1 -- 172.21.15.155:0/530779660 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9700b5ed0 con 0x7fd97006b150 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.706+0000 7fd975287640 1 --2- 172.21.15.155:0/530779660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97006ad10 0x7fd970148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.707+0000 7fd976289640 1 --2- 172.21.15.155:0/530779660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97006b150 0x7fd970148f80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd9700661d0 tx=0x7fd96802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=284f00fc1457e97d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.707+0000 7fd974a86640 1 -- 172.21.15.155:0/530779660 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96802ca70 con 0x7fd97006b150 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.707+0000 7fd974a86640 1 -- 172.21.15.155:0/530779660 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96802cbd0 con 0x7fd97006b150 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.707+0000 7fd974a86640 1 -- 172.21.15.155:0/530779660 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680343f0 con 0x7fd97006b150 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.707+0000 7fd977cec640 1 -- 172.21.15.155:0/530779660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97006b150 msgr2=0x7fd970148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.707+0000 7fd977cec640 1 --2- 172.21.15.155:0/530779660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97006b150 0x7fd970148f80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd9700661d0 tx=0x7fd96802bed0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.708+0000 7fd977cec640 1 -- 172.21.15.155:0/530779660 shutdown_connections 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.708+0000 7fd977cec640 1 --2- 172.21.15.155:0/530779660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97006b150 0x7fd970148f80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.708+0000 7fd977cec640 1 --2- 172.21.15.155:0/530779660 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97006ad10 0x7fd970148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.708+0000 7fd977cec640 1 --2- 172.21.15.155:0/530779660 >> v2:172.21.15.120:3300/0 conn(0x7fd970142b90 0x7fd9700b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.708+0000 7fd977cec640 1 -- 172.21.15.155:0/530779660 >> 172.21.15.155:0/530779660 conn(0x7fd9700b91e0 msgr2=0x7fd9700b95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:35.711 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.708+0000 7fd977cec640 1 -- 172.21.15.155:0/530779660 shutdown_connections 2023-12-19T05:38:35.712 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.708+0000 7fd977cec640 1 -- 172.21.15.155:0/530779660 wait complete. 2023-12-19T05:38:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.709+0000 7fd977cec640 1 Processor -- start 2023-12-19T05:38:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.709+0000 7fd977cec640 1 -- start start 2023-12-19T05:38:35.714 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.709+0000 7fd977cec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97006ad10 0x7fd9701455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.709+0000 7fd977cec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97006b150 0x7fd97013b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.709+0000 7fd977cec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd970142b90 0x7fd97013bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.709+0000 7fd977cec640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd970143880 con 0x7fd970142b90 2023-12-19T05:38:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.709+0000 7fd977cec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd970144e30 con 0x7fd97006b150 2023-12-19T05:38:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.709+0000 7fd977cec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd970142050 con 0x7fd97006ad10 2023-12-19T05:38:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.709+0000 7fd975a88640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97006ad10 0x7fd9701455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.709+0000 7fd975287640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97006b150 0x7fd97013b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.709+0000 7fd975287640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97006b150 0x7fd97013b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56770/0 (socket says 172.21.15.155:56770) 2023-12-19T05:38:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.709+0000 7fd975287640 1 -- 172.21.15.155:0/399434122 learned_addr learned my addr 172.21.15.155:0/399434122 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.709+0000 7fd976289640 1 --2- 172.21.15.155:0/399434122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd970142b90 0x7fd97013bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd975287640 1 -- 172.21.15.155:0/399434122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97006ad10 msgr2=0x7fd9701455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd975287640 1 --2- 172.21.15.155:0/399434122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97006ad10 0x7fd9701455c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd975287640 1 -- 172.21.15.155:0/399434122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd970142b90 msgr2=0x7fd97013bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.715 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd975287640 1 --2- 172.21.15.155:0/399434122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd970142b90 0x7fd97013bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd975287640 1 -- 172.21.15.155:0/399434122 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd960009400 con 0x7fd97006b150 2023-12-19T05:38:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd976289640 1 --2- 172.21.15.155:0/399434122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd970142b90 0x7fd97013bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:38:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd975a88640 1 --2- 172.21.15.155:0/399434122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97006ad10 0x7fd9701455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd975287640 1 --2- 172.21.15.155:0/399434122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97006b150 0x7fd97013b750 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd96000e980 tx=0x7fd96000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd9667fc640 1 -- 172.21.15.155:0/399434122 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600096e0 con 0x7fd97006b150 2023-12-19T05:38:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd9667fc640 1 -- 172.21.15.155:0/399434122 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96000ca00 con 0x7fd97006b150 2023-12-19T05:38:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd9667fc640 1 -- 172.21.15.155:0/399434122 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96000cd90 con 0x7fd97006b150 2023-12-19T05:38:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd977cec640 1 -- 172.21.15.155:0/399434122 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd968009b30 con 0x7fd97006b150 2023-12-19T05:38:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd977cec640 1 -- 172.21.15.155:0/399434122 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd970143af0 con 0x7fd97006b150 2023-12-19T05:38:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd9667fc640 1 -- 172.21.15.155:0/399434122 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd960005c90 con 0x7fd97006b150 2023-12-19T05:38:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.710+0000 7fd9667fc640 1 -- 172.21.15.155:0/399434122 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fd9600139f0 con 0x7fd97006b150 2023-12-19T05:38:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.711+0000 7fd977cec640 1 -- 172.21.15.155:0/399434122 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97004e080 con 0x7fd97006b150 2023-12-19T05:38:35.716 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.713+0000 7fd9667fc640 1 -- 172.21.15.155:0/399434122 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fd960021060 con 0x7fd97006b150 2023-12-19T05:38:35.785 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.784+0000 7fd977cec640 1 -- 172.21.15.155:0/399434122 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "952d8346-f540-49c5-8d5b-beda607a751e", "id": 5} v 0) v1 -- 0x7fd9700b6180 con 0x7fd97006b150 2023-12-19T05:38:35.792 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.791+0000 7fd9667fc640 1 -- 172.21.15.155:0/399434122 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "952d8346-f540-49c5-8d5b-beda607a751e", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd96002a0b0 con 0x7fd97006b150 2023-12-19T05:38:35.793 INFO:teuthology.orchestra.run.smithi155.stdout:5 2023-12-19T05:38:35.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.792+0000 7fd977cec640 1 -- 172.21.15.155:0/399434122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97006b150 msgr2=0x7fd97013b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.792+0000 7fd977cec640 1 --2- 172.21.15.155:0/399434122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97006b150 0x7fd97013b750 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd96000e980 tx=0x7fd96000ee40 comp rx=0 tx=0).stop 2023-12-19T05:38:35.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.792+0000 7fd977cec640 1 -- 172.21.15.155:0/399434122 shutdown_connections 2023-12-19T05:38:35.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.792+0000 7fd977cec640 1 --2- 172.21.15.155:0/399434122 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd970142b90 0x7fd97013bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.792+0000 7fd977cec640 1 --2- 172.21.15.155:0/399434122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd97006b150 0x7fd97013b750 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.792+0000 7fd977cec640 1 --2- 172.21.15.155:0/399434122 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd97006ad10 0x7fd9701455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.792+0000 7fd977cec640 1 -- 172.21.15.155:0/399434122 >> 172.21.15.155:0/399434122 conn(0x7fd9700b91e0 msgr2=0x7fd97013dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:35.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.792+0000 7fd977cec640 1 -- 172.21.15.155:0/399434122 shutdown_connections 2023-12-19T05:38:35.794 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.792+0000 7fd977cec640 1 -- 172.21.15.155:0/399434122 wait complete. 2023-12-19T05:38:35.804 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new 49077f3f-f51f-43c1-96da-0bf0bbb9ed74 6 2023-12-19T05:38:35.846 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:35.845+0000 7f0898443040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-19T05:38:35.904 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.903+0000 7f67c38ca640 1 Processor -- start 2023-12-19T05:38:35.905 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.903+0000 7f67c38ca640 1 -- start start 2023-12-19T05:38:35.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.904+0000 7f67c38ca640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f67bc070b60 0x7f67bc1477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.904+0000 7f67c38ca640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67bc071110 con 0x7f67bc0b9150 2023-12-19T05:38:35.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.904+0000 7f67c38ca640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67bc06ffa0 con 0x7f67bc06b080 2023-12-19T05:38:35.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.904+0000 7f67c38ca640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67bc0b3c80 con 0x7f67bc070b60 2023-12-19T05:38:35.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.905+0000 7f67c1e67640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f67bc070b60 0x7f67bc1477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.905+0000 7f67c1e67640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f67bc070b60 0x7f67bc1477b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56782/0 (socket says 172.21.15.155:56782) 2023-12-19T05:38:35.906 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.905+0000 7f67c1e67640 1 -- 172.21.15.155:0/2312096842 learned_addr learned my addr 172.21.15.155:0/2312096842 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:35.907 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.905+0000 7f67c1e67640 1 -- 172.21.15.155:0/2312096842 >> v1:172.21.15.155:6789/0 conn(0x7f67bc06b080 legacy=0x7f67bc141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.907 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.905+0000 7f67c1e67640 1 -- 172.21.15.155:0/2312096842 >> v1:172.21.15.120:6789/0 conn(0x7f67bc0b9150 legacy=0x7f67bc150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.907 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.905+0000 7f67c1e67640 1 -- 172.21.15.155:0/2312096842 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67bc070280 con 0x7f67bc070b60 2023-12-19T05:38:35.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.906+0000 7f67c1e67640 1 --2- 172.21.15.155:0/2312096842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67bc070b60 0x7f67bc1477b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009e50 tx=0x7f67b402bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eee2abb38b66438f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:35.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.906+0000 7f67b3fff640 1 -- 172.21.15.155:0/2312096842 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b402cb20 con 0x7f67bc070b60 2023-12-19T05:38:35.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.906+0000 7f67b3fff640 1 -- 172.21.15.155:0/2312096842 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b402cc80 con 0x7f67bc070b60 2023-12-19T05:38:35.908 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.906+0000 7f67b3fff640 1 -- 172.21.15.155:0/2312096842 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b40343f0 con 0x7f67bc070b60 2023-12-19T05:38:35.909 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.907+0000 7f67c38ca640 1 -- 172.21.15.155:0/2312096842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67bc070b60 msgr2=0x7f67bc1477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.909 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.907+0000 7f67c38ca640 1 --2- 172.21.15.155:0/2312096842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67bc070b60 0x7f67bc1477b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009e50 tx=0x7f67b402bf80 comp rx=0 tx=0).stop 2023-12-19T05:38:35.909 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.907+0000 7f67c38ca640 1 -- 172.21.15.155:0/2312096842 shutdown_connections 2023-12-19T05:38:35.909 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.907+0000 7f67c38ca640 1 --2- 172.21.15.155:0/2312096842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67bc070b60 0x7f67bc1477b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.909 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.907+0000 7f67c38ca640 1 -- 172.21.15.155:0/2312096842 >> 172.21.15.155:0/2312096842 conn(0x7f67bc0bd070 msgr2=0x7f67bc0bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:35.909 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.907+0000 7f67c38ca640 1 -- 172.21.15.155:0/2312096842 shutdown_connections 2023-12-19T05:38:35.909 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.907+0000 7f67c38ca640 1 -- 172.21.15.155:0/2312096842 wait complete. 2023-12-19T05:38:35.909 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.908+0000 7f67c38ca640 1 Processor -- start 2023-12-19T05:38:35.910 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.908+0000 7f67c38ca640 1 -- start start 2023-12-19T05:38:35.912 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.909+0000 7f67c38ca640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67bc06b080 0x7f67bc1ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.912 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.909+0000 7f67c38ca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67bc070b60 0x7f67bc1cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.909+0000 7f67c38ca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67bc0b9150 0x7f67bc145d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.909+0000 7f67c38ca640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc1d46f0 con 0x7f67bc06b080 2023-12-19T05:38:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.909+0000 7f67c38ca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc144d60 con 0x7f67bc0b9150 2023-12-19T05:38:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.909+0000 7f67c38ca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc145870 con 0x7f67bc070b60 2023-12-19T05:38:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67c1e67640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67bc0b9150 0x7f67bc145d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67c0e65640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67bc070b60 0x7f67bc1cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67c1e67640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67bc0b9150 0x7f67bc145d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56784/0 (socket says 172.21.15.155:56784) 2023-12-19T05:38:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67c1e67640 1 -- 172.21.15.155:0/1432488259 learned_addr learned my addr 172.21.15.155:0/1432488259 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67c1666640 1 --2- 172.21.15.155:0/1432488259 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67bc06b080 0x7f67bc1ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67c1e67640 1 -- 172.21.15.155:0/1432488259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67bc070b60 msgr2=0x7f67bc1cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67c1e67640 1 --2- 172.21.15.155:0/1432488259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67bc070b60 0x7f67bc1cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67c1e67640 1 -- 172.21.15.155:0/1432488259 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67bc06b080 msgr2=0x7f67bc1ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67c1e67640 1 --2- 172.21.15.155:0/1432488259 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67bc06b080 0x7f67bc1ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.913 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67c1e67640 1 -- 172.21.15.155:0/1432488259 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b4009b30 con 0x7f67bc0b9150 2023-12-19T05:38:35.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67c1e67640 1 --2- 172.21.15.155:0/1432488259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67bc0b9150 0x7f67bc145d00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009f70 tx=0x7f67b4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:35.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67b1ffb640 1 -- 172.21.15.155:0/1432488259 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b402cb20 con 0x7f67bc0b9150 2023-12-19T05:38:35.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67b1ffb640 1 -- 172.21.15.155:0/1432488259 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b4040070 con 0x7f67bc0b9150 2023-12-19T05:38:35.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67b1ffb640 1 -- 172.21.15.155:0/1432488259 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b40476c0 con 0x7f67bc0b9150 2023-12-19T05:38:35.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67c38ca640 1 -- 172.21.15.155:0/1432488259 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67bc1cf260 con 0x7f67bc0b9150 2023-12-19T05:38:35.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.910+0000 7f67c38ca640 1 -- 172.21.15.155:0/1432488259 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67bc1cedd0 con 0x7f67bc0b9150 2023-12-19T05:38:35.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.911+0000 7f67b1ffb640 1 -- 172.21.15.155:0/1432488259 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f67b4047b20 con 0x7f67bc0b9150 2023-12-19T05:38:35.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.911+0000 7f67b1ffb640 1 -- 172.21.15.155:0/1432488259 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f67b4042070 con 0x7f67bc0b9150 2023-12-19T05:38:35.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.911+0000 7f67c38ca640 1 -- 172.21.15.155:0/1432488259 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67bc144bc0 con 0x7f67bc0b9150 2023-12-19T05:38:35.914 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.913+0000 7f67b1ffb640 1 -- 172.21.15.155:0/1432488259 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f67b4066b10 con 0x7f67bc0b9150 2023-12-19T05:38:35.981 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:35.979+0000 7f0898443040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T05:38:35.987 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.986+0000 7f67c38ca640 1 -- 172.21.15.155:0/1432488259 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd new", "uuid": "49077f3f-f51f-43c1-96da-0bf0bbb9ed74", "id": 6} v 0) v1 -- 0x7f67bc04e080 con 0x7f67bc0b9150 2023-12-19T05:38:35.994 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.993+0000 7f67b1ffb640 1 -- 172.21.15.155:0/1432488259 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49077f3f-f51f-43c1-96da-0bf0bbb9ed74", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f67b4055070 con 0x7f67bc0b9150 2023-12-19T05:38:35.994 INFO:teuthology.orchestra.run.smithi155.stdout:6 2023-12-19T05:38:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.994+0000 7f67c38ca640 1 -- 172.21.15.155:0/1432488259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67bc0b9150 msgr2=0x7f67bc145d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:35.995 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.994+0000 7f67c38ca640 1 --2- 172.21.15.155:0/1432488259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67bc0b9150 0x7f67bc145d00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009f70 tx=0x7f67b4004a40 comp rx=0 tx=0).stop 2023-12-19T05:38:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.994+0000 7f67c38ca640 1 -- 172.21.15.155:0/1432488259 shutdown_connections 2023-12-19T05:38:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.994+0000 7f67c38ca640 1 --2- 172.21.15.155:0/1432488259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67bc0b9150 0x7f67bc145d00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.994+0000 7f67c38ca640 1 --2- 172.21.15.155:0/1432488259 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67bc070b60 0x7f67bc1cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.994+0000 7f67c38ca640 1 --2- 172.21.15.155:0/1432488259 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67bc06b080 0x7f67bc1ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.994+0000 7f67c38ca640 1 -- 172.21.15.155:0/1432488259 >> 172.21.15.155:0/1432488259 conn(0x7f67bc0bd070 msgr2=0x7f67bc0714a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:35.996 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.994+0000 7f67c38ca640 1 -- 172.21.15.155:0/1432488259 shutdown_connections 2023-12-19T05:38:35.997 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:35.994+0000 7f67c38ca640 1 -- 172.21.15.155:0/1432488259 wait complete. 2023-12-19T05:38:36.005 DEBUG:teuthology.orchestra.run.smithi155:> sudo ceph --cluster ceph osd new fc60ebed-2b82-47ea-b968-28b662f8bbf5 7 2023-12-19T05:38:36.011 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:36.010+0000 7f328c856040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-19T05:38:36.092 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:36.091+0000 7f0898443040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T05:38:36.111 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.104+0000 7fca9a826640 1 Processor -- start 2023-12-19T05:38:36.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.104+0000 7fca9a826640 1 -- start start 2023-12-19T05:38:36.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca9a826640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca9406b080 0x7fca941477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:36.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca9a826640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca94070b60 0x7fca940715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:36.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca9a826640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca94071110 con 0x7fca940b9150 2023-12-19T05:38:36.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca9a826640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca940b3c80 con 0x7fca9406b080 2023-12-19T05:38:36.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca9a826640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca940b48c0 con 0x7fca94070b60 2023-12-19T05:38:36.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca93fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca9406b080 0x7fca941477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:36.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca98dc3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca94070b60 0x7fca940715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:36.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca93fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fca9406b080 0x7fca941477b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56794/0 (socket says 172.21.15.155:56794) 2023-12-19T05:38:36.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca93fff640 1 -- 172.21.15.155:0/2662583088 learned_addr learned my addr 172.21.15.155:0/2662583088 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:36.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca98dc3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca94070b60 0x7fca940715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:50016/0 (socket says 172.21.15.155:50016) 2023-12-19T05:38:36.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca93fff640 1 -- 172.21.15.155:0/2662583088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca94070b60 msgr2=0x7fca940715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:36.112 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca93fff640 1 --2- 172.21.15.155:0/2662583088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca94070b60 0x7fca940715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca93fff640 1 -- 172.21.15.155:0/2662583088 >> v1:172.21.15.120:6789/0 conn(0x7fca940b9150 legacy=0x7fca94141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:36.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca93fff640 1 -- 172.21.15.155:0/2662583088 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9406ffa0 con 0x7fca9406b080 2023-12-19T05:38:36.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.105+0000 7fca98dc3640 1 --2- 172.21.15.155:0/2662583088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca94070b60 0x7fca940715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:36.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.106+0000 7fca93fff640 1 --2- 172.21.15.155:0/2662583088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9406b080 0x7fca941477b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fca8800bb10 tx=0x7fca8802e0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af709b75561cd19d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:36.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.106+0000 7fca92ffd640 1 -- 172.21.15.155:0/2662583088 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8802ee70 con 0x7fca9406b080 2023-12-19T05:38:36.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.106+0000 7fca92ffd640 1 -- 172.21.15.155:0/2662583088 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca88036440 con 0x7fca9406b080 2023-12-19T05:38:36.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.106+0000 7fca92ffd640 1 -- 172.21.15.155:0/2662583088 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880367d0 con 0x7fca9406b080 2023-12-19T05:38:36.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.107+0000 7fca9a826640 1 -- 172.21.15.155:0/2662583088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9406b080 msgr2=0x7fca941477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:36.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.107+0000 7fca9a826640 1 --2- 172.21.15.155:0/2662583088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9406b080 0x7fca941477b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fca8800bb10 tx=0x7fca8802e0c0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.107+0000 7fca9a826640 1 -- 172.21.15.155:0/2662583088 shutdown_connections 2023-12-19T05:38:36.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.107+0000 7fca9a826640 1 --2- 172.21.15.155:0/2662583088 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca94070b60 0x7fca940715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.107+0000 7fca9a826640 1 --2- 172.21.15.155:0/2662583088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca9406b080 0x7fca941477b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.107+0000 7fca9a826640 1 -- 172.21.15.155:0/2662583088 >> 172.21.15.155:0/2662583088 conn(0x7fca940bd070 msgr2=0x7fca940bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:36.113 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.107+0000 7fca9a826640 1 -- 172.21.15.155:0/2662583088 shutdown_connections 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.107+0000 7fca9a826640 1 -- 172.21.15.155:0/2662583088 wait complete. 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.108+0000 7fca9a826640 1 Processor -- start 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.108+0000 7fca9a826640 1 -- start start 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca9a826640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9406b080 0x7fca94146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca9a826640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca94070b60 0x7fca94142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca9a826640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca940b9150 0x7fca940a7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca9a826640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca94147440 con 0x7fca940b9150 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca9a826640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca94143150 con 0x7fca94070b60 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca9a826640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca94144120 con 0x7fca9406b080 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca93fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9406b080 0x7fca94146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca937fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca94070b60 0x7fca94142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca93fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9406b080 0x7fca94146f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.155:50030/0 (socket says 172.21.15.155:50030) 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca937fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca94070b60 0x7fca94142c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56808/0 (socket says 172.21.15.155:56808) 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca93fff640 1 -- 172.21.15.155:0/3222969230 learned_addr learned my addr 172.21.15.155:0/3222969230 (peer_addr_for_me v2:172.21.15.155:0/0) 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca98dc3640 1 --2- 172.21.15.155:0/3222969230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca940b9150 0x7fca940a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:36.114 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca93fff640 1 -- 172.21.15.155:0/3222969230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca94070b60 msgr2=0x7fca94142c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:36.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca93fff640 1 --2- 172.21.15.155:0/3222969230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca94070b60 0x7fca94142c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca93fff640 1 -- 172.21.15.155:0/3222969230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca940b9150 msgr2=0x7fca940a7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:36.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca93fff640 1 --2- 172.21.15.155:0/3222969230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca940b9150 0x7fca940a7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca93fff640 1 -- 172.21.15.155:0/3222969230 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c009a70 con 0x7fca9406b080 2023-12-19T05:38:36.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca937fe640 1 --2- 172.21.15.155:0/3222969230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca94070b60 0x7fca94142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:36.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca93fff640 1 --2- 172.21.15.155:0/3222969230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9406b080 0x7fca94146f00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fca8800ba60 tx=0x7fca880046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:36.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca90ff9640 1 -- 172.21.15.155:0/3222969230 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88041830 con 0x7fca9406b080 2023-12-19T05:38:36.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.109+0000 7fca90ff9640 1 -- 172.21.15.155:0/3222969230 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca88041990 con 0x7fca9406b080 2023-12-19T05:38:36.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.110+0000 7fca9a826640 1 -- 172.21.15.155:0/3222969230 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8800b770 con 0x7fca9406b080 2023-12-19T05:38:36.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.110+0000 7fca90ff9640 1 -- 172.21.15.155:0/3222969230 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88041d40 con 0x7fca9406b080 2023-12-19T05:38:36.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.110+0000 7fca9a826640 1 -- 172.21.15.155:0/3222969230 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca94143640 con 0x7fca9406b080 2023-12-19T05:38:36.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.110+0000 7fca90ff9640 1 -- 172.21.15.155:0/3222969230 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fca8803d040 con 0x7fca9406b080 2023-12-19T05:38:36.115 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.110+0000 7fca90ff9640 1 -- 172.21.15.155:0/3222969230 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fca8803fa50 con 0x7fca9406b080 2023-12-19T05:38:36.116 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.110+0000 7fca9a826640 1 -- 172.21.15.155:0/3222969230 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9404e080 con 0x7fca9406b080 2023-12-19T05:38:36.116 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.112+0000 7fca90ff9640 1 -- 172.21.15.155:0/3222969230 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fca8804f060 con 0x7fca9406b080 2023-12-19T05:38:36.137 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:36.136+0000 7f0898443040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T05:38:36.151 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:36.150+0000 7f328c856040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T05:38:36.184 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.183+0000 7fca9a826640 1 -- 172.21.15.155:0/3222969230 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fc60ebed-2b82-47ea-b968-28b662f8bbf5", "id": 7} v 0) v1 -- 0x7fca940bbc90 con 0x7fca9406b080 2023-12-19T05:38:36.190 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.189+0000 7fca90ff9640 1 -- 172.21.15.155:0/3222969230 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc60ebed-2b82-47ea-b968-28b662f8bbf5", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fca88045070 con 0x7fca9406b080 2023-12-19T05:38:36.190 INFO:teuthology.orchestra.run.smithi155.stdout:7 2023-12-19T05:38:36.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.190+0000 7fca9a826640 1 -- 172.21.15.155:0/3222969230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9406b080 msgr2=0x7fca94146f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:36.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.190+0000 7fca9a826640 1 --2- 172.21.15.155:0/3222969230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9406b080 0x7fca94146f00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fca8800ba60 tx=0x7fca880046c0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.190+0000 7fca9a826640 1 -- 172.21.15.155:0/3222969230 shutdown_connections 2023-12-19T05:38:36.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.190+0000 7fca9a826640 1 --2- 172.21.15.155:0/3222969230 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fca940b9150 0x7fca940a7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.190+0000 7fca9a826640 1 --2- 172.21.15.155:0/3222969230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca94070b60 0x7fca94142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.190+0000 7fca9a826640 1 --2- 172.21.15.155:0/3222969230 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fca9406b080 0x7fca94146f00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.190+0000 7fca9a826640 1 -- 172.21.15.155:0/3222969230 >> 172.21.15.155:0/3222969230 conn(0x7fca940bd070 msgr2=0x7fca94069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:36.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.190+0000 7fca9a826640 1 -- 172.21.15.155:0/3222969230 shutdown_connections 2023-12-19T05:38:36.191 INFO:teuthology.orchestra.run.smithi155.stderr:2023-12-19T05:38:36.190+0000 7fca9a826640 1 -- 172.21.15.155:0/3222969230 wait complete. 2023-12-19T05:38:36.201 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-19T05:38:36.201 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-19T05:38:36.203 INFO:tasks.ceph.osd.0:Started 2023-12-19T05:38:36.203 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-19T05:38:36.203 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-19T05:38:36.206 INFO:tasks.ceph.osd.1:Started 2023-12-19T05:38:36.206 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-19T05:38:36.206 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-19T05:38:36.208 INFO:tasks.ceph.osd.2:Started 2023-12-19T05:38:36.208 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-19T05:38:36.208 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-19T05:38:36.210 INFO:tasks.ceph.osd.3:Started 2023-12-19T05:38:36.210 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-19T05:38:36.210 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-19T05:38:36.242 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:36.241+0000 7f0898443040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T05:38:36.243 INFO:tasks.ceph.osd.4:Started 2023-12-19T05:38:36.243 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-19T05:38:36.243 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-19T05:38:36.245 INFO:tasks.ceph.osd.5:Started 2023-12-19T05:38:36.245 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-19T05:38:36.246 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-19T05:38:36.247 INFO:tasks.ceph.osd.6:Started 2023-12-19T05:38:36.247 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-19T05:38:36.248 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-19T05:38:36.250 INFO:tasks.ceph.osd.7:Started 2023-12-19T05:38:36.250 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:38:36.321 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:36.320+0000 7f328c856040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T05:38:36.355 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:36.354+0000 7f0898443040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T05:38:36.365 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.364+0000 7f45c6426640 1 Processor -- start 2023-12-19T05:38:36.366 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.365+0000 7f45c6426640 1 -- start start 2023-12-19T05:38:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.365+0000 7f45c6426640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c00b79b0 0x7f45c00b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.365+0000 7f45c6426640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45c014b230 0x7f45c014b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.365+0000 7f45c6426640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c00b96b0 con 0x7f45c00b8860 2023-12-19T05:38:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.365+0000 7f45c6426640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c014ae10 con 0x7f45c014b230 2023-12-19T05:38:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.365+0000 7f45c6426640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00bacc0 con 0x7f45c00b79b0 2023-12-19T05:38:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.365+0000 7f45bffff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c00b79b0 0x7f45c00b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.365+0000 7f45c49c3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45c014b230 0x7f45c014b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.365+0000 7f45c49c3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45c014b230 0x7f45c014b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:49302/0 (socket says 172.21.15.120:49302) 2023-12-19T05:38:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.365+0000 7f45bffff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c00b79b0 0x7f45c00b7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:35780/0 (socket says 172.21.15.120:35780) 2023-12-19T05:38:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.365+0000 7f45c49c3640 1 -- 172.21.15.120:0/990223823 learned_addr learned my addr 172.21.15.120:0/990223823 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:36.367 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.366+0000 7f45c49c3640 1 -- 172.21.15.120:0/990223823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c00b79b0 msgr2=0x7f45c00b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:36.368 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.366+0000 7f45c49c3640 1 --2- 172.21.15.120:0/990223823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c00b79b0 0x7f45c00b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.368 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.366+0000 7f45c49c3640 1 -- 172.21.15.120:0/990223823 >> v1:172.21.15.155:6789/0 conn(0x7f45c00b8860 legacy=0x7f45c0144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:36.368 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.366+0000 7f45c49c3640 1 -- 172.21.15.120:0/990223823 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c00b90f0 con 0x7f45c014b230 2023-12-19T05:38:36.368 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.366+0000 7f45bffff640 1 --2- 172.21.15.120:0/990223823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c00b79b0 0x7f45c00b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:36.369 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.366+0000 7f45c49c3640 1 --2- 172.21.15.120:0/990223823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c014b230 0x7f45c014b6c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009e50 tx=0x7f45b802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5296499447199dbd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:36.369 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.367+0000 7f45beffd640 1 -- 172.21.15.120:0/990223823 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b802cb00 con 0x7f45c014b230 2023-12-19T05:38:36.369 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.367+0000 7f45beffd640 1 -- 172.21.15.120:0/990223823 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b802cc60 con 0x7f45c014b230 2023-12-19T05:38:36.369 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.367+0000 7f45beffd640 1 -- 172.21.15.120:0/990223823 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b80343f0 con 0x7f45c014b230 2023-12-19T05:38:36.369 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.367+0000 7f45c6426640 1 -- 172.21.15.120:0/990223823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c014b230 msgr2=0x7f45c014b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:36.370 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.367+0000 7f45c6426640 1 --2- 172.21.15.120:0/990223823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c014b230 0x7f45c014b6c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009e50 tx=0x7f45b802bf60 comp rx=0 tx=0).stop 2023-12-19T05:38:36.370 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.367+0000 7f45c6426640 1 -- 172.21.15.120:0/990223823 shutdown_connections 2023-12-19T05:38:36.370 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.367+0000 7f45c6426640 1 --2- 172.21.15.120:0/990223823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c014b230 0x7f45c014b6c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.370 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.367+0000 7f45c6426640 1 --2- 172.21.15.120:0/990223823 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c00b79b0 0x7f45c00b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.370 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.367+0000 7f45c6426640 1 -- 172.21.15.120:0/990223823 >> 172.21.15.120:0/990223823 conn(0x7f45c00c0340 msgr2=0x7f45c00c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:36.370 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.367+0000 7f45c6426640 1 -- 172.21.15.120:0/990223823 shutdown_connections 2023-12-19T05:38:36.370 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.367+0000 7f45c6426640 1 -- 172.21.15.120:0/990223823 wait complete. 2023-12-19T05:38:36.370 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.368+0000 7f45c6426640 1 Processor -- start 2023-12-19T05:38:36.370 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.368+0000 7f45c6426640 1 -- start start 2023-12-19T05:38:36.371 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:36.368+0000 7f328c856040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T05:38:36.372 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45c6426640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c00b79b0 0x7f45c01dfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45c6426640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c00b8860 0x7f45c009ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45c6426640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014b230 0x7f45c0148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45c6426640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c0149330 con 0x7f45c00b79b0 2023-12-19T05:38:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45c6426640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c01e0c40 con 0x7f45c00b8860 2023-12-19T05:38:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45c6426640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c009e080 con 0x7f45c014b230 2023-12-19T05:38:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45bffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c00b79b0 0x7f45c01dfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45bffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c00b79b0 0x7f45c01dfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60920/0 (socket says 172.21.15.120:60920) 2023-12-19T05:38:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45bffff640 1 -- 172.21.15.120:0/669804252 learned_addr learned my addr 172.21.15.120:0/669804252 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45c49c3640 1 --2- 172.21.15.120:0/669804252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014b230 0x7f45c0148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45bf7fe640 1 --2- 172.21.15.120:0/669804252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c00b8860 0x7f45c009ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45bffff640 1 -- 172.21.15.120:0/669804252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014b230 msgr2=0x7f45c0148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45bffff640 1 --2- 172.21.15.120:0/669804252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014b230 0x7f45c0148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45bffff640 1 -- 172.21.15.120:0/669804252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c00b8860 msgr2=0x7f45c009ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:36.373 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.369+0000 7f45bffff640 1 --2- 172.21.15.120:0/669804252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c00b8860 0x7f45c009ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.370+0000 7f45bffff640 1 -- 172.21.15.120:0/669804252 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4009400 con 0x7f45c00b79b0 2023-12-19T05:38:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.370+0000 7f45bffff640 1 --2- 172.21.15.120:0/669804252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c00b79b0 0x7f45c01dfcb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f45b400e960 tx=0x7f45b400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.370+0000 7f45bcff9640 1 -- 172.21.15.120:0/669804252 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400c9a0 con 0x7f45c00b79b0 2023-12-19T05:38:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.370+0000 7f45c6426640 1 -- 172.21.15.120:0/669804252 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b8009b30 con 0x7f45c00b79b0 2023-12-19T05:38:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.370+0000 7f45bcff9640 1 -- 172.21.15.120:0/669804252 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b400cb00 con 0x7f45c00b79b0 2023-12-19T05:38:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.370+0000 7f45bcff9640 1 -- 172.21.15.120:0/669804252 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400ce90 con 0x7f45c00b79b0 2023-12-19T05:38:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.370+0000 7f45c6426640 1 -- 172.21.15.120:0/669804252 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c009c440 con 0x7f45c00b79b0 2023-12-19T05:38:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.370+0000 7f45bcff9640 1 -- 172.21.15.120:0/669804252 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f45b4005c90 con 0x7f45c00b79b0 2023-12-19T05:38:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.370+0000 7f45bcff9640 1 -- 172.21.15.120:0/669804252 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f45b4013470 con 0x7f45c00b79b0 2023-12-19T05:38:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.371+0000 7f45c6426640 1 -- 172.21.15.120:0/669804252 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c00bdbf0 con 0x7f45c00b79b0 2023-12-19T05:38:36.374 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.373+0000 7f45bcff9640 1 -- 172.21.15.120:0/669804252 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f45b4021060 con 0x7f45c00b79b0 2023-12-19T05:38:36.434 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.433+0000 7f45c6426640 1 -- 172.21.15.120:0/669804252 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45c009c8f0 con 0x7f45c00b79b0 2023-12-19T05:38:36.435 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.434+0000 7f45bcff9640 1 -- 172.21.15.120:0/669804252 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f45b4021060 con 0x7f45c00b79b0 2023-12-19T05:38:36.435 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:38:36.435 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":10,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:36.185466+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:38:36.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.435+0000 7f45c6426640 1 -- 172.21.15.120:0/669804252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c00b79b0 msgr2=0x7f45c01dfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:36.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.435+0000 7f45c6426640 1 --2- 172.21.15.120:0/669804252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c00b79b0 0x7f45c01dfcb0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f45b400e960 tx=0x7f45b400ee20 comp rx=0 tx=0).stop 2023-12-19T05:38:36.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.435+0000 7f45c6426640 1 -- 172.21.15.120:0/669804252 shutdown_connections 2023-12-19T05:38:36.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.435+0000 7f45c6426640 1 --2- 172.21.15.120:0/669804252 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014b230 0x7f45c0148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.435+0000 7f45c6426640 1 --2- 172.21.15.120:0/669804252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c00b8860 0x7f45c009ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.435+0000 7f45c6426640 1 --2- 172.21.15.120:0/669804252 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c00b79b0 0x7f45c01dfcb0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:36.436 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.435+0000 7f45c6426640 1 -- 172.21.15.120:0/669804252 >> 172.21.15.120:0/669804252 conn(0x7f45c00c0340 msgr2=0x7f45c014a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:36.437 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.435+0000 7f45c6426640 1 -- 172.21.15.120:0/669804252 shutdown_connections 2023-12-19T05:38:36.437 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:36.435+0000 7f45c6426640 1 -- 172.21.15.120:0/669804252 wait complete. 2023-12-19T05:38:36.447 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-19T05:38:36.447 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-19T05:38:36.466 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:36.465+0000 7f328c856040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T05:38:36.501 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:36.500+0000 7f0898443040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T05:38:36.543 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:36.542+0000 7f0898443040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T05:38:36.559 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:36.558+0000 7f328c856040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T05:38:36.683 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:36.682+0000 7f0898443040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T05:38:36.699 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:36.698+0000 7f328c856040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T05:38:36.741 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:36.740+0000 7f328c856040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T05:38:36.815 INFO:tasks.ceph.osd.2.smithi120.stderr:2023-12-19T05:38:36.814+0000 7fe01d0a9500 -1 Falling back to public interface 2023-12-19T05:38:36.819 INFO:tasks.ceph.osd.1.smithi120.stderr:2023-12-19T05:38:36.818+0000 7ff820412500 -1 Falling back to public interface 2023-12-19T05:38:36.830 INFO:tasks.ceph.osd.0.smithi120.stderr:2023-12-19T05:38:36.830+0000 7f4d31200500 -1 Falling back to public interface 2023-12-19T05:38:36.831 INFO:tasks.ceph.osd.3.smithi120.stderr:2023-12-19T05:38:36.830+0000 7f0f9f602500 -1 Falling back to public interface 2023-12-19T05:38:36.831 INFO:tasks.ceph.osd.3.smithi120.stderr:2023-12-19T05:38:36.830+0000 7f0f9e5a9640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6819/0: (98) Address already in use 2023-12-19T05:38:36.844 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-12-19T05:38:36.843+0000 7f7573c21500 -1 Falling back to public interface 2023-12-19T05:38:36.845 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-12-19T05:38:36.844+0000 7f14fa210500 -1 Falling back to public interface 2023-12-19T05:38:36.845 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-12-19T05:38:36.844+0000 7f757250a640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6805/0: (98) Address already in use 2023-12-19T05:38:36.846 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-12-19T05:38:36.844+0000 7f8537e20500 -1 Falling back to public interface 2023-12-19T05:38:36.846 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-12-19T05:38:36.844+0000 7f757250a640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6810/0: (98) Address already in use 2023-12-19T05:38:36.847 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-12-19T05:38:36.846+0000 7f3538625500 -1 Falling back to public interface 2023-12-19T05:38:36.883 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:36.882+0000 7f328c856040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T05:38:37.253 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T05:38:37.342 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.341+0000 7fc69399f640 1 Processor -- start 2023-12-19T05:38:37.342 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.341+0000 7fc69399f640 1 -- start start 2023-12-19T05:38:37.346 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.342+0000 7fc69399f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc68c0b8830 0x7fc68c0b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:37.346 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.342+0000 7fc69399f640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c0b91a0 con 0x7fc68c069f20 2023-12-19T05:38:37.346 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.342+0000 7fc69399f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c071c60 con 0x7fc68c06ff20 2023-12-19T05:38:37.346 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.342+0000 7fc69399f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68c070490 con 0x7fc68c0b8830 2023-12-19T05:38:37.346 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.342+0000 7fc69173b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc68c069f20 0x7fc68c0b3bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:33766/0 (socket says 172.21.15.120:33766) 2023-12-19T05:38:37.346 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.342+0000 7fc69173b640 1 -- 172.21.15.120:0/2470564746 learned_addr learned my addr 172.21.15.120:0/2470564746 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:38:37.346 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.342+0000 7fc691f3c640 1 --2- 172.21.15.120:0/2470564746 >> v2:172.21.15.155:3300/0 conn(0x7fc68c0b8830 0x7fc68c0b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:37.346 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.342+0000 7fc683fff640 1 -- 172.21.15.120:0/2470564746 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777580002 0 0) 0x7fc68c0b91a0 con 0x7fc68c069f20 2023-12-19T05:38:37.346 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.342+0000 7fc683fff640 1 -- 172.21.15.120:0/2470564746 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc678003520 con 0x7fc68c069f20 2023-12-19T05:38:37.347 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc683fff640 1 -- 172.21.15.120:0/2470564746 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1554980098 0 0) 0x7fc678003520 con 0x7fc68c069f20 2023-12-19T05:38:37.347 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc683fff640 1 -- 172.21.15.120:0/2470564746 >> v2:172.21.15.155:3300/0 conn(0x7fc68c0b8830 msgr2=0x7fc68c0b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:37.347 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc683fff640 1 --2- 172.21.15.120:0/2470564746 >> v2:172.21.15.155:3300/0 conn(0x7fc68c0b8830 0x7fc68c0b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:37.347 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc683fff640 1 -- 172.21.15.120:0/2470564746 >> v1:172.21.15.155:6789/0 conn(0x7fc68c06ff20 legacy=0x7fc68c144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:37.347 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc683fff640 1 -- 172.21.15.120:0/2470564746 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c070770 con 0x7fc68c069f20 2023-12-19T05:38:37.347 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc683fff640 1 -- 172.21.15.120:0/2470564746 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7fc67c001670 con 0x7fc68c069f20 2023-12-19T05:38:37.347 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc683fff640 1 -- 172.21.15.120:0/2470564746 >> v1:172.21.15.120:6789/0 conn(0x7fc68c069f20 legacy=0x7fc68c0b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:37.347 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc683fff640 1 --2- 172.21.15.120:0/2470564746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc678003970 0x7fc678003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:37.347 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc683fff640 1 --2- 172.21.15.120:0/2470564746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6780047c0 0x7fc678004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:37.347 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc683fff640 1 --2- 172.21.15.120:0/2470564746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc678005180 0x7fc67800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:37.347 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc683fff640 1 -- 172.21.15.120:0/2470564746 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c070490 con 0x7fc678003970 2023-12-19T05:38:37.347 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc683fff640 1 -- 172.21.15.120:0/2470564746 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67800c030 con 0x7fc6780047c0 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc683fff640 1 -- 172.21.15.120:0/2470564746 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67800c1f0 con 0x7fc678005180 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc69173b640 1 --2- 172.21.15.120:0/2470564746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc678003970 0x7fc678003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc690f3a640 1 --2- 172.21.15.120:0/2470564746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6780047c0 0x7fc678004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc691f3c640 1 --2- 172.21.15.120:0/2470564746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc678005180 0x7fc67800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc69173b640 1 -- 172.21.15.120:0/2470564746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc678005180 msgr2=0x7fc67800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc69173b640 1 --2- 172.21.15.120:0/2470564746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc678005180 0x7fc67800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc69173b640 1 -- 172.21.15.120:0/2470564746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6780047c0 msgr2=0x7fc678004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc69173b640 1 --2- 172.21.15.120:0/2470564746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6780047c0 0x7fc678004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc69173b640 1 -- 172.21.15.120:0/2470564746 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc678003520 con 0x7fc678003970 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc691f3c640 1 --2- 172.21.15.120:0/2470564746 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc678005180 0x7fc67800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.343+0000 7fc691f3c640 1 -- 172.21.15.120:0/2470564746 reap_dead start 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.344+0000 7fc69173b640 1 --2- 172.21.15.120:0/2470564746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc678003970 0x7fc678003d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00c240 tx=0x7fc6780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c0014ce82d2f7c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.344+0000 7fc683fff640 1 -- 172.21.15.120:0/2470564746 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c005ad0 con 0x7fc678003970 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.344+0000 7fc683fff640 1 -- 172.21.15.120:0/2470564746 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c005c30 con 0x7fc678003970 2023-12-19T05:38:37.348 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.344+0000 7fc683fff640 1 -- 172.21.15.120:0/2470564746 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c02ca90 con 0x7fc678003970 2023-12-19T05:38:37.349 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.345+0000 7fc69399f640 1 -- 172.21.15.120:0/2470564746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc678003970 msgr2=0x7fc678003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:37.349 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.345+0000 7fc69399f640 1 --2- 172.21.15.120:0/2470564746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc678003970 0x7fc678003d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc67c00c240 tx=0x7fc6780057f0 comp rx=0 tx=0).stop 2023-12-19T05:38:37.349 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.345+0000 7fc69399f640 1 -- 172.21.15.120:0/2470564746 shutdown_connections 2023-12-19T05:38:37.349 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.345+0000 7fc69399f640 1 --2- 172.21.15.120:0/2470564746 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc678003970 0x7fc678003d90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:37.349 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.345+0000 7fc69399f640 1 -- 172.21.15.120:0/2470564746 >> 172.21.15.120:0/2470564746 conn(0x7fc68c06afa0 msgr2=0x7fc68c06b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:37.349 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.345+0000 7fc69399f640 1 -- 172.21.15.120:0/2470564746 shutdown_connections 2023-12-19T05:38:37.349 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.345+0000 7fc69399f640 1 -- 172.21.15.120:0/2470564746 wait complete. 2023-12-19T05:38:37.351 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.346+0000 7fc69399f640 1 Processor -- start 2023-12-19T05:38:37.352 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.346+0000 7fc69399f640 1 -- start start 2023-12-19T05:38:37.352 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.347+0000 7fc69399f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc678003970 0x7fc68c14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:37.352 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.347+0000 7fc69399f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc68c146c70 0x7fc68c147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:37.352 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.347+0000 7fc69399f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc68c147ab0 0x7fc68c148ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:37.352 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.347+0000 7fc69399f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c14e930 con 0x7fc68c147ab0 2023-12-19T05:38:37.352 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.347+0000 7fc69399f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c147f60 con 0x7fc68c146c70 2023-12-19T05:38:37.352 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.347+0000 7fc69399f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c146130 con 0x7fc678003970 2023-12-19T05:38:37.352 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc691f3c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc68c147ab0 0x7fc68c148ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:37.352 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc69173b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc678003970 0x7fc68c14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:37.352 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc691f3c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc68c147ab0 0x7fc68c148ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:60936/0 (socket says 172.21.15.120:60936) 2023-12-19T05:38:37.352 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc691f3c640 1 -- 172.21.15.120:0/3099352774 learned_addr learned my addr 172.21.15.120:0/3099352774 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:37.352 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc690f3a640 1 --2- 172.21.15.120:0/3099352774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc68c146c70 0x7fc68c147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:37.352 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc69173b640 1 -- 172.21.15.120:0/3099352774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc68c146c70 msgr2=0x7fc68c147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:37.353 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc69173b640 1 --2- 172.21.15.120:0/3099352774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc68c146c70 0x7fc68c147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:37.353 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc69173b640 1 -- 172.21.15.120:0/3099352774 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc68c147ab0 msgr2=0x7fc68c148ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:37.353 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc69173b640 1 --2- 172.21.15.120:0/3099352774 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc68c147ab0 0x7fc68c148ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:37.353 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc69173b640 1 -- 172.21.15.120:0/3099352774 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c1456b0 con 0x7fc678003970 2023-12-19T05:38:37.353 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc691f3c640 1 --2- 172.21.15.120:0/3099352774 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc68c147ab0 0x7fc68c148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:37.353 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc69173b640 1 --2- 172.21.15.120:0/3099352774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc678003970 0x7fc68c14e3f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c000 tx=0x7fc67c02e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:37.353 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc681ffb640 1 -- 172.21.15.120:0/3099352774 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c03c040 con 0x7fc678003970 2023-12-19T05:38:37.353 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc681ffb640 1 -- 172.21.15.120:0/3099352774 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c02cc60 con 0x7fc678003970 2023-12-19T05:38:37.353 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc681ffb640 1 -- 172.21.15.120:0/3099352774 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c007070 con 0x7fc678003970 2023-12-19T05:38:37.353 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.348+0000 7fc69399f640 1 -- 172.21.15.120:0/3099352774 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68c147150 con 0x7fc678003970 2023-12-19T05:38:37.353 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.349+0000 7fc69399f640 1 -- 172.21.15.120:0/3099352774 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68c145930 con 0x7fc678003970 2023-12-19T05:38:37.353 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.349+0000 7fc681ffb640 1 -- 172.21.15.120:0/3099352774 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc67c032070 con 0x7fc678003970 2023-12-19T05:38:37.353 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.349+0000 7fc681ffb640 1 -- 172.21.15.120:0/3099352774 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc67c041b00 con 0x7fc678003970 2023-12-19T05:38:37.353 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.349+0000 7fc69399f640 1 -- 172.21.15.120:0/3099352774 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68c074080 con 0x7fc678003970 2023-12-19T05:38:37.354 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.352+0000 7fc681ffb640 1 -- 172.21.15.120:0/3099352774 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fc67c04f060 con 0x7fc678003970 2023-12-19T05:38:37.412 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.411+0000 7fc69399f640 1 -- 172.21.15.120:0/3099352774 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc68c148890 con 0x7fc678003970 2023-12-19T05:38:37.413 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.412+0000 7fc681ffb640 1 -- 172.21.15.120:0/3099352774 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc67c007ce0 con 0x7fc678003970 2023-12-19T05:38:37.413 INFO:teuthology.misc.health.smithi120.stdout: 2023-12-19T05:38:37.413 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":10,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:36.185466+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:38:37.415 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.413+0000 7fc69399f640 1 -- 172.21.15.120:0/3099352774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc678003970 msgr2=0x7fc68c14e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:37.415 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.413+0000 7fc69399f640 1 --2- 172.21.15.120:0/3099352774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc678003970 0x7fc68c14e3f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c000 tx=0x7fc67c02e070 comp rx=0 tx=0).stop 2023-12-19T05:38:37.415 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.414+0000 7fc69399f640 1 -- 172.21.15.120:0/3099352774 shutdown_connections 2023-12-19T05:38:37.415 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.414+0000 7fc69399f640 1 --2- 172.21.15.120:0/3099352774 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc68c147ab0 0x7fc68c148ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:37.415 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.414+0000 7fc69399f640 1 --2- 172.21.15.120:0/3099352774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc68c146c70 0x7fc68c147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:37.415 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.414+0000 7fc69399f640 1 --2- 172.21.15.120:0/3099352774 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc678003970 0x7fc68c14e3f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:37.415 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.414+0000 7fc69399f640 1 -- 172.21.15.120:0/3099352774 >> 172.21.15.120:0/3099352774 conn(0x7fc68c06afa0 msgr2=0x7fc68c0b9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:37.415 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.414+0000 7fc69399f640 1 -- 172.21.15.120:0/3099352774 shutdown_connections 2023-12-19T05:38:37.415 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:37.414+0000 7fc69399f640 1 -- 172.21.15.120:0/3099352774 wait complete. 2023-12-19T05:38:37.427 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T05:38:37.493 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:37.492+0000 7f0898443040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T05:38:37.678 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:37.677+0000 7f328c856040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T05:38:37.765 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:37.764+0000 7f0898443040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T05:38:37.815 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:37.814+0000 7f0898443040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T05:38:37.916 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:37.915+0000 7f0898443040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T05:38:37.954 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:37.953+0000 7f328c856040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T05:38:38.010 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:38.009+0000 7f328c856040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T05:38:38.108 INFO:tasks.ceph.mgr.x.smithi155.stderr:2023-12-19T05:38:38.107+0000 7f328c856040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T05:38:38.943 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:38.943+0000 7f0839967640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-19T05:38:38.946 INFO:tasks.ceph.mgr.y.smithi120.stderr:2023-12-19T05:38:38.945+0000 7f0839967640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-19T05:38:40.282 INFO:tasks.ceph.osd.2.smithi120.stderr:2023-12-19T05:38:40.280+0000 7fe01d0a9500 -1 osd.2 0 log_to_monitors true 2023-12-19T05:38:40.309 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-12-19T05:38:40.308+0000 7f3538625500 -1 osd.7 0 log_to_monitors true 2023-12-19T05:38:40.343 INFO:tasks.ceph.osd.3.smithi120.stderr:2023-12-19T05:38:40.342+0000 7f0f9f602500 -1 osd.3 0 log_to_monitors true 2023-12-19T05:38:40.343 INFO:tasks.ceph.osd.0.smithi120.stderr:2023-12-19T05:38:40.343+0000 7f4d31200500 -1 osd.0 0 log_to_monitors true 2023-12-19T05:38:40.349 INFO:tasks.ceph.osd.1.smithi120.stderr:2023-12-19T05:38:40.348+0000 7ff820412500 -1 osd.1 0 log_to_monitors true 2023-12-19T05:38:40.362 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-12-19T05:38:40.361+0000 7f8537e20500 -1 osd.5 0 log_to_monitors true 2023-12-19T05:38:40.376 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-12-19T05:38:40.375+0000 7f14fa210500 -1 osd.6 0 log_to_monitors true 2023-12-19T05:38:40.383 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-12-19T05:38:40.382+0000 7f7573c21500 -1 osd.4 0 log_to_monitors true 2023-12-19T05:38:44.005 INFO:tasks.ceph.osd.3.smithi120.stderr:2023-12-19T05:38:44.004+0000 7f0f9ad6a640 -1 osd.3 0 waiting for initial osdmap 2023-12-19T05:38:44.026 INFO:tasks.ceph.osd.3.smithi120.stderr:2023-12-19T05:38:44.025+0000 7f0f9339b640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:44.026 INFO:tasks.ceph.osd.2.smithi120.stderr:2023-12-19T05:38:44.025+0000 7fe01a04c640 -1 osd.2 0 waiting for initial osdmap 2023-12-19T05:38:44.027 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-12-19T05:38:44.027+0000 7f756eccb640 -1 osd.4 0 waiting for initial osdmap 2023-12-19T05:38:44.040 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-12-19T05:38:44.039+0000 7f75672fc640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:44.043 INFO:tasks.ceph.osd.2.smithi120.stderr:2023-12-19T05:38:44.042+0000 7fe010e42640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:44.063 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-12-19T05:38:44.062+0000 7f14f6bcf640 -1 osd.6 0 waiting for initial osdmap 2023-12-19T05:38:44.066 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-12-19T05:38:44.065+0000 7f35337ed640 -1 osd.7 0 waiting for initial osdmap 2023-12-19T05:38:44.069 INFO:tasks.ceph.osd.0.smithi120.stderr:2023-12-19T05:38:44.068+0000 7f4d2c968640 -1 osd.0 0 waiting for initial osdmap 2023-12-19T05:38:44.072 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-12-19T05:38:44.071+0000 7f8532f3f640 -1 osd.5 0 waiting for initial osdmap 2023-12-19T05:38:44.073 INFO:tasks.ceph.osd.1.smithi120.stderr:2023-12-19T05:38:44.072+0000 7ff81b583640 -1 osd.1 0 waiting for initial osdmap 2023-12-19T05:38:44.076 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-12-19T05:38:44.076+0000 7f14ed9c5640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:44.081 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-12-19T05:38:44.081+0000 7f352be1e640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:44.082 INFO:tasks.ceph.osd.0.smithi120.stderr:2023-12-19T05:38:44.082+0000 7f4d24f99640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:44.085 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-12-19T05:38:44.084+0000 7f852b570640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:44.087 INFO:tasks.ceph.osd.1.smithi120.stderr:2023-12-19T05:38:44.087+0000 7ff813bb4640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T05:38:44.235 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T05:38:44.323 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.321+0000 7fbc0fb63640 1 Processor -- start 2023-12-19T05:38:44.323 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.322+0000 7fbc0fb63640 1 -- start start 2023-12-19T05:38:44.324 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.322+0000 7fbc0fb63640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbc0814bea0 0x7fbc080b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:44.324 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.322+0000 7fbc0fb63640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc080ba420 con 0x7fbc080b8c80 2023-12-19T05:38:44.324 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.322+0000 7fbc0fb63640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc080ba700 con 0x7fbc080b9060 2023-12-19T05:38:44.324 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.322+0000 7fbc0fb63640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc080b3760 con 0x7fbc0814bea0 2023-12-19T05:38:44.324 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.322+0000 7fbc0d0fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbc0814bea0 0x7fbc080b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:44.324 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.322+0000 7fbc0d8ff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fbc080b8c80 0x7fbc08071140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:60458/0 (socket says 172.21.15.120:60458) 2023-12-19T05:38:44.324 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.322+0000 7fbc0d0fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbc0814bea0 0x7fbc080b4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:42998/0 (socket says 172.21.15.120:42998) 2023-12-19T05:38:44.324 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.322+0000 7fbc0d8ff640 1 -- 172.21.15.120:0/3419742681 learned_addr learned my addr 172.21.15.120:0/3419742681 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:38:44.324 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.323+0000 7fbc0d0fe640 1 -- 172.21.15.120:0/3419742681 >> v1:172.21.15.155:6789/0 conn(0x7fbc080b9060 legacy=0x7fbc081531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:44.324 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.323+0000 7fbc0d0fe640 1 -- 172.21.15.120:0/3419742681 >> v1:172.21.15.120:6789/0 conn(0x7fbc080b8c80 legacy=0x7fbc08071140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:44.325 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.323+0000 7fbc0d0fe640 1 -- 172.21.15.120:0/3419742681 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc080ba9e0 con 0x7fbc0814bea0 2023-12-19T05:38:44.325 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.323+0000 7fbc0c8fd640 1 -- 172.21.15.120:0/3419742681 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556152786 0 0) 0x7fbc080ba420 con 0x7fbc080b8c80 2023-12-19T05:38:44.326 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.323+0000 7fbc0d0fe640 1 --2- 172.21.15.120:0/3419742681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc0814bea0 0x7fbc080b4e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80097a0 tx=0x7fbbf802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc8916e5e674e4c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:44.326 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.324+0000 7fbc0c8fd640 1 -- 172.21.15.120:0/3419742681 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf802f810 con 0x7fbc0814bea0 2023-12-19T05:38:44.326 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.324+0000 7fbc0c8fd640 1 -- 172.21.15.120:0/3419742681 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf802f970 con 0x7fbc0814bea0 2023-12-19T05:38:44.326 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.324+0000 7fbc0c8fd640 1 -- 172.21.15.120:0/3419742681 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf802fd00 con 0x7fbc0814bea0 2023-12-19T05:38:44.326 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.324+0000 7fbc0fb63640 1 -- 172.21.15.120:0/3419742681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc0814bea0 msgr2=0x7fbc080b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:44.326 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.324+0000 7fbc0fb63640 1 --2- 172.21.15.120:0/3419742681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc0814bea0 0x7fbc080b4e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80097a0 tx=0x7fbbf802b9f0 comp rx=0 tx=0).stop 2023-12-19T05:38:44.326 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.324+0000 7fbc0fb63640 1 -- 172.21.15.120:0/3419742681 shutdown_connections 2023-12-19T05:38:44.327 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.324+0000 7fbc0fb63640 1 --2- 172.21.15.120:0/3419742681 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc0814bea0 0x7fbc080b4e60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:44.327 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.324+0000 7fbc0fb63640 1 -- 172.21.15.120:0/3419742681 >> 172.21.15.120:0/3419742681 conn(0x7fbc080bad80 msgr2=0x7fbc080bb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:44.327 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.324+0000 7fbc0fb63640 1 -- 172.21.15.120:0/3419742681 shutdown_connections 2023-12-19T05:38:44.327 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.324+0000 7fbc0fb63640 1 -- 172.21.15.120:0/3419742681 wait complete. 2023-12-19T05:38:44.327 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.325+0000 7fbc0fb63640 1 Processor -- start 2023-12-19T05:38:44.327 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.325+0000 7fbc0fb63640 1 -- start start 2023-12-19T05:38:44.329 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0fb63640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc080b8c80 0x7fbc08142060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:44.329 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0fb63640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc080b9060 0x7fbc080bc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:44.329 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0fb63640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc0814bea0 0x7fbc081e13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:44.329 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0fb63640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc081425a0 con 0x7fbc0814bea0 2023-12-19T05:38:44.330 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0fb63640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc081df2b0 con 0x7fbc080b9060 2023-12-19T05:38:44.330 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0fb63640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc080bc340 con 0x7fbc080b8c80 2023-12-19T05:38:44.330 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0e100640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc0814bea0 0x7fbc081e13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:44.330 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0e100640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc0814bea0 0x7fbc081e13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43010/0 (socket says 172.21.15.120:43010) 2023-12-19T05:38:44.330 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0e100640 1 -- 172.21.15.120:0/25500257 learned_addr learned my addr 172.21.15.120:0/25500257 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:44.330 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0d8ff640 1 --2- 172.21.15.120:0/25500257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc080b8c80 0x7fbc08142060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:44.330 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0d0fe640 1 --2- 172.21.15.120:0/25500257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc080b9060 0x7fbc080bc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:44.330 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0e100640 1 -- 172.21.15.120:0/25500257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc080b8c80 msgr2=0x7fbc08142060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:44.330 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0e100640 1 --2- 172.21.15.120:0/25500257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc080b8c80 0x7fbc08142060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:44.330 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0e100640 1 -- 172.21.15.120:0/25500257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc080b9060 msgr2=0x7fbc080bc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:44.330 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0e100640 1 --2- 172.21.15.120:0/25500257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc080b9060 0x7fbc080bc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:44.330 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0e100640 1 -- 172.21.15.120:0/25500257 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf8009400 con 0x7fbc0814bea0 2023-12-19T05:38:44.330 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbc0e100640 1 --2- 172.21.15.120:0/25500257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc0814bea0 0x7fbc081e13b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000c7d0 tx=0x7fbc0000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:44.330 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.326+0000 7fbbfe7fc640 1 -- 172.21.15.120:0/25500257 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00003b70 con 0x7fbc0814bea0 2023-12-19T05:38:44.331 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.327+0000 7fbbfe7fc640 1 -- 172.21.15.120:0/25500257 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc00003cf0 con 0x7fbc0814bea0 2023-12-19T05:38:44.331 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.327+0000 7fbbfe7fc640 1 -- 172.21.15.120:0/25500257 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0000aa90 con 0x7fbc0814bea0 2023-12-19T05:38:44.331 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.327+0000 7fbc0fb63640 1 -- 172.21.15.120:0/25500257 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc080be530 con 0x7fbc0814bea0 2023-12-19T05:38:44.331 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.327+0000 7fbc0fb63640 1 -- 172.21.15.120:0/25500257 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc080be1c0 con 0x7fbc0814bea0 2023-12-19T05:38:44.331 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.328+0000 7fbc0fb63640 1 -- 172.21.15.120:0/25500257 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc08074080 con 0x7fbc0814bea0 2023-12-19T05:38:44.331 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.328+0000 7fbbfe7fc640 1 -- 172.21.15.120:0/25500257 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 4) v1 ==== 88551+0+0 (secure 0 0 0) 0x7fbc0000abf0 con 0x7fbc0814bea0 2023-12-19T05:38:44.331 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.328+0000 7fbbfe7fc640 1 --2- 172.21.15.120:0/25500257 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbbec06a3a0 0x7fbbec06c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:44.331 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.328+0000 7fbc0d8ff640 1 --2- 172.21.15.120:0/25500257 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbbec06a3a0 0x7fbbec06c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:44.331 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.328+0000 7fbbfe7fc640 1 -- 172.21.15.120:0/25500257 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fbc00087780 con 0x7fbc0814bea0 2023-12-19T05:38:44.332 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.329+0000 7fbc0d8ff640 1 --2- 172.21.15.120:0/25500257 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbbec06a3a0 0x7fbbec06c860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbc04007f70 tx=0x7fbc04007f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:44.333 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.333+0000 7fbbfe7fc640 1 -- 172.21.15.120:0/25500257 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbc00053c80 con 0x7fbc0814bea0 2023-12-19T05:38:44.502 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.501+0000 7fbc0fb63640 1 -- 172.21.15.120:0/25500257 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc080b32a0 con 0x7fbc0814bea0 2023-12-19T05:38:44.502 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.501+0000 7fbbfe7fc640 1 -- 172.21.15.120:0/25500257 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fbc00003e60 con 0x7fbc0814bea0 2023-12-19T05:38:44.503 INFO:teuthology.misc.health.smithi120.stdout: 2023-12-19T05:38:44.503 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":12,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:41.973712+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:38:44.505 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.503+0000 7fbc0fb63640 1 -- 172.21.15.120:0/25500257 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbbec06a3a0 msgr2=0x7fbbec06c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:44.505 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.503+0000 7fbc0fb63640 1 --2- 172.21.15.120:0/25500257 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbbec06a3a0 0x7fbbec06c860 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbc04007f70 tx=0x7fbc04007f00 comp rx=0 tx=0).stop 2023-12-19T05:38:44.505 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.503+0000 7fbc0fb63640 1 -- 172.21.15.120:0/25500257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc0814bea0 msgr2=0x7fbc081e13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:44.505 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.503+0000 7fbc0fb63640 1 --2- 172.21.15.120:0/25500257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc0814bea0 0x7fbc081e13b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbc0000c7d0 tx=0x7fbc0000cc90 comp rx=0 tx=0).stop 2023-12-19T05:38:44.505 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.503+0000 7fbc0fb63640 1 -- 172.21.15.120:0/25500257 shutdown_connections 2023-12-19T05:38:44.505 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.503+0000 7fbc0fb63640 1 --2- 172.21.15.120:0/25500257 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbbec06a3a0 0x7fbbec06c860 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:44.505 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.503+0000 7fbc0fb63640 1 --2- 172.21.15.120:0/25500257 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbc0814bea0 0x7fbc081e13b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:44.505 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.503+0000 7fbc0fb63640 1 --2- 172.21.15.120:0/25500257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc080b9060 0x7fbc080bc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:44.505 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.503+0000 7fbc0fb63640 1 --2- 172.21.15.120:0/25500257 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbc080b8c80 0x7fbc08142060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:44.505 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.503+0000 7fbc0fb63640 1 -- 172.21.15.120:0/25500257 >> 172.21.15.120:0/25500257 conn(0x7fbc080bad80 msgr2=0x7fbc08147cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:44.505 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.503+0000 7fbc0fb63640 1 -- 172.21.15.120:0/25500257 shutdown_connections 2023-12-19T05:38:44.505 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:44.503+0000 7fbc0fb63640 1 -- 172.21.15.120:0/25500257 wait complete. 2023-12-19T05:38:44.513 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T05:38:51.321 DEBUG:teuthology.orchestra.run.smithi120:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T05:38:51.418 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.417+0000 7fe91c2d2640 1 Processor -- start 2023-12-19T05:38:51.418 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.417+0000 7fe91c2d2640 1 -- start start 2023-12-19T05:38:51.419 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91c2d2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe9140b90f0 0x7fe9140b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:51.419 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91c2d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9141446c0 0x7fe914144b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:51.419 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91c2d2640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9140b7e10 con 0x7fe9140bc980 2023-12-19T05:38:51.420 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91c2d2640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9140b9c70 con 0x7fe9140b90f0 2023-12-19T05:38:51.420 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91c2d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9140b7b30 con 0x7fe9141446c0 2023-12-19T05:38:51.420 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91a06e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe9140b90f0 0x7fe9140b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:51.420 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91986d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe9140bc980 0x7fe91414b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:60462/0 (socket says 172.21.15.120:60462) 2023-12-19T05:38:51.420 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91986d640 1 -- 172.21.15.120:0/2386561310 learned_addr learned my addr 172.21.15.120:0/2386561310 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:38:51.420 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91a86f640 1 --2- 172.21.15.120:0/2386561310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9141446c0 0x7fe914144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:51.420 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91906c640 1 -- 172.21.15.120:0/2386561310 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3579126108 0 0) 0x7fe9140b7e10 con 0x7fe9140bc980 2023-12-19T05:38:51.420 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91906c640 1 -- 172.21.15.120:0/2386561310 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe900003520 con 0x7fe9140bc980 2023-12-19T05:38:51.420 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91a06e640 1 -- 172.21.15.120:0/2386561310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9141446c0 msgr2=0x7fe914144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:51.420 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91a06e640 1 --2- 172.21.15.120:0/2386561310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9141446c0 0x7fe914144b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.420 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91a06e640 1 -- 172.21.15.120:0/2386561310 >> v1:172.21.15.120:6789/0 conn(0x7fe9140bc980 legacy=0x7fe91414b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:51.420 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91a06e640 1 -- 172.21.15.120:0/2386561310 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91414acf0 con 0x7fe9140b90f0 2023-12-19T05:38:51.420 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.418+0000 7fe91a86f640 1 --2- 172.21.15.120:0/2386561310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9141446c0 0x7fe914144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:38:51.422 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.419+0000 7fe91a06e640 1 --2- 172.21.15.120:0/2386561310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9140b90f0 0x7fe9140b94d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe9100097a0 tx=0x7fe91002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8995c9376b4879c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:51.422 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.419+0000 7fe91906c640 1 -- 172.21.15.120:0/2386561310 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910031830 con 0x7fe9140b90f0 2023-12-19T05:38:51.422 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.419+0000 7fe91906c640 1 -- 172.21.15.120:0/2386561310 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe910031990 con 0x7fe9140b90f0 2023-12-19T05:38:51.422 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.419+0000 7fe91906c640 1 -- 172.21.15.120:0/2386561310 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910031d20 con 0x7fe9140b90f0 2023-12-19T05:38:51.422 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.420+0000 7fe91c2d2640 1 -- 172.21.15.120:0/2386561310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9140b90f0 msgr2=0x7fe9140b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:51.422 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.420+0000 7fe91c2d2640 1 --2- 172.21.15.120:0/2386561310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9140b90f0 0x7fe9140b94d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe9100097a0 tx=0x7fe91002b8d0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.423 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.420+0000 7fe91c2d2640 1 -- 172.21.15.120:0/2386561310 shutdown_connections 2023-12-19T05:38:51.423 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.420+0000 7fe91c2d2640 1 --2- 172.21.15.120:0/2386561310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9141446c0 0x7fe914144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.423 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.420+0000 7fe91c2d2640 1 --2- 172.21.15.120:0/2386561310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9140b90f0 0x7fe9140b94d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.423 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.420+0000 7fe91c2d2640 1 -- 172.21.15.120:0/2386561310 >> 172.21.15.120:0/2386561310 conn(0x7fe9140c03e0 msgr2=0x7fe9140c07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:51.423 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.420+0000 7fe91c2d2640 1 -- 172.21.15.120:0/2386561310 shutdown_connections 2023-12-19T05:38:51.423 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.420+0000 7fe91c2d2640 1 -- 172.21.15.120:0/2386561310 wait complete. 2023-12-19T05:38:51.423 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.421+0000 7fe91c2d2640 1 Processor -- start 2023-12-19T05:38:51.423 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.421+0000 7fe91c2d2640 1 -- start start 2023-12-19T05:38:51.425 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.421+0000 7fe91c2d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9140b90f0 0x7fe91414e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:51.425 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.421+0000 7fe91c2d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9140bc980 0x7fe9141e3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:51.425 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.421+0000 7fe91c2d2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9141446c0 0x7fe914147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:51.425 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.421+0000 7fe91c2d2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe914148470 con 0x7fe9141446c0 2023-12-19T05:38:51.425 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.421+0000 7fe91c2d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9141e37c0 con 0x7fe9140b90f0 2023-12-19T05:38:51.425 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.421+0000 7fe91c2d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9141e31e0 con 0x7fe9140bc980 2023-12-19T05:38:51.425 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.421+0000 7fe91a86f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9141446c0 0x7fe914147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:51.425 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.421+0000 7fe91a86f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9141446c0 0x7fe914147f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43062/0 (socket says 172.21.15.120:43062) 2023-12-19T05:38:51.425 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.422+0000 7fe91a86f640 1 -- 172.21.15.120:0/53037165 learned_addr learned my addr 172.21.15.120:0/53037165 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.422+0000 7fe91986d640 1 --2- 172.21.15.120:0/53037165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9140bc980 0x7fe9141e3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.422+0000 7fe91a86f640 1 -- 172.21.15.120:0/53037165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9140bc980 msgr2=0x7fe9141e3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.422+0000 7fe91a06e640 1 --2- 172.21.15.120:0/53037165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9140b90f0 0x7fe91414e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.422+0000 7fe91a86f640 1 --2- 172.21.15.120:0/53037165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9140bc980 0x7fe9141e3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.422+0000 7fe91a86f640 1 -- 172.21.15.120:0/53037165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9140b90f0 msgr2=0x7fe91414e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.422+0000 7fe91a86f640 1 --2- 172.21.15.120:0/53037165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9140b90f0 0x7fe91414e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.422+0000 7fe91a86f640 1 -- 172.21.15.120:0/53037165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910009400 con 0x7fe9141446c0 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.422+0000 7fe91a86f640 1 --2- 172.21.15.120:0/53037165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9141446c0 0x7fe914147f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe90c007ed0 tx=0x7fe90c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.422+0000 7fe90affd640 1 -- 172.21.15.120:0/53037165 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c00dee0 con 0x7fe9141446c0 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.422+0000 7fe90affd640 1 -- 172.21.15.120:0/53037165 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c00f040 con 0x7fe9141446c0 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.422+0000 7fe91c2d2640 1 -- 172.21.15.120:0/53037165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9141e3450 con 0x7fe9141446c0 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.422+0000 7fe90affd640 1 -- 172.21.15.120:0/53037165 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c003df0 con 0x7fe9141446c0 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.422+0000 7fe91c2d2640 1 -- 172.21.15.120:0/53037165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe914147bc0 con 0x7fe9141446c0 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.423+0000 7fe91c2d2640 1 -- 172.21.15.120:0/53037165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9140740b0 con 0x7fe9141446c0 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.423+0000 7fe90affd640 1 -- 172.21.15.120:0/53037165 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe90c004030 con 0x7fe9141446c0 2023-12-19T05:38:51.426 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.424+0000 7fe90affd640 1 --2- 172.21.15.120:0/53037165 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe8f806a430 0x7fe8f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:51.427 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.424+0000 7fe90affd640 1 -- 172.21.15.120:0/53037165 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe90c088820 con 0x7fe9141446c0 2023-12-19T05:38:51.427 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.424+0000 7fe91a06e640 1 --2- 172.21.15.120:0/53037165 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe8f806a430 0x7fe8f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:51.427 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.424+0000 7fe91a06e640 1 --2- 172.21.15.120:0/53037165 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe8f806a430 0x7fe8f806c8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe910036000 tx=0x7fe910008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:51.429 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.428+0000 7fe90affd640 1 -- 172.21.15.120:0/53037165 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe90c0541f0 con 0x7fe9141446c0 2023-12-19T05:38:51.595 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.594+0000 7fe91c2d2640 1 -- 172.21.15.120:0/53037165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9141e3900 con 0x7fe9141446c0 2023-12-19T05:38:51.596 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.595+0000 7fe90affd640 1 -- 172.21.15.120:0/53037165 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7fe90c01a090 con 0x7fe9141446c0 2023-12-19T05:38:51.596 INFO:teuthology.misc.health.smithi120.stdout: 2023-12-19T05:38:51.596 INFO:teuthology.misc.health.smithi120.stdout:{"epoch":16,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:48.037656+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:38:51.598 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.596+0000 7fe91c2d2640 1 -- 172.21.15.120:0/53037165 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe8f806a430 msgr2=0x7fe8f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:51.598 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.596+0000 7fe91c2d2640 1 --2- 172.21.15.120:0/53037165 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe8f806a430 0x7fe8f806c8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe910036000 tx=0x7fe910008030 comp rx=0 tx=0).stop 2023-12-19T05:38:51.598 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.596+0000 7fe91c2d2640 1 -- 172.21.15.120:0/53037165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9141446c0 msgr2=0x7fe914147f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:51.598 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.596+0000 7fe91c2d2640 1 --2- 172.21.15.120:0/53037165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9141446c0 0x7fe914147f30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe90c007ed0 tx=0x7fe90c00d4a0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.598 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.597+0000 7fe91c2d2640 1 -- 172.21.15.120:0/53037165 shutdown_connections 2023-12-19T05:38:51.598 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.597+0000 7fe91c2d2640 1 --2- 172.21.15.120:0/53037165 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe8f806a430 0x7fe8f806c8f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.599 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.597+0000 7fe91c2d2640 1 --2- 172.21.15.120:0/53037165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe9141446c0 0x7fe914147f30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.599 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.597+0000 7fe91c2d2640 1 --2- 172.21.15.120:0/53037165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe9140bc980 0x7fe9141e3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.599 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.597+0000 7fe91c2d2640 1 --2- 172.21.15.120:0/53037165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe9140b90f0 0x7fe91414e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.599 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.597+0000 7fe91c2d2640 1 -- 172.21.15.120:0/53037165 >> 172.21.15.120:0/53037165 conn(0x7fe9140c03e0 msgr2=0x7fe914142190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:51.599 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.597+0000 7fe91c2d2640 1 -- 172.21.15.120:0/53037165 shutdown_connections 2023-12-19T05:38:51.599 INFO:teuthology.misc.health.smithi120.stderr:2023-12-19T05:38:51.597+0000 7fe91c2d2640 1 -- 172.21.15.120:0/53037165 wait complete. 2023-12-19T05:38:51.607 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-19T05:38:51.607 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-19T05:38:51.608 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T05:38:51.608 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T05:38:51.610 INFO:tasks.ceph.mds.a:Started 2023-12-19T05:38:51.610 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T05:38:51.610 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T05:38:51.612 INFO:tasks.ceph.mds.c:Started 2023-12-19T05:38:51.612 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T05:38:51.612 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T05:38:51.614 INFO:tasks.ceph.mds.b:Started 2023-12-19T05:38:51.615 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-19T05:38:51.615 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:38:51.686 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2023-12-19T05:38:51.686 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2023-12-19T05:38:51.699 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-12-19T05:38:51.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.719+0000 7f85ecf77640 1 Processor -- start 2023-12-19T05:38:51.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.719+0000 7f85ecf77640 1 -- start start 2023-12-19T05:38:51.723 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85ecf77640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f85e806b080 0x7f85e8071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:51.724 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85ecf77640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e8070c30 0x7f85e81415e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:51.724 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85ecf77640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f85e81477d0 0x7f85e8141b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:51.724 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85ecf77640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e80b9450 con 0x7f85e81477d0 2023-12-19T05:38:51.724 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85e6d9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f85e81477d0 0x7f85e8141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:51.724 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85ecf77640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e8070830 con 0x7f85e806b080 2023-12-19T05:38:51.724 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85ecf77640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e8071950 con 0x7f85e8070c30 2023-12-19T05:38:51.724 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85e6d9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f85e81477d0 0x7f85e8141b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48296/0 (socket says 172.21.15.120:48296) 2023-12-19T05:38:51.724 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85e6d9d640 1 -- 172.21.15.120:0/54269216 learned_addr learned my addr 172.21.15.120:0/54269216 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:51.724 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85e659c640 1 --2- 172.21.15.120:0/54269216 >> v2:172.21.15.155:3300/0 conn(0x7f85e806b080 0x7f85e8071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:51.724 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85e5d9b640 1 --2- 172.21.15.120:0/54269216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e8070c30 0x7f85e81415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:51.724 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85e6d9d640 1 -- 172.21.15.120:0/54269216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e8070c30 msgr2=0x7f85e81415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:51.724 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85e6d9d640 1 --2- 172.21.15.120:0/54269216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e8070c30 0x7f85e81415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.725 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85e6d9d640 1 -- 172.21.15.120:0/54269216 >> v2:172.21.15.155:3300/0 conn(0x7f85e806b080 msgr2=0x7f85e8071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:51.725 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85e6d9d640 1 --2- 172.21.15.120:0/54269216 >> v2:172.21.15.155:3300/0 conn(0x7f85e806b080 0x7f85e8071410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.725 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.720+0000 7f85e6d9d640 1 -- 172.21.15.120:0/54269216 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e806ff80 con 0x7f85e81477d0 2023-12-19T05:38:51.725 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.721+0000 7f85e6d9d640 1 --2- 172.21.15.120:0/54269216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e81477d0 0x7f85e8141b20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f85e80b8c80 tx=0x7f85e002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d7d88c86352527 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:51.725 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.721+0000 7f85e559a640 1 -- 172.21.15.120:0/54269216 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e002cb00 con 0x7f85e81477d0 2023-12-19T05:38:51.725 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.721+0000 7f85e559a640 1 -- 172.21.15.120:0/54269216 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e002cc60 con 0x7f85e81477d0 2023-12-19T05:38:51.725 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.721+0000 7f85e559a640 1 -- 172.21.15.120:0/54269216 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00343f0 con 0x7f85e81477d0 2023-12-19T05:38:51.725 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.722+0000 7f85ecf77640 1 -- 172.21.15.120:0/54269216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e81477d0 msgr2=0x7f85e8141b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:51.725 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.722+0000 7f85ecf77640 1 --2- 172.21.15.120:0/54269216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e81477d0 0x7f85e8141b20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f85e80b8c80 tx=0x7f85e002bf60 comp rx=0 tx=0).stop 2023-12-19T05:38:51.725 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.722+0000 7f85ecf77640 1 -- 172.21.15.120:0/54269216 shutdown_connections 2023-12-19T05:38:51.725 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.722+0000 7f85ecf77640 1 --2- 172.21.15.120:0/54269216 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e81477d0 0x7f85e8141b20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.725 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.722+0000 7f85ecf77640 1 --2- 172.21.15.120:0/54269216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e8070c30 0x7f85e81415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.726 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.722+0000 7f85ecf77640 1 --2- 172.21.15.120:0/54269216 >> v2:172.21.15.155:3300/0 conn(0x7f85e806b080 0x7f85e8071410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.726 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.722+0000 7f85ecf77640 1 -- 172.21.15.120:0/54269216 >> 172.21.15.120:0/54269216 conn(0x7f85e80bcfd0 msgr2=0x7f85e80bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:51.726 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.722+0000 7f85ecf77640 1 -- 172.21.15.120:0/54269216 shutdown_connections 2023-12-19T05:38:51.726 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.722+0000 7f85ecf77640 1 -- 172.21.15.120:0/54269216 wait complete. 2023-12-19T05:38:51.730 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.723+0000 7f85ecf77640 1 Processor -- start 2023-12-19T05:38:51.730 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.723+0000 7f85ecf77640 1 -- start start 2023-12-19T05:38:51.730 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85ecf77640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85e806b080 0x7f85e80bc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:51.730 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85ecf77640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e8070c30 0x7f85e81371f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:51.730 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85ecf77640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e81477d0 0x7f85e81e10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:51.730 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85ecf77640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80bcda0 con 0x7f85e81477d0 2023-12-19T05:38:51.730 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85ecf77640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e81459e0 con 0x7f85e806b080 2023-12-19T05:38:51.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85ecf77640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80b69d0 con 0x7f85e8070c30 2023-12-19T05:38:51.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85e659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85e806b080 0x7f85e80bc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:51.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85e5d9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e8070c30 0x7f85e81371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:51.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85e659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85e806b080 0x7f85e80bc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:49188/0 (socket says 172.21.15.120:49188) 2023-12-19T05:38:51.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85e6d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e81477d0 0x7f85e81e10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:51.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85e659c640 1 -- 172.21.15.120:0/3999639638 learned_addr learned my addr 172.21.15.120:0/3999639638 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:51.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85e6d9d640 1 -- 172.21.15.120:0/3999639638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e8070c30 msgr2=0x7f85e81371f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:51.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85e6d9d640 1 --2- 172.21.15.120:0/3999639638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e8070c30 0x7f85e81371f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85e6d9d640 1 -- 172.21.15.120:0/3999639638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85e806b080 msgr2=0x7f85e80bc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:51.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85e6d9d640 1 --2- 172.21.15.120:0/3999639638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85e806b080 0x7f85e80bc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85e6d9d640 1 -- 172.21.15.120:0/3999639638 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0009b30 con 0x7f85e81477d0 2023-12-19T05:38:51.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85e659c640 1 --2- 172.21.15.120:0/3999639638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85e806b080 0x7f85e80bc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:51.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85e6d9d640 1 --2- 172.21.15.120:0/3999639638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e81477d0 0x7f85e81e10c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f85e0032000 tx=0x7f85e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:51.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85deffd640 1 -- 172.21.15.120:0/3999639638 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0009510 con 0x7f85e81477d0 2023-12-19T05:38:51.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85deffd640 1 -- 172.21.15.120:0/3999639638 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e003e450 con 0x7f85e81477d0 2023-12-19T05:38:51.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85ecf77640 1 -- 172.21.15.120:0/3999639638 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e8145670 con 0x7f85e81477d0 2023-12-19T05:38:51.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85deffd640 1 -- 172.21.15.120:0/3999639638 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e003e800 con 0x7f85e81477d0 2023-12-19T05:38:51.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.724+0000 7f85ecf77640 1 -- 172.21.15.120:0/3999639638 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e80b6cb0 con 0x7f85e81477d0 2023-12-19T05:38:51.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.725+0000 7f85ecf77640 1 -- 172.21.15.120:0/3999639638 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e80b6b10 con 0x7f85e81477d0 2023-12-19T05:38:51.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.726+0000 7f85deffd640 1 -- 172.21.15.120:0/3999639638 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f85e003e960 con 0x7f85e81477d0 2023-12-19T05:38:51.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.726+0000 7f85deffd640 1 --2- 172.21.15.120:0/3999639638 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f85c806a430 0x7f85c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:51.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.726+0000 7f85e659c640 1 --2- 172.21.15.120:0/3999639638 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f85c806a430 0x7f85c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:51.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.727+0000 7f85deffd640 1 -- 172.21.15.120:0/3999639638 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f85e00ab070 con 0x7f85e81477d0 2023-12-19T05:38:51.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.727+0000 7f85e659c640 1 --2- 172.21.15.120:0/3999639638 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f85c806a430 0x7f85c806c8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009f70 tx=0x7f85d8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:51.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.731+0000 7f85deffd640 1 -- 172.21.15.120:0/3999639638 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f85e80b6b10 con 0x7f85e81477d0 2023-12-19T05:38:51.899 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.898+0000 7f85ecf77640 1 -- 172.21.15.120:0/3999639638 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85e80b6b10 con 0x7f85e81477d0 2023-12-19T05:38:51.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.899+0000 7f85deffd640 1 -- 172.21.15.120:0/3999639638 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f85e80b6b10 con 0x7f85e81477d0 2023-12-19T05:38:51.900 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:38:51.900 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":16,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:48.037656+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:38:51.902 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.901+0000 7f85ecf77640 1 -- 172.21.15.120:0/3999639638 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f85c806a430 msgr2=0x7f85c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:51.902 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.901+0000 7f85ecf77640 1 --2- 172.21.15.120:0/3999639638 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f85c806a430 0x7f85c806c8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009f70 tx=0x7f85d8009190 comp rx=0 tx=0).stop 2023-12-19T05:38:51.902 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.901+0000 7f85ecf77640 1 -- 172.21.15.120:0/3999639638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e81477d0 msgr2=0x7f85e81e10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:51.902 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.901+0000 7f85ecf77640 1 --2- 172.21.15.120:0/3999639638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e81477d0 0x7f85e81e10c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f85e0032000 tx=0x7f85e0004a40 comp rx=0 tx=0).stop 2023-12-19T05:38:51.902 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.901+0000 7f85ecf77640 1 -- 172.21.15.120:0/3999639638 shutdown_connections 2023-12-19T05:38:51.902 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.901+0000 7f85ecf77640 1 --2- 172.21.15.120:0/3999639638 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f85c806a430 0x7f85c806c8f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.903 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.901+0000 7f85ecf77640 1 --2- 172.21.15.120:0/3999639638 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f85e81477d0 0x7f85e81e10c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.903 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.901+0000 7f85ecf77640 1 --2- 172.21.15.120:0/3999639638 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f85e8070c30 0x7f85e81371f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.903 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.901+0000 7f85ecf77640 1 --2- 172.21.15.120:0/3999639638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f85e806b080 0x7f85e80bc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:51.903 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.901+0000 7f85ecf77640 1 -- 172.21.15.120:0/3999639638 >> 172.21.15.120:0/3999639638 conn(0x7f85e80bcfd0 msgr2=0x7f85e813ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:51.903 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.901+0000 7f85ecf77640 1 -- 172.21.15.120:0/3999639638 shutdown_connections 2023-12-19T05:38:51.903 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:51.901+0000 7f85ecf77640 1 -- 172.21.15.120:0/3999639638 wait complete. 2023-12-19T05:38:51.912 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:45.976868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:38:51.913 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:38:52.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.013+0000 7f45c81d2640 1 Processor -- start 2023-12-19T05:38:52.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.013+0000 7f45c81d2640 1 -- start start 2023-12-19T05:38:52.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c81d2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f45c0144d70 0x7f45c00b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:52.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c81d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014df70 0x7f45c00b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:52.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c81d2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f45c00bc7e0 0x7f45c00bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:52.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c81d2640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c00b9f00 con 0x7f45c0144d70 2023-12-19T05:38:52.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c81d2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c00b84b0 con 0x7f45c00bc7e0 2023-12-19T05:38:52.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c81d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c0145150 con 0x7f45c014df70 2023-12-19T05:38:52.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c5f6e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f45c0144d70 0x7f45c00b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:52.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c5f6e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f45c0144d70 0x7f45c00b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48310/0 (socket says 172.21.15.120:48310) 2023-12-19T05:38:52.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c5f6e640 1 -- 172.21.15.120:0/4038879176 learned_addr learned my addr 172.21.15.120:0/4038879176 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:52.017 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c676f640 1 --2- 172.21.15.120:0/4038879176 >> v2:172.21.15.155:3300/0 conn(0x7f45c00bc7e0 0x7f45c00bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:52.017 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c576d640 1 --2- 172.21.15.120:0/4038879176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014df70 0x7f45c00b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:52.017 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c5f6e640 1 -- 172.21.15.120:0/4038879176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014df70 msgr2=0x7f45c00b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:52.017 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c5f6e640 1 --2- 172.21.15.120:0/4038879176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014df70 0x7f45c00b8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.017 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c5f6e640 1 -- 172.21.15.120:0/4038879176 >> v2:172.21.15.155:3300/0 conn(0x7f45c00bc7e0 msgr2=0x7f45c00bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:52.017 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c5f6e640 1 --2- 172.21.15.120:0/4038879176 >> v2:172.21.15.155:3300/0 conn(0x7f45c00bc7e0 0x7f45c00bcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.017 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.014+0000 7f45c5f6e640 1 -- 172.21.15.120:0/4038879176 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c00b9080 con 0x7f45c0144d70 2023-12-19T05:38:52.017 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.015+0000 7f45c5f6e640 1 --2- 172.21.15.120:0/4038879176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c0144d70 0x7f45c00b7f70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f45c00b6b90 tx=0x7f45bc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec4045e92e90365 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:52.017 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.015+0000 7f45c4f6c640 1 -- 172.21.15.120:0/4038879176 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc030840 con 0x7f45c0144d70 2023-12-19T05:38:52.017 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.015+0000 7f45c4f6c640 1 -- 172.21.15.120:0/4038879176 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45bc0309a0 con 0x7f45c0144d70 2023-12-19T05:38:52.017 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.015+0000 7f45c4f6c640 1 -- 172.21.15.120:0/4038879176 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45bc030d30 con 0x7f45c0144d70 2023-12-19T05:38:52.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.016+0000 7f45c81d2640 1 -- 172.21.15.120:0/4038879176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c0144d70 msgr2=0x7f45c00b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:52.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.016+0000 7f45c81d2640 1 --2- 172.21.15.120:0/4038879176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c0144d70 0x7f45c00b7f70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f45c00b6b90 tx=0x7f45bc02b980 comp rx=0 tx=0).stop 2023-12-19T05:38:52.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.016+0000 7f45c81d2640 1 -- 172.21.15.120:0/4038879176 shutdown_connections 2023-12-19T05:38:52.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.016+0000 7f45c81d2640 1 --2- 172.21.15.120:0/4038879176 >> v2:172.21.15.155:3300/0 conn(0x7f45c00bc7e0 0x7f45c00bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.016+0000 7f45c81d2640 1 --2- 172.21.15.120:0/4038879176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014df70 0x7f45c00b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.016+0000 7f45c81d2640 1 --2- 172.21.15.120:0/4038879176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c0144d70 0x7f45c00b7f70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.016+0000 7f45c81d2640 1 -- 172.21.15.120:0/4038879176 >> 172.21.15.120:0/4038879176 conn(0x7f45c0071430 msgr2=0x7f45c0071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:52.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.016+0000 7f45c81d2640 1 -- 172.21.15.120:0/4038879176 shutdown_connections 2023-12-19T05:38:52.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.016+0000 7f45c81d2640 1 -- 172.21.15.120:0/4038879176 wait complete. 2023-12-19T05:38:52.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.017+0000 7f45c81d2640 1 Processor -- start 2023-12-19T05:38:52.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.017+0000 7f45c81d2640 1 -- start start 2023-12-19T05:38:52.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.017+0000 7f45c81d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c00bc7e0 0x7f45c00be5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:52.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.017+0000 7f45c81d2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c0144d70 0x7f45c00b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:52.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.017+0000 7f45c81d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014df70 0x7f45c01dfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:52.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.017+0000 7f45c81d2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00beb10 con 0x7f45c0144d70 2023-12-19T05:38:52.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.017+0000 7f45c81d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00b11d0 con 0x7f45c00bc7e0 2023-12-19T05:38:52.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.017+0000 7f45c81d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c00c0530 con 0x7f45c014df70 2023-12-19T05:38:52.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.017+0000 7f45c576d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c0144d70 0x7f45c00b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:52.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.017+0000 7f45c576d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c0144d70 0x7f45c00b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48320/0 (socket says 172.21.15.120:48320) 2023-12-19T05:38:52.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45c576d640 1 -- 172.21.15.120:0/4249051491 learned_addr learned my addr 172.21.15.120:0/4249051491 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:52.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45c5f6e640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c00bc7e0 0x7f45c00be5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:52.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45c676f640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014df70 0x7f45c01dfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:52.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45c576d640 1 -- 172.21.15.120:0/4249051491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014df70 msgr2=0x7f45c01dfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:52.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45c576d640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014df70 0x7f45c01dfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45c576d640 1 -- 172.21.15.120:0/4249051491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c00bc7e0 msgr2=0x7f45c00be5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:52.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45c576d640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c00bc7e0 0x7f45c00be5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45c576d640 1 -- 172.21.15.120:0/4249051491 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc0094d0 con 0x7f45c0144d70 2023-12-19T05:38:52.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45c5f6e640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c00bc7e0 0x7f45c00be5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:52.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45c676f640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014df70 0x7f45c01dfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:52.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45c576d640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c0144d70 0x7f45c00b1680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45b000d5f0 tx=0x7f45b000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:52.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45b67fc640 1 -- 172.21.15.120:0/4249051491 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b00125f0 con 0x7f45c0144d70 2023-12-19T05:38:52.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45b67fc640 1 -- 172.21.15.120:0/4249051491 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b0012750 con 0x7f45c0144d70 2023-12-19T05:38:52.023 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45b67fc640 1 -- 172.21.15.120:0/4249051491 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b0012b00 con 0x7f45c0144d70 2023-12-19T05:38:52.023 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45c81d2640 1 -- 172.21.15.120:0/4249051491 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c00c0810 con 0x7f45c0144d70 2023-12-19T05:38:52.023 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.018+0000 7f45c81d2640 1 -- 172.21.15.120:0/4249051491 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c00c0fb0 con 0x7f45c0144d70 2023-12-19T05:38:52.023 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.019+0000 7f45c81d2640 1 -- 172.21.15.120:0/4249051491 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c0071d40 con 0x7f45c0144d70 2023-12-19T05:38:52.023 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.019+0000 7f45b67fc640 1 -- 172.21.15.120:0/4249051491 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f45b0012c60 con 0x7f45c0144d70 2023-12-19T05:38:52.023 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.020+0000 7f45b67fc640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f45a406a460 0x7f45a406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:52.024 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.020+0000 7f45c5f6e640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f45a406a460 0x7f45a406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:52.024 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.020+0000 7f45b67fc640 1 -- 172.21.15.120:0/4249051491 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f45b00889f0 con 0x7f45c0144d70 2023-12-19T05:38:52.024 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.020+0000 7f45c5f6e640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f45a406a460 0x7f45a406c920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45bc036000 tx=0x7f45bc03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:52.025 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.024+0000 7f45b67fc640 1 -- 172.21.15.120:0/4249051491 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f45b0054330 con 0x7f45c0144d70 2023-12-19T05:38:52.191 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.190+0000 7f45c81d2640 1 -- 172.21.15.120:0/4249051491 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45c00b1310 con 0x7f45c0144d70 2023-12-19T05:38:52.191 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.190+0000 7f45b67fc640 1 -- 172.21.15.120:0/4249051491 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f45c00b1310 con 0x7f45c0144d70 2023-12-19T05:38:52.191 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2023-12-19T05:38:52.193 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.192+0000 7f45c81d2640 1 -- 172.21.15.120:0/4249051491 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f45a406a460 msgr2=0x7f45a406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:52.193 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.192+0000 7f45c81d2640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f45a406a460 0x7f45a406c920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f45bc036000 tx=0x7f45bc03b040 comp rx=0 tx=0).stop 2023-12-19T05:38:52.193 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.192+0000 7f45c81d2640 1 -- 172.21.15.120:0/4249051491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c0144d70 msgr2=0x7f45c00b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:52.193 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.192+0000 7f45c81d2640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c0144d70 0x7f45c00b1680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f45b000d5f0 tx=0x7f45b000dab0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.193 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.192+0000 7f45c81d2640 1 -- 172.21.15.120:0/4249051491 shutdown_connections 2023-12-19T05:38:52.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.192+0000 7f45c81d2640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f45a406a460 0x7f45a406c920 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.192+0000 7f45c81d2640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f45c014df70 0x7f45c01dfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.192+0000 7f45c81d2640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45c0144d70 0x7f45c00b1680 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.192+0000 7f45c81d2640 1 --2- 172.21.15.120:0/4249051491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c00bc7e0 0x7f45c00be5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.192+0000 7f45c81d2640 1 -- 172.21.15.120:0/4249051491 >> 172.21.15.120:0/4249051491 conn(0x7f45c0071430 msgr2=0x7f45c014d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:52.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.192+0000 7f45c81d2640 1 -- 172.21.15.120:0/4249051491 shutdown_connections 2023-12-19T05:38:52.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.192+0000 7f45c81d2640 1 -- 172.21.15.120:0/4249051491 wait complete. 2023-12-19T05:38:52.204 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:38:52.302 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.301+0000 7f3764a4c640 1 Processor -- start 2023-12-19T05:38:52.303 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.301+0000 7f3764a4c640 1 -- start start 2023-12-19T05:38:52.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.302+0000 7f3764a4c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f376006da70 0x7f37601429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:52.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.302+0000 7f3764a4c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3760142ee0 0x7f37600b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:52.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.302+0000 7f3764a4c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376006e690 con 0x7f37600b4e30 2023-12-19T05:38:52.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.302+0000 7f3764a4c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376006ebc0 con 0x7f3760142ee0 2023-12-19T05:38:52.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.302+0000 7f3764a4c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37600b3db0 con 0x7f376006da70 2023-12-19T05:38:52.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.302+0000 7f375dd9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3760142ee0 0x7f37600b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:52.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.302+0000 7f375dd9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3760142ee0 0x7f37600b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48324/0 (socket says 172.21.15.120:48324) 2023-12-19T05:38:52.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.302+0000 7f375dd9b640 1 -- 172.21.15.120:0/2957944576 learned_addr learned my addr 172.21.15.120:0/2957944576 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:52.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.302+0000 7f375e59c640 1 --2- 172.21.15.120:0/2957944576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f376006da70 0x7f37601429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:52.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.303+0000 7f375dd9b640 1 -- 172.21.15.120:0/2957944576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f376006da70 msgr2=0x7f37601429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:52.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.303+0000 7f375dd9b640 1 --2- 172.21.15.120:0/2957944576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f376006da70 0x7f37601429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.303+0000 7f375dd9b640 1 -- 172.21.15.120:0/2957944576 >> v1:172.21.15.155:6789/0 conn(0x7f37600b4e30 legacy=0x7f376014bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:52.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.303+0000 7f375dd9b640 1 -- 172.21.15.120:0/2957944576 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37600b9f60 con 0x7f3760142ee0 2023-12-19T05:38:52.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.303+0000 7f375dd9b640 1 --2- 172.21.15.120:0/2957944576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3760142ee0 0x7f37600b3090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3754009e50 tx=0x7f375402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96067566ac1edd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:52.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.303+0000 7f375d59a640 1 -- 172.21.15.120:0/2957944576 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375402ca70 con 0x7f3760142ee0 2023-12-19T05:38:52.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.303+0000 7f375d59a640 1 -- 172.21.15.120:0/2957944576 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375402cbd0 con 0x7f3760142ee0 2023-12-19T05:38:52.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.303+0000 7f375d59a640 1 -- 172.21.15.120:0/2957944576 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540343f0 con 0x7f3760142ee0 2023-12-19T05:38:52.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.304+0000 7f3764a4c640 1 -- 172.21.15.120:0/2957944576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3760142ee0 msgr2=0x7f37600b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:52.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.304+0000 7f3764a4c640 1 --2- 172.21.15.120:0/2957944576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3760142ee0 0x7f37600b3090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3754009e50 tx=0x7f375402bed0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.304+0000 7f3764a4c640 1 -- 172.21.15.120:0/2957944576 shutdown_connections 2023-12-19T05:38:52.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.304+0000 7f3764a4c640 1 --2- 172.21.15.120:0/2957944576 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3760142ee0 0x7f37600b3090 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.304+0000 7f3764a4c640 1 --2- 172.21.15.120:0/2957944576 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f376006da70 0x7f37601429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.304+0000 7f3764a4c640 1 -- 172.21.15.120:0/2957944576 >> 172.21.15.120:0/2957944576 conn(0x7f37600bac10 msgr2=0x7f37600bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:52.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.304+0000 7f3764a4c640 1 -- 172.21.15.120:0/2957944576 shutdown_connections 2023-12-19T05:38:52.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.304+0000 7f3764a4c640 1 -- 172.21.15.120:0/2957944576 wait complete. 2023-12-19T05:38:52.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.305+0000 7f3764a4c640 1 Processor -- start 2023-12-19T05:38:52.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.305+0000 7f3764a4c640 1 -- start start 2023-12-19T05:38:52.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f3764a4c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f376006da70 0x7f3760149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:52.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f3764a4c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37600b4e30 0x7f37601473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:52.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f3764a4c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3760142ee0 0x7f37601480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:52.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f3764a4c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3760146f60 con 0x7f37600b4e30 2023-12-19T05:38:52.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f3764a4c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37601434f0 con 0x7f3760142ee0 2023-12-19T05:38:52.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f3764a4c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3760148b50 con 0x7f376006da70 2023-12-19T05:38:52.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f375dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37600b4e30 0x7f37601473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:52.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f375dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37600b4e30 0x7f37601473f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48340/0 (socket says 172.21.15.120:48340) 2023-12-19T05:38:52.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f375dd9b640 1 -- 172.21.15.120:0/3924478548 learned_addr learned my addr 172.21.15.120:0/3924478548 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:52.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f375e59c640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f376006da70 0x7f3760149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:52.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f375ed9d640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3760142ee0 0x7f37601480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:52.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f375dd9b640 1 -- 172.21.15.120:0/3924478548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f376006da70 msgr2=0x7f3760149490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:52.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f375dd9b640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f376006da70 0x7f3760149490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f375dd9b640 1 -- 172.21.15.120:0/3924478548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3760142ee0 msgr2=0x7f37601480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:52.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f375dd9b640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3760142ee0 0x7f37601480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f375dd9b640 1 -- 172.21.15.120:0/3924478548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754009b30 con 0x7f37600b4e30 2023-12-19T05:38:52.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f375ed9d640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3760142ee0 0x7f37601480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:38:52.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f375dd9b640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37600b4e30 0x7f37601473f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3754000f80 tx=0x7f3754004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:52.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.306+0000 7f374effd640 1 -- 172.21.15.120:0/3924478548 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3754009510 con 0x7f37600b4e30 2023-12-19T05:38:52.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.307+0000 7f374effd640 1 -- 172.21.15.120:0/3924478548 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375403e450 con 0x7f37600b4e30 2023-12-19T05:38:52.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.307+0000 7f374effd640 1 -- 172.21.15.120:0/3924478548 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375403e800 con 0x7f37600b4e30 2023-12-19T05:38:52.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.307+0000 7f3764a4c640 1 -- 172.21.15.120:0/3924478548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3760146910 con 0x7f37600b4e30 2023-12-19T05:38:52.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.307+0000 7f3764a4c640 1 -- 172.21.15.120:0/3924478548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37600a3050 con 0x7f37600b4e30 2023-12-19T05:38:52.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.307+0000 7f3764a4c640 1 -- 172.21.15.120:0/3924478548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3760066dd0 con 0x7f37600b4e30 2023-12-19T05:38:52.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.308+0000 7f374effd640 1 -- 172.21.15.120:0/3924478548 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f375403e960 con 0x7f37600b4e30 2023-12-19T05:38:52.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.308+0000 7f374effd640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f374006a430 0x7f374006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:52.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.308+0000 7f374effd640 1 -- 172.21.15.120:0/3924478548 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f37540ab240 con 0x7f37600b4e30 2023-12-19T05:38:52.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.308+0000 7f375e59c640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f374006a430 0x7f374006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:52.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.309+0000 7f375e59c640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f374006a430 0x7f374006c8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3758009b40 tx=0x7f3758009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:52.313 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.312+0000 7f374effd640 1 -- 172.21.15.120:0/3924478548 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3754076b90 con 0x7f37600b4e30 2023-12-19T05:38:52.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.511+0000 7f3764a4c640 1 -- 172.21.15.120:0/3924478548 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f376004e080 con 0x7f37600b4e30 2023-12-19T05:38:52.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.511+0000 7f374effd640 1 -- 172.21.15.120:0/3924478548 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7f375407a1b0 con 0x7f37600b4e30 2023-12-19T05:38:52.513 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:38:52.513 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1608902018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":1608902018},{"type":"v1","addr":"172.21.15.120:6837","nonce":1608902018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-12-19T05:38:52.513 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 2 2023-12-19T05:38:52.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.513+0000 7f3764a4c640 1 -- 172.21.15.120:0/3924478548 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f374006a430 msgr2=0x7f374006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:52.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.513+0000 7f3764a4c640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f374006a430 0x7f374006c8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3758009b40 tx=0x7f3758009190 comp rx=0 tx=0).stop 2023-12-19T05:38:52.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.513+0000 7f3764a4c640 1 -- 172.21.15.120:0/3924478548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37600b4e30 msgr2=0x7f37601473f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:52.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.513+0000 7f3764a4c640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37600b4e30 0x7f37601473f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3754000f80 tx=0x7f3754004a40 comp rx=0 tx=0).stop 2023-12-19T05:38:52.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.513+0000 7f3764a4c640 1 -- 172.21.15.120:0/3924478548 shutdown_connections 2023-12-19T05:38:52.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.513+0000 7f3764a4c640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f374006a430 0x7f374006c8f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.513+0000 7f3764a4c640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3760142ee0 0x7f37601480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.513+0000 7f3764a4c640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f37600b4e30 0x7f37601473f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.513+0000 7f3764a4c640 1 --2- 172.21.15.120:0/3924478548 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f376006da70 0x7f3760149490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:52.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.513+0000 7f3764a4c640 1 -- 172.21.15.120:0/3924478548 >> 172.21.15.120:0/3924478548 conn(0x7f37600bac10 msgr2=0x7f37600b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:52.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.513+0000 7f3764a4c640 1 -- 172.21.15.120:0/3924478548 shutdown_connections 2023-12-19T05:38:52.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:52.513+0000 7f3764a4c640 1 -- 172.21.15.120:0/3924478548 wait complete. 2023-12-19T05:38:54.526 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:38:54.636 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.634+0000 7f6b2010a640 1 Processor -- start 2023-12-19T05:38:54.636 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.635+0000 7f6b2010a640 1 -- start start 2023-12-19T05:38:54.637 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.635+0000 7f6b2010a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6b1806ae10 0x7f6b1814b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:54.637 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.635+0000 7f6b2010a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1814b700 0x7f6b18155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:54.637 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.635+0000 7f6b2010a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b180bbb60 con 0x7f6b18144d60 2023-12-19T05:38:54.637 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.635+0000 7f6b2010a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1806b980 con 0x7f6b1806ae10 2023-12-19T05:38:54.637 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.635+0000 7f6b2010a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1814aa40 con 0x7f6b1814b700 2023-12-19T05:38:54.637 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.635+0000 7f6b1d6a5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6b1806ae10 0x7f6b1814b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:54.637 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.635+0000 7f6b1dea6640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f6b18144d60 0x7f6b1806d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50328/0 (socket says 172.21.15.120:50328) 2023-12-19T05:38:54.637 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.635+0000 7f6b1dea6640 1 -- 172.21.15.120:0/3184721282 learned_addr learned my addr 172.21.15.120:0/3184721282 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:38:54.637 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.636+0000 7f6b1e6a7640 1 --2- 172.21.15.120:0/3184721282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1814b700 0x7f6b18155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:54.637 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.636+0000 7f6b1d6a5640 1 -- 172.21.15.120:0/3184721282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1814b700 msgr2=0x7f6b18155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:54.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.636+0000 7f6b1cea4640 1 -- 172.21.15.120:0/3184721282 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734773086 0 0) 0x7f6b180bbb60 con 0x7f6b18144d60 2023-12-19T05:38:54.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.636+0000 7f6b1d6a5640 1 --2- 172.21.15.120:0/3184721282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1814b700 0x7f6b18155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:54.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.636+0000 7f6b1d6a5640 1 -- 172.21.15.120:0/3184721282 >> v1:172.21.15.120:6789/0 conn(0x7f6b18144d60 legacy=0x7f6b1806d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:54.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.636+0000 7f6b1d6a5640 1 -- 172.21.15.120:0/3184721282 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b180b8b10 con 0x7f6b1806ae10 2023-12-19T05:38:54.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.637+0000 7f6b1d6a5640 1 --2- 172.21.15.120:0/3184721282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b1806ae10 0x7f6b1814b1c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0097a0 tx=0x7f6b0c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9918d387f5a7d8d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:54.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.637+0000 7f6b1cea4640 1 -- 172.21.15.120:0/3184721282 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c030610 con 0x7f6b1806ae10 2023-12-19T05:38:54.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.637+0000 7f6b1cea4640 1 -- 172.21.15.120:0/3184721282 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c030770 con 0x7f6b1806ae10 2023-12-19T05:38:54.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.637+0000 7f6b1cea4640 1 -- 172.21.15.120:0/3184721282 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c030b00 con 0x7f6b1806ae10 2023-12-19T05:38:54.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.637+0000 7f6b2010a640 1 -- 172.21.15.120:0/3184721282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b1806ae10 msgr2=0x7f6b1814b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:54.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.637+0000 7f6b2010a640 1 --2- 172.21.15.120:0/3184721282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b1806ae10 0x7f6b1814b1c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0097a0 tx=0x7f6b0c02b960 comp rx=0 tx=0).stop 2023-12-19T05:38:54.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.637+0000 7f6b2010a640 1 -- 172.21.15.120:0/3184721282 shutdown_connections 2023-12-19T05:38:54.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.637+0000 7f6b2010a640 1 --2- 172.21.15.120:0/3184721282 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b1806ae10 0x7f6b1814b1c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:54.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.637+0000 7f6b2010a640 1 --2- 172.21.15.120:0/3184721282 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1814b700 0x7f6b18155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:54.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.637+0000 7f6b2010a640 1 -- 172.21.15.120:0/3184721282 >> 172.21.15.120:0/3184721282 conn(0x7f6b180bac10 msgr2=0x7f6b180bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:54.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.637+0000 7f6b2010a640 1 -- 172.21.15.120:0/3184721282 shutdown_connections 2023-12-19T05:38:54.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.637+0000 7f6b2010a640 1 -- 172.21.15.120:0/3184721282 wait complete. 2023-12-19T05:38:54.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.638+0000 7f6b2010a640 1 Processor -- start 2023-12-19T05:38:54.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.638+0000 7f6b2010a640 1 -- start start 2023-12-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b2010a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b1806ae10 0x7f6b1813dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b2010a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b18144d60 0x7f6b1813f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b2010a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1814b700 0x7f6b1813f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b2010a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1813e170 con 0x7f6b1806ae10 2023-12-19T05:38:54.643 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b2010a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1813fec0 con 0x7f6b18144d60 2023-12-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b2010a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b181e03f0 con 0x7f6b1814b700 2023-12-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b1dea6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b1806ae10 0x7f6b1813dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b1dea6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b1806ae10 0x7f6b1813dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48358/0 (socket says 172.21.15.120:48358) 2023-12-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b1dea6640 1 -- 172.21.15.120:0/2882238096 learned_addr learned my addr 172.21.15.120:0/2882238096 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b1d6a5640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b18144d60 0x7f6b1813f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b1e6a7640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1814b700 0x7f6b1813f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b1dea6640 1 -- 172.21.15.120:0/2882238096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1814b700 msgr2=0x7f6b1813f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b1dea6640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1814b700 0x7f6b1813f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b1dea6640 1 -- 172.21.15.120:0/2882238096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b18144d60 msgr2=0x7f6b1813f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b1dea6640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b18144d60 0x7f6b1813f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b1dea6640 1 -- 172.21.15.120:0/2882238096 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c009400 con 0x7f6b1806ae10 2023-12-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b1d6a5640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b18144d60 0x7f6b1813f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:54.644 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.639+0000 7f6b1e6a7640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1814b700 0x7f6b1813f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.640+0000 7f6b1dea6640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b1806ae10 0x7f6b1813dc30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c8c0 tx=0x7f6b1000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.640+0000 7f6b167fc640 1 -- 172.21.15.120:0/2882238096 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000a640 con 0x7f6b1806ae10 2023-12-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.640+0000 7f6b167fc640 1 -- 172.21.15.120:0/2882238096 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1000a7c0 con 0x7f6b1806ae10 2023-12-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.640+0000 7f6b2010a640 1 -- 172.21.15.120:0/2882238096 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b181e06b0 con 0x7f6b1806ae10 2023-12-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.640+0000 7f6b167fc640 1 -- 172.21.15.120:0/2882238096 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1000ab70 con 0x7f6b1806ae10 2023-12-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.640+0000 7f6b2010a640 1 -- 172.21.15.120:0/2882238096 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1813d2b0 con 0x7f6b1806ae10 2023-12-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.641+0000 7f6b2010a640 1 -- 172.21.15.120:0/2882238096 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1804e080 con 0x7f6b1806ae10 2023-12-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.641+0000 7f6b167fc640 1 -- 172.21.15.120:0/2882238096 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6b1000acd0 con 0x7f6b1806ae10 2023-12-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.642+0000 7f6b167fc640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6b0406a430 0x7f6b0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.642+0000 7f6b1d6a5640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6b0406a430 0x7f6b0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.642+0000 7f6b167fc640 1 -- 172.21.15.120:0/2882238096 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6b10087c30 con 0x7f6b1806ae10 2023-12-19T05:38:54.645 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.642+0000 7f6b1d6a5640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6b0406a430 0x7f6b0406c8f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c036000 tx=0x7f6b0c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:54.647 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.646+0000 7f6b167fc640 1 -- 172.21.15.120:0/2882238096 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6b10053570 con 0x7f6b1806ae10 2023-12-19T05:38:54.848 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.847+0000 7f6b2010a640 1 -- 172.21.15.120:0/2882238096 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b1806e540 con 0x7f6b1806ae10 2023-12-19T05:38:54.849 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.848+0000 7f6b167fc640 1 -- 172.21.15.120:0/2882238096 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2774 (secure 0 0 0) 0x7f6b10018020 con 0x7f6b1806ae10 2023-12-19T05:38:54.849 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:38:54.849 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/753508604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":753508604},{"type":"v1","addr":"172.21.15.155:6833","nonce":753508604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/3314096579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":3314096579},{"type":"v1","addr":"172.21.15.120:6836","nonce":3314096579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6837/1608902018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":1608902018},{"type":"v1","addr":"172.21.15.120:6837","nonce":1608902018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-12-19T05:38:54.850 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 3 2023-12-19T05:38:54.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.850+0000 7f6b2010a640 1 -- 172.21.15.120:0/2882238096 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6b0406a430 msgr2=0x7f6b0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:54.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.850+0000 7f6b2010a640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6b0406a430 0x7f6b0406c8f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c036000 tx=0x7f6b0c03b040 comp rx=0 tx=0).stop 2023-12-19T05:38:54.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.850+0000 7f6b2010a640 1 -- 172.21.15.120:0/2882238096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b1806ae10 msgr2=0x7f6b1813dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:54.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.850+0000 7f6b2010a640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b1806ae10 0x7f6b1813dc30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c8c0 tx=0x7f6b1000cd80 comp rx=0 tx=0).stop 2023-12-19T05:38:54.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.850+0000 7f6b2010a640 1 -- 172.21.15.120:0/2882238096 shutdown_connections 2023-12-19T05:38:54.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.850+0000 7f6b2010a640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6b0406a430 0x7f6b0406c8f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:54.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.850+0000 7f6b2010a640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6b1814b700 0x7f6b1813f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:54.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.850+0000 7f6b2010a640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6b18144d60 0x7f6b1813f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:54.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.850+0000 7f6b2010a640 1 --2- 172.21.15.120:0/2882238096 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6b1806ae10 0x7f6b1813dc30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:54.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.850+0000 7f6b2010a640 1 -- 172.21.15.120:0/2882238096 >> 172.21.15.120:0/2882238096 conn(0x7f6b180bac10 msgr2=0x7f6b18148890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:54.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.850+0000 7f6b2010a640 1 -- 172.21.15.120:0/2882238096 shutdown_connections 2023-12-19T05:38:54.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.850+0000 7f6b2010a640 1 -- 172.21.15.120:0/2882238096 wait complete. 2023-12-19T05:38:54.862 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:38:54.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.960+0000 7f4c32f99640 1 Processor -- start 2023-12-19T05:38:54.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.960+0000 7f4c32f99640 1 -- start start 2023-12-19T05:38:54.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.960+0000 7f4c32f99640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f4c2c0b7d90 0x7f4c2c144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:54.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.960+0000 7f4c32f99640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4c2c145010 0x7f4c2c14b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:54.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.960+0000 7f4c32f99640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2c0b96b0 con 0x7f4c2c0b79b0 2023-12-19T05:38:54.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.960+0000 7f4c32f99640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2c14ae10 con 0x7f4c2c145010 2023-12-19T05:38:54.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.960+0000 7f4c32f99640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2c0bacc0 con 0x7f4c2c0b7d90 2023-12-19T05:38:54.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.960+0000 7f4c31536640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4c2c145010 0x7f4c2c14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:54.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.960+0000 7f4c31536640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4c2c145010 0x7f4c2c14b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48374/0 (socket says 172.21.15.120:48374) 2023-12-19T05:38:54.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.960+0000 7f4c31536640 1 -- 172.21.15.120:0/1717956297 learned_addr learned my addr 172.21.15.120:0/1717956297 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:54.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.960+0000 7f4c30d35640 1 --1- 172.21.15.120:0/1717956297 >> v1:172.21.15.120:6789/0 conn(0x7f4c2c0b79b0 0x7f4c2c0b8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50330/0 (socket says 172.21.15.120:50330) 2023-12-19T05:38:54.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.961+0000 7f4c2bfff640 1 --2- 172.21.15.120:0/1717956297 >> v2:172.21.15.155:3300/0 conn(0x7f4c2c0b7d90 0x7f4c2c144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:54.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.961+0000 7f4c31536640 1 -- 172.21.15.120:0/1717956297 >> v2:172.21.15.155:3300/0 conn(0x7f4c2c0b7d90 msgr2=0x7f4c2c144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:54.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.961+0000 7f4c31536640 1 --2- 172.21.15.120:0/1717956297 >> v2:172.21.15.155:3300/0 conn(0x7f4c2c0b7d90 0x7f4c2c144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:54.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.961+0000 7f4c31536640 1 -- 172.21.15.120:0/1717956297 >> v1:172.21.15.120:6789/0 conn(0x7f4c2c0b79b0 legacy=0x7f4c2c0b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:54.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.961+0000 7f4c31536640 1 -- 172.21.15.120:0/1717956297 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c0b81d0 con 0x7f4c2c145010 2023-12-19T05:38:54.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.961+0000 7f4c2b7fe640 1 -- 172.21.15.120:0/1717956297 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420485997 0 0) 0x7f4c2c0b96b0 con 0x7f4c2c0b79b0 2023-12-19T05:38:54.966 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.961+0000 7f4c31536640 1 --2- 172.21.15.120:0/1717956297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c145010 0x7f4c2c14b230 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c066740 tx=0x7f4c2402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2b5ae7a80dc222 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:54.966 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.962+0000 7f4c2b7fe640 1 -- 172.21.15.120:0/1717956297 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2402cb20 con 0x7f4c2c145010 2023-12-19T05:38:54.966 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.962+0000 7f4c2b7fe640 1 -- 172.21.15.120:0/1717956297 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2402cc80 con 0x7f4c2c145010 2023-12-19T05:38:54.966 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.962+0000 7f4c2b7fe640 1 -- 172.21.15.120:0/1717956297 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c240343f0 con 0x7f4c2c145010 2023-12-19T05:38:54.966 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.962+0000 7f4c32f99640 1 -- 172.21.15.120:0/1717956297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c145010 msgr2=0x7f4c2c14b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:54.966 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.962+0000 7f4c32f99640 1 --2- 172.21.15.120:0/1717956297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c145010 0x7f4c2c14b230 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c066740 tx=0x7f4c2402bf80 comp rx=0 tx=0).stop 2023-12-19T05:38:54.966 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.962+0000 7f4c32f99640 1 -- 172.21.15.120:0/1717956297 shutdown_connections 2023-12-19T05:38:54.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.962+0000 7f4c32f99640 1 --2- 172.21.15.120:0/1717956297 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c145010 0x7f4c2c14b230 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:54.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.962+0000 7f4c32f99640 1 --2- 172.21.15.120:0/1717956297 >> v2:172.21.15.155:3300/0 conn(0x7f4c2c0b7d90 0x7f4c2c144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:54.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.962+0000 7f4c32f99640 1 -- 172.21.15.120:0/1717956297 >> 172.21.15.120:0/1717956297 conn(0x7f4c2c0c0340 msgr2=0x7f4c2c0c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:54.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.962+0000 7f4c32f99640 1 -- 172.21.15.120:0/1717956297 shutdown_connections 2023-12-19T05:38:54.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.962+0000 7f4c32f99640 1 -- 172.21.15.120:0/1717956297 wait complete. 2023-12-19T05:38:54.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.963+0000 7f4c32f99640 1 Processor -- start 2023-12-19T05:38:54.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.963+0000 7f4c32f99640 1 -- start start 2023-12-19T05:38:54.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c32f99640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c0b79b0 0x7f4c2c1df4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:54.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c32f99640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c2c0b7d90 0x7f4c2c148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:54.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c32f99640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c2c145010 0x7f4c2c13a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:54.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c32f99640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c149220 con 0x7f4c2c0b79b0 2023-12-19T05:38:54.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c32f99640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c1394e0 con 0x7f4c2c0b7d90 2023-12-19T05:38:54.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c32f99640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c13abc0 con 0x7f4c2c145010 2023-12-19T05:38:54.968 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c30d35640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c0b79b0 0x7f4c2c1df4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:54.968 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c30d35640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c0b79b0 0x7f4c2c1df4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48384/0 (socket says 172.21.15.120:48384) 2023-12-19T05:38:54.968 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c30d35640 1 -- 172.21.15.120:0/3770160890 learned_addr learned my addr 172.21.15.120:0/3770160890 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:54.968 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c30d35640 1 -- 172.21.15.120:0/3770160890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c2c145010 msgr2=0x7f4c2c13a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:54.968 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c30d35640 1 --2- 172.21.15.120:0/3770160890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c2c145010 0x7f4c2c13a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:54.968 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c30d35640 1 -- 172.21.15.120:0/3770160890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c2c0b7d90 msgr2=0x7f4c2c148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:54.968 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c30d35640 1 --2- 172.21.15.120:0/3770160890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c2c0b7d90 0x7f4c2c148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:54.968 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c30d35640 1 -- 172.21.15.120:0/3770160890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c24009b30 con 0x7f4c2c0b79b0 2023-12-19T05:38:54.968 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c30d35640 1 --2- 172.21.15.120:0/3770160890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c0b79b0 0x7f4c2c1df4b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000c500 tx=0x7f4c2000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:54.968 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.964+0000 7f4c297fa640 1 -- 172.21.15.120:0/3770160890 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20007560 con 0x7f4c2c0b79b0 2023-12-19T05:38:54.968 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.965+0000 7f4c297fa640 1 -- 172.21.15.120:0/3770160890 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c200047e0 con 0x7f4c2c0b79b0 2023-12-19T05:38:54.968 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.965+0000 7f4c297fa640 1 -- 172.21.15.120:0/3770160890 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20004b90 con 0x7f4c2c0b79b0 2023-12-19T05:38:54.968 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.965+0000 7f4c32f99640 1 -- 172.21.15.120:0/3770160890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2c13ae20 con 0x7f4c2c0b79b0 2023-12-19T05:38:54.968 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.965+0000 7f4c32f99640 1 -- 172.21.15.120:0/3770160890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2c139a10 con 0x7f4c2c0b79b0 2023-12-19T05:38:54.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.966+0000 7f4c32f99640 1 -- 172.21.15.120:0/3770160890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2c04e080 con 0x7f4c2c0b79b0 2023-12-19T05:38:54.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.966+0000 7f4c297fa640 1 -- 172.21.15.120:0/3770160890 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4c20004cf0 con 0x7f4c2c0b79b0 2023-12-19T05:38:54.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.966+0000 7f4c297fa640 1 --2- 172.21.15.120:0/3770160890 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f4c1006a430 0x7f4c1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:54.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.966+0000 7f4c2bfff640 1 --2- 172.21.15.120:0/3770160890 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f4c1006a430 0x7f4c1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:54.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.966+0000 7f4c297fa640 1 -- 172.21.15.120:0/3770160890 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4c200876b0 con 0x7f4c2c0b79b0 2023-12-19T05:38:54.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.967+0000 7f4c2bfff640 1 --2- 172.21.15.120:0/3770160890 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f4c1006a430 0x7f4c1006c8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c18006fd0 tx=0x7f4c18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:54.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:54.970+0000 7f4c297fa640 1 -- 172.21.15.120:0/3770160890 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4c20053080 con 0x7f4c2c0b79b0 2023-12-19T05:38:55.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.138+0000 7f4c32f99640 1 -- 172.21.15.120:0/3770160890 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c2c0008d0 con 0x7f4c2c0b79b0 2023-12-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.139+0000 7f4c297fa640 1 -- 172.21.15.120:0/3770160890 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f4c20018090 con 0x7f4c2c0b79b0 2023-12-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:38:55.140 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":16,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:48.037656+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.140+0000 7f4c32f99640 1 -- 172.21.15.120:0/3770160890 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f4c1006a430 msgr2=0x7f4c1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.140+0000 7f4c32f99640 1 --2- 172.21.15.120:0/3770160890 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f4c1006a430 0x7f4c1006c8f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4c18006fd0 tx=0x7f4c18008040 comp rx=0 tx=0).stop 2023-12-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.141+0000 7f4c32f99640 1 -- 172.21.15.120:0/3770160890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c0b79b0 msgr2=0x7f4c2c1df4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.141+0000 7f4c32f99640 1 --2- 172.21.15.120:0/3770160890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c0b79b0 0x7f4c2c1df4b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000c500 tx=0x7f4c2000c9c0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.141+0000 7f4c32f99640 1 -- 172.21.15.120:0/3770160890 shutdown_connections 2023-12-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.141+0000 7f4c32f99640 1 --2- 172.21.15.120:0/3770160890 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f4c1006a430 0x7f4c1006c8f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.141+0000 7f4c32f99640 1 --2- 172.21.15.120:0/3770160890 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4c2c145010 0x7f4c2c13a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.141+0000 7f4c32f99640 1 --2- 172.21.15.120:0/3770160890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4c2c0b7d90 0x7f4c2c148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.141+0000 7f4c32f99640 1 --2- 172.21.15.120:0/3770160890 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4c2c0b79b0 0x7f4c2c1df4b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.141+0000 7f4c32f99640 1 -- 172.21.15.120:0/3770160890 >> 172.21.15.120:0/3770160890 conn(0x7f4c2c0c0340 msgr2=0x7f4c2c0be220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.141+0000 7f4c32f99640 1 -- 172.21.15.120:0/3770160890 shutdown_connections 2023-12-19T05:38:55.143 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.141+0000 7f4c32f99640 1 -- 172.21.15.120:0/3770160890 wait complete. 2023-12-19T05:38:55.152 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:45.976868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:38:55.153 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:38:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.253+0000 7fc5190a1640 1 Processor -- start 2023-12-19T05:38:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.253+0000 7fc5190a1640 1 -- start start 2023-12-19T05:38:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.253+0000 7fc5190a1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc5140b8970 0x7fc5140b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.253+0000 7fc5190a1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc51414b150 0x7fc51414b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.253+0000 7fc5190a1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51414acc0 con 0x7fc5140b7650 2023-12-19T05:38:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.253+0000 7fc5190a1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5140babd0 con 0x7fc51414b150 2023-12-19T05:38:55.257 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.253+0000 7fc5190a1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5140b6d90 con 0x7fc5140b8970 2023-12-19T05:38:55.258 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.253+0000 7fc51359e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc51414b150 0x7fc51414b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.258 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.254+0000 7fc50a59c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc5140b7650 0x7fc5141449e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50332/0 (socket says 172.21.15.120:50332) 2023-12-19T05:38:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.254+0000 7fc50a59c640 1 -- 172.21.15.120:0/1776856098 learned_addr learned my addr 172.21.15.120:0/1776856098 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:38:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.254+0000 7fc51359e640 1 --2- 172.21.15.120:0/1776856098 >> v2:172.21.15.120:3300/0 conn(0x7fc51414b150 0x7fc51414b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48394/0 (socket says 172.21.15.120:48394) 2023-12-19T05:38:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.254+0000 7fc51359e640 1 -- 172.21.15.120:0/1776856098 >> v2:172.21.15.155:3300/0 conn(0x7fc5140b8970 msgr2=0x7fc5140b8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.254+0000 7fc51359e640 1 --2- 172.21.15.120:0/1776856098 >> v2:172.21.15.155:3300/0 conn(0x7fc5140b8970 0x7fc5140b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.254+0000 7fc51359e640 1 -- 172.21.15.120:0/1776856098 >> v1:172.21.15.120:6789/0 conn(0x7fc5140b7650 legacy=0x7fc5141449e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.254+0000 7fc51259c640 1 -- 172.21.15.120:0/1776856098 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094636401 0 0) 0x7fc51414acc0 con 0x7fc5140b7650 2023-12-19T05:38:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.254+0000 7fc51359e640 1 -- 172.21.15.120:0/1776856098 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5140b8310 con 0x7fc51414b150 2023-12-19T05:38:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.255+0000 7fc51359e640 1 --2- 172.21.15.120:0/1776856098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc51414b150 0x7fc51414b5c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5140bdd70 tx=0x7fc50c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c227240026bfbfa4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.255+0000 7fc51259c640 1 -- 172.21.15.120:0/1776856098 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c02cd00 con 0x7fc51414b150 2023-12-19T05:38:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.255+0000 7fc51259c640 1 -- 172.21.15.120:0/1776856098 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50c02ce60 con 0x7fc51414b150 2023-12-19T05:38:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.255+0000 7fc51259c640 1 -- 172.21.15.120:0/1776856098 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c034660 con 0x7fc51414b150 2023-12-19T05:38:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.255+0000 7fc5190a1640 1 -- 172.21.15.120:0/1776856098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc51414b150 msgr2=0x7fc51414b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.255+0000 7fc5190a1640 1 --2- 172.21.15.120:0/1776856098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc51414b150 0x7fc51414b5c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5140bdd70 tx=0x7fc50c02bf50 comp rx=0 tx=0).stop 2023-12-19T05:38:55.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.255+0000 7fc5190a1640 1 -- 172.21.15.120:0/1776856098 shutdown_connections 2023-12-19T05:38:55.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.255+0000 7fc5190a1640 1 --2- 172.21.15.120:0/1776856098 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc51414b150 0x7fc51414b5c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.255+0000 7fc5190a1640 1 --2- 172.21.15.120:0/1776856098 >> v2:172.21.15.155:3300/0 conn(0x7fc5140b8970 0x7fc5140b8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.255+0000 7fc5190a1640 1 -- 172.21.15.120:0/1776856098 >> 172.21.15.120:0/1776856098 conn(0x7fc5140c0250 msgr2=0x7fc5140c0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:55.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.255+0000 7fc5190a1640 1 -- 172.21.15.120:0/1776856098 shutdown_connections 2023-12-19T05:38:55.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.255+0000 7fc5190a1640 1 -- 172.21.15.120:0/1776856098 wait complete. 2023-12-19T05:38:55.262 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.256+0000 7fc5190a1640 1 Processor -- start 2023-12-19T05:38:55.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.257+0000 7fc5190a1640 1 -- start start 2023-12-19T05:38:55.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.257+0000 7fc5190a1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5140b7650 0x7fc514141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.257+0000 7fc5190a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5140b8970 0x7fc5141e32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.257+0000 7fc5190a1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc51414b150 0x7fc514147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.257+0000 7fc5190a1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51414df20 con 0x7fc5140b8970 2023-12-19T05:38:55.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.257+0000 7fc5190a1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51414be40 con 0x7fc5140b7650 2023-12-19T05:38:55.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.257+0000 7fc5190a1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5141483f0 con 0x7fc51414b150 2023-12-19T05:38:55.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.257+0000 7fc50a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5140b8970 0x7fc5141e32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.257+0000 7fc50a59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5140b8970 0x7fc5141e32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48406/0 (socket says 172.21.15.120:48406) 2023-12-19T05:38:55.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.257+0000 7fc50a59c640 1 -- 172.21.15.120:0/4010310434 learned_addr learned my addr 172.21.15.120:0/4010310434 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:55.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.257+0000 7fc51359e640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc51414b150 0x7fc514147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.258+0000 7fc512d9d640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5140b7650 0x7fc514141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.264 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.258+0000 7fc50a59c640 1 -- 172.21.15.120:0/4010310434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc51414b150 msgr2=0x7fc514147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.264 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.258+0000 7fc50a59c640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc51414b150 0x7fc514147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.264 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.258+0000 7fc50a59c640 1 -- 172.21.15.120:0/4010310434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5140b7650 msgr2=0x7fc514141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.264 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.258+0000 7fc50a59c640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5140b7650 0x7fc514141960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.264 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.258+0000 7fc50a59c640 1 -- 172.21.15.120:0/4010310434 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c009a70 con 0x7fc5140b8970 2023-12-19T05:38:55.264 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.258+0000 7fc51359e640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc51414b150 0x7fc514147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.258+0000 7fc512d9d640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5140b7650 0x7fc514141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.258+0000 7fc50a59c640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5140b8970 0x7fc5141e32e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00c410 tx=0x7fc4fc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.258+0000 7fc50bfff640 1 -- 172.21.15.120:0/4010310434 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0074e0 con 0x7fc5140b8970 2023-12-19T05:38:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.258+0000 7fc5190a1640 1 -- 172.21.15.120:0/4010310434 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51414c090 con 0x7fc5140b8970 2023-12-19T05:38:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.258+0000 7fc5190a1640 1 -- 172.21.15.120:0/4010310434 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51414bba0 con 0x7fc5140b8970 2023-12-19T05:38:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.258+0000 7fc50bfff640 1 -- 172.21.15.120:0/4010310434 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc007640 con 0x7fc5140b8970 2023-12-19T05:38:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.258+0000 7fc50bfff640 1 -- 172.21.15.120:0/4010310434 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0059a0 con 0x7fc5140b8970 2023-12-19T05:38:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.259+0000 7fc5190a1640 1 -- 172.21.15.120:0/4010310434 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5140b9de0 con 0x7fc5140b8970 2023-12-19T05:38:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.259+0000 7fc50bfff640 1 -- 172.21.15.120:0/4010310434 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc4fc005b00 con 0x7fc5140b8970 2023-12-19T05:38:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.259+0000 7fc50bfff640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc4f406a430 0x7fc4f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.260+0000 7fc50bfff640 1 -- 172.21.15.120:0/4010310434 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc4fc087b40 con 0x7fc5140b8970 2023-12-19T05:38:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.260+0000 7fc512d9d640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc4f406a430 0x7fc4f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.265 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.260+0000 7fc512d9d640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc4f406a430 0x7fc4f406c8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc504006fd0 tx=0x7fc504008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:55.266 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.264+0000 7fc50bfff640 1 -- 172.21.15.120:0/4010310434 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc4fc053540 con 0x7fc5140b8970 2023-12-19T05:38:55.431 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.429+0000 7fc5190a1640 1 -- 172.21.15.120:0/4010310434 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc51404e080 con 0x7fc5140b8970 2023-12-19T05:38:55.431 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.430+0000 7fc50bfff640 1 -- 172.21.15.120:0/4010310434 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4fc017020 con 0x7fc5140b8970 2023-12-19T05:38:55.431 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2023-12-19T05:38:55.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.432+0000 7fc5190a1640 1 -- 172.21.15.120:0/4010310434 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc4f406a430 msgr2=0x7fc4f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.432+0000 7fc5190a1640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc4f406a430 0x7fc4f406c8f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc504006fd0 tx=0x7fc504008040 comp rx=0 tx=0).stop 2023-12-19T05:38:55.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.432+0000 7fc5190a1640 1 -- 172.21.15.120:0/4010310434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5140b8970 msgr2=0x7fc5141e32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.432+0000 7fc5190a1640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5140b8970 0x7fc5141e32e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00c410 tx=0x7fc4fc00c8d0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.432+0000 7fc5190a1640 1 -- 172.21.15.120:0/4010310434 shutdown_connections 2023-12-19T05:38:55.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.432+0000 7fc5190a1640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc4f406a430 0x7fc4f406c8f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.432+0000 7fc5190a1640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc51414b150 0x7fc514147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.434 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.432+0000 7fc5190a1640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc5140b8970 0x7fc5141e32e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.434 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.432+0000 7fc5190a1640 1 --2- 172.21.15.120:0/4010310434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5140b7650 0x7fc514141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.434 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.432+0000 7fc5190a1640 1 -- 172.21.15.120:0/4010310434 >> 172.21.15.120:0/4010310434 conn(0x7fc5140c0250 msgr2=0x7fc5140c0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:55.434 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.432+0000 7fc5190a1640 1 -- 172.21.15.120:0/4010310434 shutdown_connections 2023-12-19T05:38:55.434 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.432+0000 7fc5190a1640 1 -- 172.21.15.120:0/4010310434 wait complete. 2023-12-19T05:38:55.443 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T05:38:55.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.541+0000 7f9ed5a5f640 1 Processor -- start 2023-12-19T05:38:55.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.541+0000 7f9ed5a5f640 1 -- start start 2023-12-19T05:38:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9ed5a5f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9ed00b8e90 0x7f9ed0144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9ed5a5f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ed0145020 0x7f9ed01553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9ed5a5f640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed00b6e20 con 0x7f9ed00b8790 2023-12-19T05:38:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9ed5a5f640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed00bacd0 con 0x7f9ed00b8e90 2023-12-19T05:38:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9ed5a5f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed014ab60 con 0x7f9ed0145020 2023-12-19T05:38:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9eceffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9ed00b8e90 0x7f9ed0144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9ece7fc640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9ed00b8790 0x7f9ed014b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50336/0 (socket says 172.21.15.120:50336) 2023-12-19T05:38:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9ece7fc640 1 -- 172.21.15.120:0/3671443639 learned_addr learned my addr 172.21.15.120:0/3671443639 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:38:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9ecf7fe640 1 --2- 172.21.15.120:0/3671443639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ed0145020 0x7f9ed01553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9eceffd640 1 -- 172.21.15.120:0/3671443639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ed0145020 msgr2=0x7f9ed01553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9eceffd640 1 --2- 172.21.15.120:0/3671443639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ed0145020 0x7f9ed01553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9eceffd640 1 -- 172.21.15.120:0/3671443639 >> v1:172.21.15.120:6789/0 conn(0x7f9ed00b8790 legacy=0x7f9ed014b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9eceffd640 1 -- 172.21.15.120:0/3671443639 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed00bc720 con 0x7f9ed00b8e90 2023-12-19T05:38:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9ecdffb640 1 -- 172.21.15.120:0/3671443639 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987139364 0 0) 0x7f9ed00b6e20 con 0x7f9ed00b8790 2023-12-19T05:38:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.542+0000 7f9ecf7fe640 1 --2- 172.21.15.120:0/3671443639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ed0145020 0x7f9ed01553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.543+0000 7f9eceffd640 1 --2- 172.21.15.120:0/3671443639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed00b8e90 0x7f9ed0144ae0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009790 tx=0x7f9ec002b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af689ce1bc877ecc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.543+0000 7f9ecdffb640 1 -- 172.21.15.120:0/3671443639 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0031890 con 0x7f9ed00b8e90 2023-12-19T05:38:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.543+0000 7f9ecdffb640 1 -- 172.21.15.120:0/3671443639 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec00319f0 con 0x7f9ed00b8e90 2023-12-19T05:38:55.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.543+0000 7f9ecdffb640 1 -- 172.21.15.120:0/3671443639 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0031d80 con 0x7f9ed00b8e90 2023-12-19T05:38:55.549 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.544+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/3671443639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed00b8e90 msgr2=0x7f9ed0144ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.549 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.544+0000 7f9ed5a5f640 1 --2- 172.21.15.120:0/3671443639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed00b8e90 0x7f9ed0144ae0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009790 tx=0x7f9ec002b930 comp rx=0 tx=0).stop 2023-12-19T05:38:55.549 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.544+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/3671443639 shutdown_connections 2023-12-19T05:38:55.549 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.544+0000 7f9ed5a5f640 1 --2- 172.21.15.120:0/3671443639 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ed0145020 0x7f9ed01553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.549 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.544+0000 7f9ed5a5f640 1 --2- 172.21.15.120:0/3671443639 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed00b8e90 0x7f9ed0144ae0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.549 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.544+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/3671443639 >> 172.21.15.120:0/3671443639 conn(0x7f9ed00c0350 msgr2=0x7f9ed00c0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:55.549 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.544+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/3671443639 shutdown_connections 2023-12-19T05:38:55.549 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.544+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/3671443639 wait complete. 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.545+0000 7f9ed5a5f640 1 Processor -- start 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.545+0000 7f9ed5a5f640 1 -- start start 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.545+0000 7f9ed5a5f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ed00b8790 0x7f9ed014d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.545+0000 7f9ed5a5f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ed00b8e90 0x7f9ed00b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.545+0000 7f9ed5a5f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed0145020 0x7f9ed0145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.545+0000 7f9ed5a5f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed0149390 con 0x7f9ed0145020 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ed5a5f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed01467f0 con 0x7f9ed00b8790 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ed5a5f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed014dc40 con 0x7f9ed00b8e90 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ecf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed0145020 0x7f9ed0145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ecf7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed0145020 0x7f9ed0145560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48432/0 (socket says 172.21.15.120:48432) 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ecf7fe640 1 -- 172.21.15.120:0/1600044907 learned_addr learned my addr 172.21.15.120:0/1600044907 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ece7fc640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ed00b8e90 0x7f9ed00b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9eceffd640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ed00b8790 0x7f9ed014d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ecf7fe640 1 -- 172.21.15.120:0/1600044907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ed00b8e90 msgr2=0x7f9ed00b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ecf7fe640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ed00b8e90 0x7f9ed00b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ecf7fe640 1 -- 172.21.15.120:0/1600044907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ed00b8790 msgr2=0x7f9ed014d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ecf7fe640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ed00b8790 0x7f9ed014d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ecf7fe640 1 -- 172.21.15.120:0/1600044907 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00093a0 con 0x7f9ed0145020 2023-12-19T05:38:55.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ece7fc640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ed00b8e90 0x7f9ed00b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:55.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ecf7fe640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed0145020 0x7f9ed0145560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800cd80 tx=0x7f9ec800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:55.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9eb7fff640 1 -- 172.21.15.120:0/1600044907 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec800f680 con 0x7f9ed0145020 2023-12-19T05:38:55.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9eb7fff640 1 -- 172.21.15.120:0/1600044907 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec800f800 con 0x7f9ed0145020 2023-12-19T05:38:55.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9eb7fff640 1 -- 172.21.15.120:0/1600044907 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec800fbb0 con 0x7f9ed0145020 2023-12-19T05:38:55.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/1600044907 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed00b5e00 con 0x7f9ed0145020 2023-12-19T05:38:55.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.546+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/1600044907 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed01e3370 con 0x7f9ed0145020 2023-12-19T05:38:55.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.547+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/1600044907 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed004e080 con 0x7f9ed0145020 2023-12-19T05:38:55.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.548+0000 7f9eb7fff640 1 -- 172.21.15.120:0/1600044907 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9ec800b040 con 0x7f9ed0145020 2023-12-19T05:38:55.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.548+0000 7f9eb7fff640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9ebc06a430 0x7f9ebc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.548+0000 7f9eb7fff640 1 -- 172.21.15.120:0/1600044907 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9ec8088f50 con 0x7f9ed0145020 2023-12-19T05:38:55.552 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.548+0000 7f9eceffd640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9ebc06a430 0x7f9ebc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.552 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.548+0000 7f9eceffd640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9ebc06a430 0x7f9ebc06c8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0036000 tx=0x7f9ec0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:55.553 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.552+0000 7f9eb7fff640 1 -- 172.21.15.120:0/1600044907 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9ec8054920 con 0x7f9ed0145020 2023-12-19T05:38:55.723 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.722+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/1600044907 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9ed0144e00 con 0x7f9ed0145020 2023-12-19T05:38:55.724 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.723+0000 7f9eb7fff640 1 -- 172.21.15.120:0/1600044907 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9ec801d060 con 0x7f9ed0145020 2023-12-19T05:38:55.724 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:38:55.724 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2023-12-19T05:38:55.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:38:55.724 INFO:teuthology.orchestra.run.smithi120.stdout: "poolnum": 1, 2023-12-19T05:38:55.724 INFO:teuthology.orchestra.run.smithi120.stdout: "poolname": ".mgr" 2023-12-19T05:38:55.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:38:55.725 INFO:teuthology.orchestra.run.smithi120.stdout:] 2023-12-19T05:38:55.726 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.725+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/1600044907 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9ebc06a430 msgr2=0x7f9ebc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.726 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.725+0000 7f9ed5a5f640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9ebc06a430 0x7f9ebc06c8f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0036000 tx=0x7f9ec0008030 comp rx=0 tx=0).stop 2023-12-19T05:38:55.726 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.725+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/1600044907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed0145020 msgr2=0x7f9ed0145560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.726 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.725+0000 7f9ed5a5f640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed0145020 0x7f9ed0145560 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800cd80 tx=0x7f9ec800a650 comp rx=0 tx=0).stop 2023-12-19T05:38:55.726 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.725+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/1600044907 shutdown_connections 2023-12-19T05:38:55.726 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.725+0000 7f9ed5a5f640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9ebc06a430 0x7f9ebc06c8f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.727 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.725+0000 7f9ed5a5f640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ed0145020 0x7f9ed0145560 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.727 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.725+0000 7f9ed5a5f640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ed00b8e90 0x7f9ed00b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.727 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.725+0000 7f9ed5a5f640 1 --2- 172.21.15.120:0/1600044907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ed00b8790 0x7f9ed014d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.727 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.725+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/1600044907 >> 172.21.15.120:0/1600044907 conn(0x7f9ed00c0350 msgr2=0x7f9ed00aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:55.727 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.725+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/1600044907 shutdown_connections 2023-12-19T05:38:55.727 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.725+0000 7f9ed5a5f640 1 -- 172.21.15.120:0/1600044907 wait complete. 2023-12-19T05:38:55.736 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T05:38:55.737 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T05:38:55.839 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.838+0000 7f14b3826640 1 Processor -- start 2023-12-19T05:38:55.839 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.838+0000 7f14b3826640 1 -- start start 2023-12-19T05:38:55.842 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.838+0000 7f14b3826640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14ac144d70 0x7f14ac0b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.842 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.838+0000 7f14b3826640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ac145150 con 0x7f14ac0bc7e0 2023-12-19T05:38:55.842 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.838+0000 7f14b3826640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ac0b9080 con 0x7f14ac14df70 2023-12-19T05:38:55.843 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.838+0000 7f14b3826640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0b9f00 con 0x7f14ac144d70 2023-12-19T05:38:55.843 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14b1dc3640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f14ac0bc7e0 0x7f14ac0bcc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50338/0 (socket says 172.21.15.120:50338) 2023-12-19T05:38:55.843 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14b1dc3640 1 -- 172.21.15.120:0/2546882165 learned_addr learned my addr 172.21.15.120:0/2546882165 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:38:55.843 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14b15c2640 1 --2- 172.21.15.120:0/2546882165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14ac144d70 0x7f14ac0b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.843 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 -- 172.21.15.120:0/2546882165 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323389990 0 0) 0x7f14ac145150 con 0x7f14ac0bc7e0 2023-12-19T05:38:55.843 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 -- 172.21.15.120:0/2546882165 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1498003520 con 0x7f14ac0bc7e0 2023-12-19T05:38:55.843 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 -- 172.21.15.120:0/2546882165 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1110527766 0 0) 0x7f1498003520 con 0x7f14ac0bc7e0 2023-12-19T05:38:55.843 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 -- 172.21.15.120:0/2546882165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14ac144d70 msgr2=0x7f14ac0b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:55.843 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 --2- 172.21.15.120:0/2546882165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14ac144d70 0x7f14ac0b7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.843 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 -- 172.21.15.120:0/2546882165 >> v1:172.21.15.155:6789/0 conn(0x7f14ac14df70 legacy=0x7f14ac0b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.843 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 -- 172.21.15.120:0/2546882165 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac0b9360 con 0x7f14ac0bc7e0 2023-12-19T05:38:55.843 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14b15c2640 1 --2- 172.21.15.120:0/2546882165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14ac144d70 0x7f14ac0b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:55.843 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 -- 172.21.15.120:0/2546882165 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f14a4001670 con 0x7f14ac0bc7e0 2023-12-19T05:38:55.844 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 -- 172.21.15.120:0/2546882165 >> v1:172.21.15.120:6789/0 conn(0x7f14ac0bc7e0 legacy=0x7f14ac0bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.844 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 --2- 172.21.15.120:0/2546882165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14980039a0 0x7f1498003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.844 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 --2- 172.21.15.120:0/2546882165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1498004350 0x7f1498004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.844 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 --2- 172.21.15.120:0/2546882165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14ac144d70 0x7f1498005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.844 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 -- 172.21.15.120:0/2546882165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0b9f00 con 0x7f14980039a0 2023-12-19T05:38:55.844 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 -- 172.21.15.120:0/2546882165 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149800b980 con 0x7f1498004350 2023-12-19T05:38:55.844 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14a3fff640 1 -- 172.21.15.120:0/2546882165 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149800baf0 con 0x7f14ac144d70 2023-12-19T05:38:55.844 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14b15c2640 1 --2- 172.21.15.120:0/2546882165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14980039a0 0x7f1498003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.844 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14b0dc1640 1 --2- 172.21.15.120:0/2546882165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1498004350 0x7f1498004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.844 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14b1dc3640 1 --2- 172.21.15.120:0/2546882165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14ac144d70 0x7f1498005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.844 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14b15c2640 1 -- 172.21.15.120:0/2546882165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14ac144d70 msgr2=0x7f1498005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:55.844 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14b15c2640 1 --2- 172.21.15.120:0/2546882165 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14ac144d70 0x7f1498005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.844 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14b15c2640 1 -- 172.21.15.120:0/2546882165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1498004350 msgr2=0x7f1498004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:55.844 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14b15c2640 1 --2- 172.21.15.120:0/2546882165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1498004350 0x7f1498004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.845 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.839+0000 7f14b15c2640 1 -- 172.21.15.120:0/2546882165 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8009a70 con 0x7f14980039a0 2023-12-19T05:38:55.845 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.840+0000 7f14b15c2640 1 --2- 172.21.15.120:0/2546882165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14980039a0 0x7f1498003d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f14a800e350 tx=0x7f14980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c48c2a348a1fa5e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:55.845 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.840+0000 7f14a3fff640 1 -- 172.21.15.120:0/2546882165 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a802cd70 con 0x7f14980039a0 2023-12-19T05:38:55.845 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.840+0000 7f14a3fff640 1 -- 172.21.15.120:0/2546882165 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a800f040 con 0x7f14980039a0 2023-12-19T05:38:55.845 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.840+0000 7f14a3fff640 1 -- 172.21.15.120:0/2546882165 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a8034640 con 0x7f14980039a0 2023-12-19T05:38:55.845 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.841+0000 7f14b3826640 1 -- 172.21.15.120:0/2546882165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14980039a0 msgr2=0x7f1498003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.845 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.841+0000 7f14b3826640 1 --2- 172.21.15.120:0/2546882165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14980039a0 0x7f1498003d80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f14a800e350 tx=0x7f14980057f0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.845 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.841+0000 7f14b1dc3640 1 -- 172.21.15.120:0/2546882165 reap_dead start 2023-12-19T05:38:55.845 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.841+0000 7f14b3826640 1 -- 172.21.15.120:0/2546882165 shutdown_connections 2023-12-19T05:38:55.845 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.841+0000 7f14b3826640 1 -- 172.21.15.120:0/2546882165 >> 172.21.15.120:0/2546882165 conn(0x7f14ac071430 msgr2=0x7f14ac071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:55.845 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.841+0000 7f14b3826640 1 -- 172.21.15.120:0/2546882165 shutdown_connections 2023-12-19T05:38:55.845 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.841+0000 7f14b3826640 1 -- 172.21.15.120:0/2546882165 wait complete. 2023-12-19T05:38:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.842+0000 7f14b3826640 1 Processor -- start 2023-12-19T05:38:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.842+0000 7f14b3826640 1 -- start start 2023-12-19T05:38:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.842+0000 7f14b3826640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14980039a0 0x7f14ac0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.850 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.842+0000 7f14b3826640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14ac14d6e0 0x7f14ac1df780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.842+0000 7f14b3826640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14ac1dfcc0 0x7f14ac1455b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.842+0000 7f14b3826640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac146b90 con 0x7f14980039a0 2023-12-19T05:38:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.842+0000 7f14b3826640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac1e0140 con 0x7f14ac1dfcc0 2023-12-19T05:38:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.842+0000 7f14b3826640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac14db40 con 0x7f14ac14d6e0 2023-12-19T05:38:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14b15c2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14980039a0 0x7f14ac0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14b15c2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14980039a0 0x7f14ac0af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48446/0 (socket says 172.21.15.120:48446) 2023-12-19T05:38:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14b15c2640 1 -- 172.21.15.120:0/3411001886 learned_addr learned my addr 172.21.15.120:0/3411001886 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14b0dc1640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14ac14d6e0 0x7f14ac1df780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14b1dc3640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14ac1dfcc0 0x7f14ac1455b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14b15c2640 1 -- 172.21.15.120:0/3411001886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14ac14d6e0 msgr2=0x7f14ac1df780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14b15c2640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14ac14d6e0 0x7f14ac1df780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.851 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14b15c2640 1 -- 172.21.15.120:0/3411001886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14ac1dfcc0 msgr2=0x7f14ac1455b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14b15c2640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14ac1dfcc0 0x7f14ac1455b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14b15c2640 1 -- 172.21.15.120:0/3411001886 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac0aee50 con 0x7f14980039a0 2023-12-19T05:38:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14b1dc3640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14ac1dfcc0 0x7f14ac1455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:38:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14b15c2640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14980039a0 0x7f14ac0af6e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14a802c710 tx=0x7f14a8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14a1ffb640 1 -- 172.21.15.120:0/3411001886 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a803e400 con 0x7f14980039a0 2023-12-19T05:38:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14a1ffb640 1 -- 172.21.15.120:0/3411001886 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a803e5a0 con 0x7f14980039a0 2023-12-19T05:38:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14b3826640 1 -- 172.21.15.120:0/3411001886 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ac147d30 con 0x7f14980039a0 2023-12-19T05:38:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14a1ffb640 1 -- 172.21.15.120:0/3411001886 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a803e950 con 0x7f14980039a0 2023-12-19T05:38:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.843+0000 7f14b3826640 1 -- 172.21.15.120:0/3411001886 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ac147950 con 0x7f14980039a0 2023-12-19T05:38:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.844+0000 7f14b3826640 1 -- 172.21.15.120:0/3411001886 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ac147ba0 con 0x7f14980039a0 2023-12-19T05:38:55.852 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.845+0000 7f14a1ffb640 1 -- 172.21.15.120:0/3411001886 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f14a803eab0 con 0x7f14980039a0 2023-12-19T05:38:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.845+0000 7f14a1ffb640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f149006a460 0x7f149006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.845+0000 7f14a1ffb640 1 -- 172.21.15.120:0/3411001886 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f14a80aadd0 con 0x7f14980039a0 2023-12-19T05:38:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.845+0000 7f14b0dc1640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f149006a460 0x7f149006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.845+0000 7f14b0dc1640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f149006a460 0x7f149006c920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0ae990 tx=0x7f149c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:55.853 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:55.849+0000 7f14a1ffb640 1 -- 172.21.15.120:0/3411001886 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f14a8076730 con 0x7f14980039a0 2023-12-19T05:38:56.017 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.016+0000 7f14b3826640 1 -- 172.21.15.120:0/3411001886 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f14ac04e080 con 0x7f14980039a0 2023-12-19T05:38:56.729 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.728+0000 7f14a1ffb640 1 -- 172.21.15.120:0/3411001886 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f14a804c0b0 con 0x7f14980039a0 2023-12-19T05:38:56.729 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' created 2023-12-19T05:38:56.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.731+0000 7f14b3826640 1 -- 172.21.15.120:0/3411001886 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f149006a460 msgr2=0x7f149006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:56.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.731+0000 7f14b3826640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f149006a460 0x7f149006c920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0ae990 tx=0x7f149c009040 comp rx=0 tx=0).stop 2023-12-19T05:38:56.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.731+0000 7f14b3826640 1 -- 172.21.15.120:0/3411001886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14980039a0 msgr2=0x7f14ac0af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:56.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.731+0000 7f14b3826640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14980039a0 0x7f14ac0af6e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14a802c710 tx=0x7f14a8009750 comp rx=0 tx=0).stop 2023-12-19T05:38:56.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.731+0000 7f14b3826640 1 -- 172.21.15.120:0/3411001886 shutdown_connections 2023-12-19T05:38:56.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.731+0000 7f14b3826640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f149006a460 0x7f149006c920 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:56.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.731+0000 7f14b3826640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f14ac1dfcc0 0x7f14ac1455b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:56.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.731+0000 7f14b3826640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f14ac14d6e0 0x7f14ac1df780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:56.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.731+0000 7f14b3826640 1 --2- 172.21.15.120:0/3411001886 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f14980039a0 0x7f14ac0af6e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:56.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.731+0000 7f14b3826640 1 -- 172.21.15.120:0/3411001886 >> 172.21.15.120:0/3411001886 conn(0x7f14ac071430 msgr2=0x7f14ac071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:56.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.731+0000 7f14b3826640 1 -- 172.21.15.120:0/3411001886 shutdown_connections 2023-12-19T05:38:56.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.731+0000 7f14b3826640 1 -- 172.21.15.120:0/3411001886 wait complete. 2023-12-19T05:38:56.746 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T05:38:56.854 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.852+0000 7efe38e26640 1 Processor -- start 2023-12-19T05:38:56.854 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.852+0000 7efe38e26640 1 -- start start 2023-12-19T05:38:56.855 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.853+0000 7efe38e26640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efe34144d70 0x7efe340b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:56.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.853+0000 7efe38e26640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe3414df70 0x7efe340b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:56.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.853+0000 7efe38e26640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7efe340bc7e0 0x7efe340bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:56.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.853+0000 7efe38e26640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe340b9f00 con 0x7efe34144d70 2023-12-19T05:38:56.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.853+0000 7efe38e26640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe340b84b0 con 0x7efe340bc7e0 2023-12-19T05:38:56.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.853+0000 7efe38e26640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe34145150 con 0x7efe3414df70 2023-12-19T05:38:56.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.853+0000 7efe3259c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efe34144d70 0x7efe340b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:56.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.853+0000 7efe3259c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efe34144d70 0x7efe340b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48458/0 (socket says 172.21.15.120:48458) 2023-12-19T05:38:56.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.853+0000 7efe3259c640 1 -- 172.21.15.120:0/1376255634 learned_addr learned my addr 172.21.15.120:0/1376255634 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:56.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.854+0000 7efe3259c640 1 -- 172.21.15.120:0/1376255634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe3414df70 msgr2=0x7efe340b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:56.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.854+0000 7efe3259c640 1 --2- 172.21.15.120:0/1376255634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe3414df70 0x7efe340b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:56.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.854+0000 7efe3259c640 1 -- 172.21.15.120:0/1376255634 >> v2:172.21.15.155:3300/0 conn(0x7efe340bc7e0 msgr2=0x7efe340bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:56.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.854+0000 7efe32d9d640 1 --2- 172.21.15.120:0/1376255634 >> v2:172.21.15.155:3300/0 conn(0x7efe340bc7e0 0x7efe340bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:56.856 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.854+0000 7efe3259c640 1 --2- 172.21.15.120:0/1376255634 >> v2:172.21.15.155:3300/0 conn(0x7efe340bc7e0 0x7efe340bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:56.857 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.854+0000 7efe3259c640 1 -- 172.21.15.120:0/1376255634 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe340b9080 con 0x7efe34144d70 2023-12-19T05:38:56.857 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.854+0000 7efe3259c640 1 --2- 172.21.15.120:0/1376255634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe34144d70 0x7efe340b7f70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe340b6b90 tx=0x7efe2402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d721099017b1ea server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:56.857 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.855+0000 7efe3159a640 1 -- 172.21.15.120:0/1376255634 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2402cb00 con 0x7efe34144d70 2023-12-19T05:38:56.857 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.855+0000 7efe3159a640 1 -- 172.21.15.120:0/1376255634 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2402cc60 con 0x7efe34144d70 2023-12-19T05:38:56.857 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.855+0000 7efe3159a640 1 -- 172.21.15.120:0/1376255634 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe240343f0 con 0x7efe34144d70 2023-12-19T05:38:56.859 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.855+0000 7efe38e26640 1 -- 172.21.15.120:0/1376255634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe34144d70 msgr2=0x7efe340b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:56.860 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.855+0000 7efe38e26640 1 --2- 172.21.15.120:0/1376255634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe34144d70 0x7efe340b7f70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe340b6b90 tx=0x7efe2402bf60 comp rx=0 tx=0).stop 2023-12-19T05:38:56.860 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.855+0000 7efe38e26640 1 -- 172.21.15.120:0/1376255634 shutdown_connections 2023-12-19T05:38:56.860 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.855+0000 7efe38e26640 1 --2- 172.21.15.120:0/1376255634 >> v2:172.21.15.155:3300/0 conn(0x7efe340bc7e0 0x7efe340bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:56.860 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.855+0000 7efe38e26640 1 --2- 172.21.15.120:0/1376255634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe3414df70 0x7efe340b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:56.860 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.855+0000 7efe38e26640 1 --2- 172.21.15.120:0/1376255634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe34144d70 0x7efe340b7f70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:56.860 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.855+0000 7efe38e26640 1 -- 172.21.15.120:0/1376255634 >> 172.21.15.120:0/1376255634 conn(0x7efe34071430 msgr2=0x7efe34071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:56.860 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.855+0000 7efe38e26640 1 -- 172.21.15.120:0/1376255634 shutdown_connections 2023-12-19T05:38:56.860 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.855+0000 7efe38e26640 1 -- 172.21.15.120:0/1376255634 wait complete. 2023-12-19T05:38:56.860 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.856+0000 7efe38e26640 1 Processor -- start 2023-12-19T05:38:56.860 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.856+0000 7efe38e26640 1 -- start start 2023-12-19T05:38:56.860 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe38e26640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe340bc7e0 0x7efe340ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:56.860 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe38e26640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe34144d70 0x7efe340be920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:56.860 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe38e26640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe3414df70 0x7efe340a8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:56.861 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe38e26640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe340bf370 con 0x7efe34144d70 2023-12-19T05:38:56.861 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe38e26640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe340aee50 con 0x7efe340bc7e0 2023-12-19T05:38:56.861 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe38e26640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe341478b0 con 0x7efe3414df70 2023-12-19T05:38:56.861 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe31d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe34144d70 0x7efe340be920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:56.861 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe31d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe34144d70 0x7efe340be920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48468/0 (socket says 172.21.15.120:48468) 2023-12-19T05:38:56.861 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe31d9b640 1 -- 172.21.15.120:0/4237571756 learned_addr learned my addr 172.21.15.120:0/4237571756 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:56.861 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe32d9d640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe3414df70 0x7efe340a8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:56.861 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe3259c640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe340bc7e0 0x7efe340ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:56.861 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe31d9b640 1 -- 172.21.15.120:0/4237571756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe3414df70 msgr2=0x7efe340a8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:56.861 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe31d9b640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe3414df70 0x7efe340a8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:56.861 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe31d9b640 1 -- 172.21.15.120:0/4237571756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe340bc7e0 msgr2=0x7efe340ae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:56.861 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe31d9b640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe340bc7e0 0x7efe340ae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:56.861 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe31d9b640 1 -- 172.21.15.120:0/4237571756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe24009b30 con 0x7efe34144d70 2023-12-19T05:38:56.862 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe3259c640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe340bc7e0 0x7efe340ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:38:56.862 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.857+0000 7efe32d9d640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe3414df70 0x7efe340a8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:38:56.862 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.858+0000 7efe31d9b640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe34144d70 0x7efe340be920 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe2800b410 tx=0x7efe2800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:56.862 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.858+0000 7efe22ffd640 1 -- 172.21.15.120:0/4237571756 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe28011830 con 0x7efe34144d70 2023-12-19T05:38:56.862 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.858+0000 7efe22ffd640 1 -- 172.21.15.120:0/4237571756 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe280119b0 con 0x7efe34144d70 2023-12-19T05:38:56.862 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.858+0000 7efe38e26640 1 -- 172.21.15.120:0/4237571756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe34147b50 con 0x7efe34144d70 2023-12-19T05:38:56.862 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.858+0000 7efe22ffd640 1 -- 172.21.15.120:0/4237571756 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe28011d60 con 0x7efe34144d70 2023-12-19T05:38:56.862 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.858+0000 7efe38e26640 1 -- 172.21.15.120:0/4237571756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe34148110 con 0x7efe34144d70 2023-12-19T05:38:56.862 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.859+0000 7efe38e26640 1 -- 172.21.15.120:0/4237571756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe340beec0 con 0x7efe34144d70 2023-12-19T05:38:56.863 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.859+0000 7efe22ffd640 1 -- 172.21.15.120:0/4237571756 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efe2801a400 con 0x7efe34144d70 2023-12-19T05:38:56.863 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.860+0000 7efe22ffd640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efe1406a430 0x7efe1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:56.863 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.860+0000 7efe22ffd640 1 -- 172.21.15.120:0/4237571756 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7efe28088870 con 0x7efe34144d70 2023-12-19T05:38:56.863 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.860+0000 7efe3259c640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efe1406a430 0x7efe1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:56.863 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.860+0000 7efe3259c640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efe1406a430 0x7efe1406c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe24035000 tx=0x7efe24030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:56.865 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:56.864+0000 7efe22ffd640 1 -- 172.21.15.120:0/4237571756 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efe28054040 con 0x7efe34144d70 2023-12-19T05:38:57.033 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.032+0000 7efe38e26640 1 -- 172.21.15.120:0/4237571756 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efe3404e080 con 0x7efe34144d70 2023-12-19T05:38:57.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.731+0000 7efe22ffd640 1 -- 172.21.15.120:0/4237571756 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7efe28015020 con 0x7efe34144d70 2023-12-19T05:38:57.732 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' created 2023-12-19T05:38:57.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.735+0000 7efe38e26640 1 -- 172.21.15.120:0/4237571756 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efe1406a430 msgr2=0x7efe1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.735+0000 7efe38e26640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efe1406a430 0x7efe1406c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe24035000 tx=0x7efe24030000 comp rx=0 tx=0).stop 2023-12-19T05:38:57.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.736+0000 7efe38e26640 1 -- 172.21.15.120:0/4237571756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe34144d70 msgr2=0x7efe340be920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.736+0000 7efe38e26640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe34144d70 0x7efe340be920 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efe2800b410 tx=0x7efe2800b8d0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.739 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.738+0000 7efe38e26640 1 -- 172.21.15.120:0/4237571756 shutdown_connections 2023-12-19T05:38:57.740 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.738+0000 7efe38e26640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efe1406a430 0x7efe1406c8f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.740 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.738+0000 7efe38e26640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe3414df70 0x7efe340a8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.740 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.738+0000 7efe38e26640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe34144d70 0x7efe340be920 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.740 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.739+0000 7efe38e26640 1 --2- 172.21.15.120:0/4237571756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe340bc7e0 0x7efe340ae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.740 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.739+0000 7efe38e26640 1 -- 172.21.15.120:0/4237571756 >> 172.21.15.120:0/4237571756 conn(0x7efe34071430 msgr2=0x7efe340b6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:57.741 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.740+0000 7efe38e26640 1 -- 172.21.15.120:0/4237571756 shutdown_connections 2023-12-19T05:38:57.742 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.742+0000 7efe38e26640 1 -- 172.21.15.120:0/4237571756 wait complete. 2023-12-19T05:38:57.760 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T05:38:57.864 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.863+0000 7ff702563640 1 Processor -- start 2023-12-19T05:38:57.864 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.863+0000 7ff702563640 1 -- start start 2023-12-19T05:38:57.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.863+0000 7ff702563640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff6fc144d70 0x7ff6fc0b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.863+0000 7ff702563640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc14df70 0x7ff6fc0b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.863+0000 7ff702563640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff6fc0bc7e0 0x7ff6fc0bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.863+0000 7ff702563640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc0b9f00 con 0x7ff6fc0bc7e0 2023-12-19T05:38:57.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.863+0000 7ff702563640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc0b84b0 con 0x7ff6fc144d70 2023-12-19T05:38:57.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.863+0000 7ff702563640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc145150 con 0x7ff6fc14df70 2023-12-19T05:38:57.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.864+0000 7ff700b00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff6fc0bc7e0 0x7ff6fc0bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.864+0000 7ff700b00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff6fc0bc7e0 0x7ff6fc0bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48484/0 (socket says 172.21.15.120:48484) 2023-12-19T05:38:57.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.864+0000 7ff700b00640 1 -- 172.21.15.120:0/2348513310 learned_addr learned my addr 172.21.15.120:0/2348513310 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:57.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.864+0000 7ff6fbfff640 1 --2- 172.21.15.120:0/2348513310 >> v2:172.21.15.155:3300/0 conn(0x7ff6fc144d70 0x7ff6fc0b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.864+0000 7ff6fb7fe640 1 --2- 172.21.15.120:0/2348513310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc14df70 0x7ff6fc0b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.864+0000 7ff700b00640 1 -- 172.21.15.120:0/2348513310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc14df70 msgr2=0x7ff6fc0b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:57.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.864+0000 7ff700b00640 1 --2- 172.21.15.120:0/2348513310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc14df70 0x7ff6fc0b8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.864+0000 7ff700b00640 1 -- 172.21.15.120:0/2348513310 >> v2:172.21.15.155:3300/0 conn(0x7ff6fc144d70 msgr2=0x7ff6fc0b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:57.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.864+0000 7ff700b00640 1 --2- 172.21.15.120:0/2348513310 >> v2:172.21.15.155:3300/0 conn(0x7ff6fc144d70 0x7ff6fc0b7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.864+0000 7ff700b00640 1 -- 172.21.15.120:0/2348513310 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0b9080 con 0x7ff6fc0bc7e0 2023-12-19T05:38:57.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.864+0000 7ff6fbfff640 1 --2- 172.21.15.120:0/2348513310 >> v2:172.21.15.155:3300/0 conn(0x7ff6fc144d70 0x7ff6fc0b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:57.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.865+0000 7ff700b00640 1 --2- 172.21.15.120:0/2348513310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6fc0bc7e0 0x7ff6fc0bcc70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0c1400 tx=0x7ff6f402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12112599ff3300b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:57.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.865+0000 7ff6faffd640 1 -- 172.21.15.120:0/2348513310 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f402cb00 con 0x7ff6fc0bc7e0 2023-12-19T05:38:57.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.865+0000 7ff6faffd640 1 -- 172.21.15.120:0/2348513310 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f402cc60 con 0x7ff6fc0bc7e0 2023-12-19T05:38:57.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.865+0000 7ff6faffd640 1 -- 172.21.15.120:0/2348513310 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f40343f0 con 0x7ff6fc0bc7e0 2023-12-19T05:38:57.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.865+0000 7ff702563640 1 -- 172.21.15.120:0/2348513310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6fc0bc7e0 msgr2=0x7ff6fc0bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.865+0000 7ff702563640 1 --2- 172.21.15.120:0/2348513310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6fc0bc7e0 0x7ff6fc0bcc70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc0c1400 tx=0x7ff6f402bf60 comp rx=0 tx=0).stop 2023-12-19T05:38:57.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.865+0000 7ff702563640 1 -- 172.21.15.120:0/2348513310 shutdown_connections 2023-12-19T05:38:57.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.865+0000 7ff702563640 1 --2- 172.21.15.120:0/2348513310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6fc0bc7e0 0x7ff6fc0bcc70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.865+0000 7ff702563640 1 --2- 172.21.15.120:0/2348513310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc14df70 0x7ff6fc0b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.865+0000 7ff702563640 1 --2- 172.21.15.120:0/2348513310 >> v2:172.21.15.155:3300/0 conn(0x7ff6fc144d70 0x7ff6fc0b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.865+0000 7ff702563640 1 -- 172.21.15.120:0/2348513310 >> 172.21.15.120:0/2348513310 conn(0x7ff6fc071430 msgr2=0x7ff6fc071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:57.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.865+0000 7ff702563640 1 -- 172.21.15.120:0/2348513310 shutdown_connections 2023-12-19T05:38:57.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.865+0000 7ff702563640 1 -- 172.21.15.120:0/2348513310 wait complete. 2023-12-19T05:38:57.872 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.866+0000 7ff702563640 1 Processor -- start 2023-12-19T05:38:57.872 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.867+0000 7ff702563640 1 -- start start 2023-12-19T05:38:57.872 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.867+0000 7ff702563640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc0bc7e0 0x7ff6fc145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.872 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.867+0000 7ff702563640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6fc144d70 0x7ff6fc1dfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.872 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.867+0000 7ff702563640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6fc14df70 0x7ff6fc0adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.872 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.867+0000 7ff702563640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc1465d0 con 0x7ff6fc14df70 2023-12-19T05:38:57.872 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.867+0000 7ff702563640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc147330 con 0x7ff6fc144d70 2023-12-19T05:38:57.872 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.867+0000 7ff702563640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc146370 con 0x7ff6fc0bc7e0 2023-12-19T05:38:57.872 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.867+0000 7ff700b00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6fc14df70 0x7ff6fc0adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.872 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.867+0000 7ff700b00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6fc14df70 0x7ff6fc0adc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48490/0 (socket says 172.21.15.120:48490) 2023-12-19T05:38:57.872 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.867+0000 7ff700b00640 1 -- 172.21.15.120:0/4279154723 learned_addr learned my addr 172.21.15.120:0/4279154723 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:57.872 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.867+0000 7ff6fb7fe640 1 --2- 172.21.15.120:0/4279154723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6fc144d70 0x7ff6fc1dfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.873 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.867+0000 7ff6fbfff640 1 --2- 172.21.15.120:0/4279154723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc0bc7e0 0x7ff6fc145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.873 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.868+0000 7ff700b00640 1 -- 172.21.15.120:0/4279154723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc0bc7e0 msgr2=0x7ff6fc145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.873 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.868+0000 7ff700b00640 1 --2- 172.21.15.120:0/4279154723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc0bc7e0 0x7ff6fc145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.873 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.868+0000 7ff700b00640 1 -- 172.21.15.120:0/4279154723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6fc144d70 msgr2=0x7ff6fc1dfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:57.873 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.868+0000 7ff700b00640 1 --2- 172.21.15.120:0/4279154723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6fc144d70 0x7ff6fc1dfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:57.873 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.868+0000 7ff700b00640 1 -- 172.21.15.120:0/4279154723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f4009b30 con 0x7ff6fc14df70 2023-12-19T05:38:57.873 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.868+0000 7ff700b00640 1 --2- 172.21.15.120:0/4279154723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6fc14df70 0x7ff6fc0adc70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4036040 tx=0x7ff6f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:57.873 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.868+0000 7ff6f8ff9640 1 -- 172.21.15.120:0/4279154723 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4009510 con 0x7ff6fc14df70 2023-12-19T05:38:57.873 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.868+0000 7ff6f8ff9640 1 -- 172.21.15.120:0/4279154723 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f403e450 con 0x7ff6fc14df70 2023-12-19T05:38:57.873 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.868+0000 7ff702563640 1 -- 172.21.15.120:0/4279154723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc0aeb00 con 0x7ff6fc14df70 2023-12-19T05:38:57.873 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.868+0000 7ff6f8ff9640 1 -- 172.21.15.120:0/4279154723 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f403e7e0 con 0x7ff6fc14df70 2023-12-19T05:38:57.873 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.868+0000 7ff702563640 1 -- 172.21.15.120:0/4279154723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc0af0c0 con 0x7ff6fc14df70 2023-12-19T05:38:57.874 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.869+0000 7ff702563640 1 -- 172.21.15.120:0/4279154723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc0af2e0 con 0x7ff6fc14df70 2023-12-19T05:38:57.874 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.869+0000 7ff6f8ff9640 1 -- 172.21.15.120:0/4279154723 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff6f403e940 con 0x7ff6fc14df70 2023-12-19T05:38:57.874 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.870+0000 7ff6f8ff9640 1 --2- 172.21.15.120:0/4279154723 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff6e806a430 0x7ff6e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:57.874 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.870+0000 7ff6f8ff9640 1 -- 172.21.15.120:0/4279154723 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7ff6f40ab8a0 con 0x7ff6fc14df70 2023-12-19T05:38:57.874 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.870+0000 7ff6fbfff640 1 --2- 172.21.15.120:0/4279154723 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff6e806a430 0x7ff6e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:57.874 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.870+0000 7ff6fbfff640 1 --2- 172.21.15.120:0/4279154723 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff6e806a430 0x7ff6e806c8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0006b10 tx=0x7ff6f0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:57.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:57.874+0000 7ff6f8ff9640 1 -- 172.21.15.120:0/4279154723 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff6f4076fa0 con 0x7ff6fc14df70 2023-12-19T05:38:57.970 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:38:57.973 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:38:57.975 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:38:58.081 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.080+0000 7ff702563640 1 -- 172.21.15.120:0/4279154723 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff6fc04e080 con 0x7ff6fc14df70 2023-12-19T05:38:58.089 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.088+0000 7ff6f8ff9640 1 -- 172.21.15.120:0/4279154723 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff6f407a5c0 con 0x7ff6fc14df70 2023-12-19T05:38:58.090 INFO:teuthology.orchestra.run.smithi120.stderr:new fs with metadata pool 2 and data pool 3 2023-12-19T05:38:58.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.096+0000 7ff702563640 1 -- 172.21.15.120:0/4279154723 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff6e806a430 msgr2=0x7ff6e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.096+0000 7ff702563640 1 --2- 172.21.15.120:0/4279154723 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff6e806a430 0x7ff6e806c8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0006b10 tx=0x7ff6f0008040 comp rx=0 tx=0).stop 2023-12-19T05:38:58.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.096+0000 7ff702563640 1 -- 172.21.15.120:0/4279154723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6fc14df70 msgr2=0x7ff6fc0adc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.096+0000 7ff702563640 1 --2- 172.21.15.120:0/4279154723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6fc14df70 0x7ff6fc0adc70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4036040 tx=0x7ff6f4004a40 comp rx=0 tx=0).stop 2023-12-19T05:38:58.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.097+0000 7ff702563640 1 -- 172.21.15.120:0/4279154723 shutdown_connections 2023-12-19T05:38:58.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.097+0000 7ff702563640 1 --2- 172.21.15.120:0/4279154723 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff6e806a430 0x7ff6e806c8f0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0006b10 tx=0x7ff6f0008040 comp rx=0 tx=0).stop 2023-12-19T05:38:58.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.097+0000 7ff702563640 1 --2- 172.21.15.120:0/4279154723 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff6fc14df70 0x7ff6fc0adc70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.097+0000 7ff702563640 1 --2- 172.21.15.120:0/4279154723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff6fc144d70 0x7ff6fc1dfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.097+0000 7ff702563640 1 --2- 172.21.15.120:0/4279154723 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff6fc0bc7e0 0x7ff6fc145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.097+0000 7ff702563640 1 -- 172.21.15.120:0/4279154723 >> 172.21.15.120:0/4279154723 conn(0x7ff6fc071430 msgr2=0x7ff6fc0bcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:58.100 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.099+0000 7ff702563640 1 -- 172.21.15.120:0/4279154723 shutdown_connections 2023-12-19T05:38:58.100 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.099+0000 7ff702563640 1 -- 172.21.15.120:0/4279154723 wait complete. 2023-12-19T05:38:58.117 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:38:58.217 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.216+0000 7fd5de4b6640 1 Processor -- start 2023-12-19T05:38:58.217 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.216+0000 7fd5de4b6640 1 -- start start 2023-12-19T05:38:58.219 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.216+0000 7fd5de4b6640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd5d80b79b0 0x7fd5d80b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.219 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.216+0000 7fd5de4b6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d814b230 0x7fd5d814b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.219 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.216+0000 7fd5de4b6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d80b96b0 con 0x7fd5d80b8860 2023-12-19T05:38:58.219 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.216+0000 7fd5de4b6640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d814ae10 con 0x7fd5d80b79b0 2023-12-19T05:38:58.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.216+0000 7fd5de4b6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d80bacc0 con 0x7fd5d814b230 2023-12-19T05:38:58.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.216+0000 7fd5d7fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd5d80b79b0 0x7fd5d80b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.216+0000 7fd5d7fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd5d80b79b0 0x7fd5d80b7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48502/0 (socket says 172.21.15.120:48502) 2023-12-19T05:38:58.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.216+0000 7fd5d7fff640 1 -- 172.21.15.120:0/1814082347 learned_addr learned my addr 172.21.15.120:0/1814082347 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:58.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.217+0000 7fd5dca53640 1 --2- 172.21.15.120:0/1814082347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d814b230 0x7fd5d814b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.217+0000 7fd5d7fff640 1 -- 172.21.15.120:0/1814082347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d814b230 msgr2=0x7fd5d814b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:58.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.217+0000 7fd5d7fff640 1 --2- 172.21.15.120:0/1814082347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d814b230 0x7fd5d814b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.217+0000 7fd5d7fff640 1 -- 172.21.15.120:0/1814082347 >> v1:172.21.15.155:6789/0 conn(0x7fd5d80b8860 legacy=0x7fd5d8144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.217+0000 7fd5d7fff640 1 -- 172.21.15.120:0/1814082347 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d80b90f0 con 0x7fd5d80b79b0 2023-12-19T05:38:58.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.217+0000 7fd5d7fff640 1 --2- 172.21.15.120:0/1814082347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5d80b79b0 0x7fd5d80b7d90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009870 tx=0x7fd5cc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e49f6073a7dc35 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.218+0000 7fd5d6ffd640 1 -- 172.21.15.120:0/1814082347 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc030840 con 0x7fd5d80b79b0 2023-12-19T05:38:58.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.218+0000 7fd5d6ffd640 1 -- 172.21.15.120:0/1814082347 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc0309a0 con 0x7fd5d80b79b0 2023-12-19T05:38:58.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.218+0000 7fd5d6ffd640 1 -- 172.21.15.120:0/1814082347 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc030d30 con 0x7fd5d80b79b0 2023-12-19T05:38:58.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.218+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1814082347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5d80b79b0 msgr2=0x7fd5d80b7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.218+0000 7fd5de4b6640 1 --2- 172.21.15.120:0/1814082347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5d80b79b0 0x7fd5d80b7d90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009870 tx=0x7fd5cc02b980 comp rx=0 tx=0).stop 2023-12-19T05:38:58.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.218+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1814082347 shutdown_connections 2023-12-19T05:38:58.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.218+0000 7fd5de4b6640 1 --2- 172.21.15.120:0/1814082347 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d814b230 0x7fd5d814b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.218+0000 7fd5de4b6640 1 --2- 172.21.15.120:0/1814082347 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5d80b79b0 0x7fd5d80b7d90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.218+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1814082347 >> 172.21.15.120:0/1814082347 conn(0x7fd5d80c0340 msgr2=0x7fd5d80c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:58.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.218+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1814082347 shutdown_connections 2023-12-19T05:38:58.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.218+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1814082347 wait complete. 2023-12-19T05:38:58.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.219+0000 7fd5de4b6640 1 Processor -- start 2023-12-19T05:38:58.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.219+0000 7fd5de4b6640 1 -- start start 2023-12-19T05:38:58.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5de4b6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d80b79b0 0x7fd5d80b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5de4b6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5d80b8860 0x7fd5d81d2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5de4b6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5d814b230 0x7fd5d81476b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5de4b6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d80b67e0 con 0x7fd5d80b8860 2023-12-19T05:38:58.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5de4b6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d80bbb90 con 0x7fd5d814b230 2023-12-19T05:38:58.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5de4b6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d81d0b80 con 0x7fd5d80b79b0 2023-12-19T05:38:58.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5d77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5d80b8860 0x7fd5d81d2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5d77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5d80b8860 0x7fd5d81d2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48518/0 (socket says 172.21.15.120:48518) 2023-12-19T05:38:58.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5d77fe640 1 -- 172.21.15.120:0/1679431909 learned_addr learned my addr 172.21.15.120:0/1679431909 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:58.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5d77fe640 1 -- 172.21.15.120:0/1679431909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d80b79b0 msgr2=0x7fd5d80b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5d77fe640 1 --2- 172.21.15.120:0/1679431909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d80b79b0 0x7fd5d80b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5d77fe640 1 -- 172.21.15.120:0/1679431909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5d814b230 msgr2=0x7fd5d81476b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5d77fe640 1 --2- 172.21.15.120:0/1679431909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5d814b230 0x7fd5d81476b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5d77fe640 1 -- 172.21.15.120:0/1679431909 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc0094d0 con 0x7fd5d80b8860 2023-12-19T05:38:58.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.220+0000 7fd5d77fe640 1 --2- 172.21.15.120:0/1679431909 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5d80b8860 0x7fd5d81d2e90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800c400 tx=0x7fd5c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.221+0000 7fd5d4ff9640 1 -- 172.21.15.120:0/1679431909 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c80052d0 con 0x7fd5d80b8860 2023-12-19T05:38:58.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.221+0000 7fd5d4ff9640 1 -- 172.21.15.120:0/1679431909 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c8005430 con 0x7fd5d80b8860 2023-12-19T05:38:58.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.221+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1679431909 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d81d0dd0 con 0x7fd5d80b8860 2023-12-19T05:38:58.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.221+0000 7fd5d4ff9640 1 -- 172.21.15.120:0/1679431909 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8003830 con 0x7fd5d80b8860 2023-12-19T05:38:58.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.221+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1679431909 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d8149060 con 0x7fd5d80b8860 2023-12-19T05:38:58.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.222+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1679431909 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d804e080 con 0x7fd5d80b8860 2023-12-19T05:38:58.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.222+0000 7fd5d4ff9640 1 -- 172.21.15.120:0/1679431909 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd5c8003990 con 0x7fd5d80b8860 2023-12-19T05:38:58.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.222+0000 7fd5d4ff9640 1 --2- 172.21.15.120:0/1679431909 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd5c406a430 0x7fd5c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.222+0000 7fd5d4ff9640 1 -- 172.21.15.120:0/1679431909 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5c8087e20 con 0x7fd5d80b8860 2023-12-19T05:38:58.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.222+0000 7fd5d7fff640 1 --2- 172.21.15.120:0/1679431909 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd5c406a430 0x7fd5c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.223+0000 7fd5d7fff640 1 --2- 172.21.15.120:0/1679431909 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd5c406a430 0x7fd5c406c8f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc036000 tx=0x7fd5cc03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.227+0000 7fd5d4ff9640 1 -- 172.21.15.120:0/1679431909 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd5c80534a0 con 0x7fd5d80b8860 2023-12-19T05:38:58.397 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.396+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1679431909 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5d8149eb0 con 0x7fd5d80b8860 2023-12-19T05:38:58.398 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.397+0000 7fd5d4ff9640 1 -- 172.21.15.120:0/1679431909 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16098 (secure 0 0 0) 0x7fd5c8056ac0 con 0x7fd5d80b8860 2023-12-19T05:38:58.399 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:38:58.399 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":19,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:58.081390+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:38:58.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.399+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1679431909 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd5c406a430 msgr2=0x7fd5c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.399+0000 7fd5de4b6640 1 --2- 172.21.15.120:0/1679431909 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd5c406a430 0x7fd5c406c8f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc036000 tx=0x7fd5cc03b040 comp rx=0 tx=0).stop 2023-12-19T05:38:58.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.399+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1679431909 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5d80b8860 msgr2=0x7fd5d81d2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.399+0000 7fd5de4b6640 1 --2- 172.21.15.120:0/1679431909 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5d80b8860 0x7fd5d81d2e90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd5c800c400 tx=0x7fd5c800c8c0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.399+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1679431909 shutdown_connections 2023-12-19T05:38:58.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.399+0000 7fd5de4b6640 1 --2- 172.21.15.120:0/1679431909 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd5c406a430 0x7fd5c406c8f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.399+0000 7fd5de4b6640 1 --2- 172.21.15.120:0/1679431909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5d814b230 0x7fd5d81476b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.399+0000 7fd5de4b6640 1 --2- 172.21.15.120:0/1679431909 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd5d80b8860 0x7fd5d81d2e90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.399+0000 7fd5de4b6640 1 --2- 172.21.15.120:0/1679431909 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd5d80b79b0 0x7fd5d80b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.399+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1679431909 >> 172.21.15.120:0/1679431909 conn(0x7fd5d80c0340 msgr2=0x7fd5d80bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:58.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.400+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1679431909 shutdown_connections 2023-12-19T05:38:58.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.400+0000 7fd5de4b6640 1 -- 172.21.15.120:0/1679431909 wait complete. 2023-12-19T05:38:58.411 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:38:58.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.508+0000 7f520f4ec640 1 Processor -- start 2023-12-19T05:38:58.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.509+0000 7f520f4ec640 1 -- start start 2023-12-19T05:38:58.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.509+0000 7f520f4ec640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f520806b080 0x7f5208071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.509+0000 7f520f4ec640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5208141cf0 0x7f5208152040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.509+0000 7f520f4ec640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52080b9450 con 0x7f5208070c30 2023-12-19T05:38:58.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.509+0000 7f520f4ec640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5208070830 con 0x7f520806b080 2023-12-19T05:38:58.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.509+0000 7f520f4ec640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5208071950 con 0x7f5208141cf0 2023-12-19T05:38:58.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.509+0000 7f520d288640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f520806b080 0x7f5208071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.509+0000 7f520d288640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f520806b080 0x7f5208071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48524/0 (socket says 172.21.15.120:48524) 2023-12-19T05:38:58.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.509+0000 7f520d288640 1 -- 172.21.15.120:0/3135523301 learned_addr learned my addr 172.21.15.120:0/3135523301 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:58.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.509+0000 7f520ca87640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5208070c30 0x7f52081415e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50354/0 (socket says 172.21.15.120:50354) 2023-12-19T05:38:58.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.510+0000 7f520d288640 1 -- 172.21.15.120:0/3135523301 >> v2:172.21.15.155:3300/0 conn(0x7f5208141cf0 msgr2=0x7f5208152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:58.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.510+0000 7f520d288640 1 --2- 172.21.15.120:0/3135523301 >> v2:172.21.15.155:3300/0 conn(0x7f5208141cf0 0x7f5208152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.510+0000 7f520d288640 1 -- 172.21.15.120:0/3135523301 >> v1:172.21.15.120:6789/0 conn(0x7f5208070c30 legacy=0x7f52081415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.510+0000 7f51fffff640 1 -- 172.21.15.120:0/3135523301 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3997968485 0 0) 0x7f52080b9450 con 0x7f5208070c30 2023-12-19T05:38:58.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.510+0000 7f520d288640 1 -- 172.21.15.120:0/3135523301 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520806ff80 con 0x7f520806b080 2023-12-19T05:38:58.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.510+0000 7f520d288640 1 --2- 172.21.15.120:0/3135523301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f520806b080 0x7f5208071410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f52080b3930 tx=0x7f520002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d9ced55dcfcdd6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.510+0000 7f51fffff640 1 -- 172.21.15.120:0/3135523301 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520002cbb0 con 0x7f520806b080 2023-12-19T05:38:58.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.510+0000 7f51fffff640 1 -- 172.21.15.120:0/3135523301 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520002cd10 con 0x7f520806b080 2023-12-19T05:38:58.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.510+0000 7f51fffff640 1 -- 172.21.15.120:0/3135523301 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200034610 con 0x7f520806b080 2023-12-19T05:38:58.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.511+0000 7f520f4ec640 1 -- 172.21.15.120:0/3135523301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f520806b080 msgr2=0x7f5208071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.511+0000 7f520f4ec640 1 --2- 172.21.15.120:0/3135523301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f520806b080 0x7f5208071410 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f52080b3930 tx=0x7f520002c010 comp rx=0 tx=0).stop 2023-12-19T05:38:58.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.511+0000 7f520f4ec640 1 -- 172.21.15.120:0/3135523301 shutdown_connections 2023-12-19T05:38:58.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.511+0000 7f520f4ec640 1 --2- 172.21.15.120:0/3135523301 >> v2:172.21.15.155:3300/0 conn(0x7f5208141cf0 0x7f5208152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.511+0000 7f520f4ec640 1 --2- 172.21.15.120:0/3135523301 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f520806b080 0x7f5208071410 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.511+0000 7f520f4ec640 1 -- 172.21.15.120:0/3135523301 >> 172.21.15.120:0/3135523301 conn(0x7f52080bcfd0 msgr2=0x7f52080bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:58.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.511+0000 7f520f4ec640 1 -- 172.21.15.120:0/3135523301 shutdown_connections 2023-12-19T05:38:58.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.511+0000 7f520f4ec640 1 -- 172.21.15.120:0/3135523301 wait complete. 2023-12-19T05:38:58.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.512+0000 7f520f4ec640 1 Processor -- start 2023-12-19T05:38:58.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.512+0000 7f520f4ec640 1 -- start start 2023-12-19T05:38:58.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520f4ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f520806b080 0x7f5208144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520f4ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5208070c30 0x7f52081cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520f4ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5208141cf0 0x7f520813bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520f4ec640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52081debe0 con 0x7f5208141cf0 2023-12-19T05:38:58.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520f4ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52081ddc60 con 0x7f5208070c30 2023-12-19T05:38:58.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520f4ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52081cecd0 con 0x7f520806b080 2023-12-19T05:38:58.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520da89640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5208141cf0 0x7f520813bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520da89640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5208141cf0 0x7f520813bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48538/0 (socket says 172.21.15.120:48538) 2023-12-19T05:38:58.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520da89640 1 -- 172.21.15.120:0/3941326527 learned_addr learned my addr 172.21.15.120:0/3941326527 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:58.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520d288640 1 --2- 172.21.15.120:0/3941326527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f520806b080 0x7f5208144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520ca87640 1 --2- 172.21.15.120:0/3941326527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5208070c30 0x7f52081cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520da89640 1 -- 172.21.15.120:0/3941326527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f520806b080 msgr2=0x7f5208144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520da89640 1 --2- 172.21.15.120:0/3941326527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f520806b080 0x7f5208144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520da89640 1 -- 172.21.15.120:0/3941326527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5208070c30 msgr2=0x7f52081cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520da89640 1 --2- 172.21.15.120:0/3941326527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5208070c30 0x7f52081cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520da89640 1 -- 172.21.15.120:0/3941326527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5200009b30 con 0x7f5208141cf0 2023-12-19T05:38:58.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520da89640 1 --2- 172.21.15.120:0/3941326527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5208141cf0 0x7f520813bd80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f520400b410 tx=0x7f520400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f51fdffb640 1 -- 172.21.15.120:0/3941326527 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204011830 con 0x7f5208141cf0 2023-12-19T05:38:58.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f51fdffb640 1 -- 172.21.15.120:0/3941326527 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52040119b0 con 0x7f5208141cf0 2023-12-19T05:38:58.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f520f4ec640 1 -- 172.21.15.120:0/3941326527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52081d0590 con 0x7f5208141cf0 2023-12-19T05:38:58.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.513+0000 7f51fdffb640 1 -- 172.21.15.120:0/3941326527 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204011d60 con 0x7f5208141cf0 2023-12-19T05:38:58.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.514+0000 7f520f4ec640 1 -- 172.21.15.120:0/3941326527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5208145130 con 0x7f5208141cf0 2023-12-19T05:38:58.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.514+0000 7f520f4ec640 1 -- 172.21.15.120:0/3941326527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52081cf490 con 0x7f5208141cf0 2023-12-19T05:38:58.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.515+0000 7f51fdffb640 1 -- 172.21.15.120:0/3941326527 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f520401a400 con 0x7f5208141cf0 2023-12-19T05:38:58.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.515+0000 7f51fdffb640 1 --2- 172.21.15.120:0/3941326527 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f51ec06a430 0x7f51ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.515+0000 7f51fdffb640 1 -- 172.21.15.120:0/3941326527 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5204088a40 con 0x7f5208141cf0 2023-12-19T05:38:58.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.515+0000 7f520d288640 1 --2- 172.21.15.120:0/3941326527 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f51ec06a430 0x7f51ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.516+0000 7f520d288640 1 --2- 172.21.15.120:0/3941326527 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f51ec06a430 0x7f51ec06c8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5200035000 tx=0x7f5200030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.519+0000 7f51fdffb640 1 -- 172.21.15.120:0/3941326527 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f52081cf490 con 0x7f5208141cf0 2023-12-19T05:38:58.689 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.688+0000 7f520f4ec640 1 -- 172.21.15.120:0/3941326527 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52081cf490 con 0x7f5208141cf0 2023-12-19T05:38:58.690 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.689+0000 7f51fdffb640 1 -- 172.21.15.120:0/3941326527 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16098 (secure 0 0 0) 0x7f52081cf490 con 0x7f5208141cf0 2023-12-19T05:38:58.690 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:38:58.690 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":19,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:58.081390+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:38:58.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.691+0000 7f520f4ec640 1 -- 172.21.15.120:0/3941326527 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f51ec06a430 msgr2=0x7f51ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.691+0000 7f520f4ec640 1 --2- 172.21.15.120:0/3941326527 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f51ec06a430 0x7f51ec06c8f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5200035000 tx=0x7f5200030000 comp rx=0 tx=0).stop 2023-12-19T05:38:58.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.691+0000 7f520f4ec640 1 -- 172.21.15.120:0/3941326527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5208141cf0 msgr2=0x7f520813bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.691+0000 7f520f4ec640 1 --2- 172.21.15.120:0/3941326527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5208141cf0 0x7f520813bd80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f520400b410 tx=0x7f520400b8d0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.691+0000 7f520f4ec640 1 -- 172.21.15.120:0/3941326527 shutdown_connections 2023-12-19T05:38:58.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.691+0000 7f520f4ec640 1 --2- 172.21.15.120:0/3941326527 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f51ec06a430 0x7f51ec06c8f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.691+0000 7f520f4ec640 1 --2- 172.21.15.120:0/3941326527 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5208141cf0 0x7f520813bd80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.691+0000 7f520f4ec640 1 --2- 172.21.15.120:0/3941326527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5208070c30 0x7f52081cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.691+0000 7f520f4ec640 1 --2- 172.21.15.120:0/3941326527 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f520806b080 0x7f5208144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.691+0000 7f520f4ec640 1 -- 172.21.15.120:0/3941326527 >> 172.21.15.120:0/3941326527 conn(0x7f52080bcfd0 msgr2=0x7f520813f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:58.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.691+0000 7f520f4ec640 1 -- 172.21.15.120:0/3941326527 shutdown_connections 2023-12-19T05:38:58.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.691+0000 7f520f4ec640 1 -- 172.21.15.120:0/3941326527 wait complete. 2023-12-19T05:38:58.704 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T05:38:58.807 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.806+0000 7f526f5d2640 1 Processor -- start 2023-12-19T05:38:58.807 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.806+0000 7f526f5d2640 1 -- start start 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.807+0000 7f526f5d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5268144d70 0x7f52680b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.807+0000 7f526f5d2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f52680bc7e0 0x7f52680bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.807+0000 7f526f5d2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5268145150 con 0x7f526814df70 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.807+0000 7f526f5d2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52680b9f00 con 0x7f52680bc7e0 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.807+0000 7f526f5d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680b84b0 con 0x7f5268144d70 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.807+0000 7f526d36e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5268144d70 0x7f52680b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.807+0000 7f526db6f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f52680bc7e0 0x7f52680bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.807+0000 7f526d36e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5268144d70 0x7f52680b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:44036/0 (socket says 172.21.15.120:44036) 2023-12-19T05:38:58.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.807+0000 7f526d36e640 1 -- 172.21.15.120:0/1163169382 learned_addr learned my addr 172.21.15.120:0/1163169382 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.807+0000 7f525ffff640 1 -- 172.21.15.120:0/1163169382 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1359705780 0 0) 0x7f5268145150 con 0x7f526814df70 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.807+0000 7f525ffff640 1 -- 172.21.15.120:0/1163169382 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5254003520 con 0x7f526814df70 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.808+0000 7f526d36e640 1 -- 172.21.15.120:0/1163169382 >> v2:172.21.15.155:3300/0 conn(0x7f52680bc7e0 msgr2=0x7f52680bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.808+0000 7f526d36e640 1 --2- 172.21.15.120:0/1163169382 >> v2:172.21.15.155:3300/0 conn(0x7f52680bc7e0 0x7f52680bcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.808+0000 7f526d36e640 1 -- 172.21.15.120:0/1163169382 >> v1:172.21.15.155:6789/0 conn(0x7f526814df70 legacy=0x7f52680b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.808+0000 7f526d36e640 1 -- 172.21.15.120:0/1163169382 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680b9080 con 0x7f5268144d70 2023-12-19T05:38:58.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.808+0000 7f526db6f640 1 --2- 172.21.15.120:0/1163169382 >> v2:172.21.15.155:3300/0 conn(0x7f52680bc7e0 0x7f52680bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:38:58.813 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.808+0000 7f526d36e640 1 --2- 172.21.15.120:0/1163169382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5268144d70 0x7f52680b7f70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5264009870 tx=0x7f526402ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f82763866354690f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.813 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.808+0000 7f525ffff640 1 -- 172.21.15.120:0/1163169382 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526402f840 con 0x7f5268144d70 2023-12-19T05:38:58.813 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.808+0000 7f525ffff640 1 -- 172.21.15.120:0/1163169382 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526402f9a0 con 0x7f5268144d70 2023-12-19T05:38:58.813 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.808+0000 7f525ffff640 1 -- 172.21.15.120:0/1163169382 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526402fd30 con 0x7f5268144d70 2023-12-19T05:38:58.813 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.809+0000 7f526f5d2640 1 -- 172.21.15.120:0/1163169382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5268144d70 msgr2=0x7f52680b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.813 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.809+0000 7f526f5d2640 1 --2- 172.21.15.120:0/1163169382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5268144d70 0x7f52680b7f70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5264009870 tx=0x7f526402ba20 comp rx=0 tx=0).stop 2023-12-19T05:38:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.809+0000 7f526f5d2640 1 -- 172.21.15.120:0/1163169382 shutdown_connections 2023-12-19T05:38:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.809+0000 7f526f5d2640 1 --2- 172.21.15.120:0/1163169382 >> v2:172.21.15.155:3300/0 conn(0x7f52680bc7e0 0x7f52680bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.809+0000 7f526f5d2640 1 --2- 172.21.15.120:0/1163169382 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5268144d70 0x7f52680b7f70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.809+0000 7f526f5d2640 1 -- 172.21.15.120:0/1163169382 >> 172.21.15.120:0/1163169382 conn(0x7f5268071430 msgr2=0x7f5268071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.809+0000 7f526f5d2640 1 -- 172.21.15.120:0/1163169382 shutdown_connections 2023-12-19T05:38:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.809+0000 7f526f5d2640 1 -- 172.21.15.120:0/1163169382 wait complete. 2023-12-19T05:38:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.810+0000 7f526f5d2640 1 Processor -- start 2023-12-19T05:38:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.810+0000 7f526f5d2640 1 -- start start 2023-12-19T05:38:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526f5d2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52680bc7e0 0x7f52680c0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526f5d2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5268144d70 0x7f52681dfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526f5d2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f526814df70 0x7f52680be3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526f5d2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680be900 con 0x7f5268144d70 2023-12-19T05:38:58.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526f5d2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680bedb0 con 0x7f526814df70 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526f5d2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680bfe30 con 0x7f52680bc7e0 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526cb6d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5268144d70 0x7f52681dfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526cb6d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5268144d70 0x7f52681dfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48544/0 (socket says 172.21.15.120:48544) 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526d36e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52680bc7e0 0x7f52680c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526cb6d640 1 -- 172.21.15.120:0/2453064215 learned_addr learned my addr 172.21.15.120:0/2453064215 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526db6f640 1 --2- 172.21.15.120:0/2453064215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f526814df70 0x7f52680be3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526cb6d640 1 -- 172.21.15.120:0/2453064215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52680bc7e0 msgr2=0x7f52680c0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526cb6d640 1 --2- 172.21.15.120:0/2453064215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52680bc7e0 0x7f52680c0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526cb6d640 1 -- 172.21.15.120:0/2453064215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f526814df70 msgr2=0x7f52680be3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526cb6d640 1 --2- 172.21.15.120:0/2453064215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f526814df70 0x7f52680be3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526cb6d640 1 -- 172.21.15.120:0/2453064215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260009a70 con 0x7f5268144d70 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526cb6d640 1 --2- 172.21.15.120:0/2453064215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5268144d70 0x7f52681dfad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f525800c460 tx=0x7f525800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f525dffb640 1 -- 172.21.15.120:0/2453064215 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52580052d0 con 0x7f5268144d70 2023-12-19T05:38:58.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f525dffb640 1 -- 172.21.15.120:0/2453064215 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5258005450 con 0x7f5268144d70 2023-12-19T05:38:58.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f526f5d2640 1 -- 172.21.15.120:0/2453064215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52640094d0 con 0x7f5268144d70 2023-12-19T05:38:58.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.811+0000 7f525dffb640 1 -- 172.21.15.120:0/2453064215 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258003830 con 0x7f5268144d70 2023-12-19T05:38:58.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.812+0000 7f526f5d2640 1 -- 172.21.15.120:0/2453064215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52680c00f0 con 0x7f5268144d70 2023-12-19T05:38:58.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.813+0000 7f526f5d2640 1 -- 172.21.15.120:0/2453064215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52680c0280 con 0x7f5268144d70 2023-12-19T05:38:58.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.813+0000 7f525dffb640 1 -- 172.21.15.120:0/2453064215 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5258003990 con 0x7f5268144d70 2023-12-19T05:38:58.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.813+0000 7f525dffb640 1 --2- 172.21.15.120:0/2453064215 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f524c06a430 0x7f524c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:58.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.813+0000 7f525dffb640 1 -- 172.21.15.120:0/2453064215 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5258087e40 con 0x7f5268144d70 2023-12-19T05:38:58.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.813+0000 7f526d36e640 1 --2- 172.21.15.120:0/2453064215 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f524c06a430 0x7f524c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:58.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.814+0000 7f526d36e640 1 --2- 172.21.15.120:0/2453064215 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f524c06a430 0x7f524c06c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5264009870 tx=0x7f5264008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:58.818 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:58.818+0000 7f525dffb640 1 -- 172.21.15.120:0/2453064215 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f52580534e0 con 0x7f5268144d70 2023-12-19T05:38:59.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.019+0000 7f526f5d2640 1 -- 172.21.15.120:0/2453064215 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f526804e080 con 0x7f5268144d70 2023-12-19T05:38:59.755 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.754+0000 7f525dffb640 1 -- 172.21.15.120:0/2453064215 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5258056b00 con 0x7f5268144d70 2023-12-19T05:38:59.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.756+0000 7f526f5d2640 1 -- 172.21.15.120:0/2453064215 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f524c06a430 msgr2=0x7f524c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.756+0000 7f526f5d2640 1 --2- 172.21.15.120:0/2453064215 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f524c06a430 0x7f524c06c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5264009870 tx=0x7f5264008030 comp rx=0 tx=0).stop 2023-12-19T05:38:59.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.756+0000 7f526f5d2640 1 -- 172.21.15.120:0/2453064215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5268144d70 msgr2=0x7f52681dfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.756+0000 7f526f5d2640 1 --2- 172.21.15.120:0/2453064215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5268144d70 0x7f52681dfad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f525800c460 tx=0x7f525800c860 comp rx=0 tx=0).stop 2023-12-19T05:38:59.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.756+0000 7f526f5d2640 1 -- 172.21.15.120:0/2453064215 shutdown_connections 2023-12-19T05:38:59.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.756+0000 7f526f5d2640 1 --2- 172.21.15.120:0/2453064215 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f524c06a430 0x7f524c06c8f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.756+0000 7f526f5d2640 1 --2- 172.21.15.120:0/2453064215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f526814df70 0x7f52680be3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.756+0000 7f526f5d2640 1 --2- 172.21.15.120:0/2453064215 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5268144d70 0x7f52681dfad0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.756+0000 7f526f5d2640 1 --2- 172.21.15.120:0/2453064215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52680bc7e0 0x7f52680c0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.756+0000 7f526f5d2640 1 -- 172.21.15.120:0/2453064215 >> 172.21.15.120:0/2453064215 conn(0x7f5268071430 msgr2=0x7f52680b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:59.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.756+0000 7f526f5d2640 1 -- 172.21.15.120:0/2453064215 shutdown_connections 2023-12-19T05:38:59.758 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.756+0000 7f526f5d2640 1 -- 172.21.15.120:0/2453064215 wait complete. 2023-12-19T05:38:59.770 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T05:38:59.770 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T05:38:59.877 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.875+0000 7fb76e14e640 1 Processor -- start 2023-12-19T05:38:59.877 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.876+0000 7fb76e14e640 1 -- start start 2023-12-19T05:38:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.876+0000 7fb76e14e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76806ad10 0x7fb768148a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.879 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.876+0000 7fb76e14e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb76806b150 0x7fb768148f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.876+0000 7fb76e14e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7680b5ed0 con 0x7fb768142b90 2023-12-19T05:38:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.876+0000 7fb76e14e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb768142f70 con 0x7fb76806b150 2023-12-19T05:38:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.876+0000 7fb76e14e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7680b4b00 con 0x7fb76806ad10 2023-12-19T05:38:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.876+0000 7fb7677fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb768142b90 0x7fb7680b41e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50358/0 (socket says 172.21.15.120:50358) 2023-12-19T05:38:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.876+0000 7fb7677fe640 1 -- 172.21.15.120:0/3271232310 learned_addr learned my addr 172.21.15.120:0/3271232310 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:38:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.876+0000 7fb767fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb76806b150 0x7fb768148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.877+0000 7fb766ffd640 1 --2- 172.21.15.120:0/3271232310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76806ad10 0x7fb768148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.877+0000 7fb767fff640 1 -- 172.21.15.120:0/3271232310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76806ad10 msgr2=0x7fb768148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:38:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.877+0000 7fb767fff640 1 --2- 172.21.15.120:0/3271232310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76806ad10 0x7fb768148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.877+0000 7fb7667fc640 1 -- 172.21.15.120:0/3271232310 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392798305 0 0) 0x7fb7680b5ed0 con 0x7fb768142b90 2023-12-19T05:38:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.877+0000 7fb767fff640 1 -- 172.21.15.120:0/3271232310 >> v1:172.21.15.120:6789/0 conn(0x7fb768142b90 legacy=0x7fb7680b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.877+0000 7fb767fff640 1 -- 172.21.15.120:0/3271232310 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7680b61b0 con 0x7fb76806b150 2023-12-19T05:38:59.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.877+0000 7fb766ffd640 1 --2- 172.21.15.120:0/3271232310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76806ad10 0x7fb768148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.877+0000 7fb767fff640 1 --2- 172.21.15.120:0/3271232310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb76806b150 0x7fb768148f80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb760009d90 tx=0x7fb76002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbaa7d911da998f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.877+0000 7fb7667fc640 1 -- 172.21.15.120:0/3271232310 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76002cc50 con 0x7fb76806b150 2023-12-19T05:38:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.877+0000 7fb7667fc640 1 -- 172.21.15.120:0/3271232310 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76002cdb0 con 0x7fb76806b150 2023-12-19T05:38:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.877+0000 7fb7667fc640 1 -- 172.21.15.120:0/3271232310 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760034660 con 0x7fb76806b150 2023-12-19T05:38:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.878+0000 7fb76e14e640 1 -- 172.21.15.120:0/3271232310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb76806b150 msgr2=0x7fb768148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.878+0000 7fb76e14e640 1 --2- 172.21.15.120:0/3271232310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb76806b150 0x7fb768148f80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb760009d90 tx=0x7fb76002bea0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.878+0000 7fb76e14e640 1 -- 172.21.15.120:0/3271232310 shutdown_connections 2023-12-19T05:38:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.878+0000 7fb76e14e640 1 --2- 172.21.15.120:0/3271232310 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb76806b150 0x7fb768148f80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.878+0000 7fb76e14e640 1 --2- 172.21.15.120:0/3271232310 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76806ad10 0x7fb768148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.878+0000 7fb76e14e640 1 -- 172.21.15.120:0/3271232310 >> 172.21.15.120:0/3271232310 conn(0x7fb7680b91e0 msgr2=0x7fb7680b95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:38:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.878+0000 7fb76e14e640 1 -- 172.21.15.120:0/3271232310 shutdown_connections 2023-12-19T05:38:59.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.878+0000 7fb76e14e640 1 -- 172.21.15.120:0/3271232310 wait complete. 2023-12-19T05:38:59.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.879+0000 7fb76e14e640 1 Processor -- start 2023-12-19T05:38:59.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.879+0000 7fb76e14e640 1 -- start start 2023-12-19T05:38:59.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb76e14e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76806ad10 0x7fb768147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb76e14e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb76806b150 0x7fb76813ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb76e14e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb768142b90 0x7fb768143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb76e14e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb768147780 con 0x7fb768142b90 2023-12-19T05:38:59.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb76e14e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb768143160 con 0x7fb76806b150 2023-12-19T05:38:59.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb76e14e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76813c810 con 0x7fb76806ad10 2023-12-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb767fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb768142b90 0x7fb768143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb767fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb768142b90 0x7fb768143ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48560/0 (socket says 172.21.15.120:48560) 2023-12-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb767fff640 1 -- 172.21.15.120:0/1861240544 learned_addr learned my addr 172.21.15.120:0/1861240544 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb766ffd640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb76806b150 0x7fb76813ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb7677fe640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76806ad10 0x7fb768147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb767fff640 1 -- 172.21.15.120:0/1861240544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76806ad10 msgr2=0x7fb768147c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb767fff640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76806ad10 0x7fb768147c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb767fff640 1 -- 172.21.15.120:0/1861240544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb76806b150 msgr2=0x7fb76813ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb767fff640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb76806b150 0x7fb76813ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:38:59.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb767fff640 1 -- 172.21.15.120:0/1861240544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb760009a70 con 0x7fb768142b90 2023-12-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb766ffd640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb76806b150 0x7fb76813ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb7677fe640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76806ad10 0x7fb768147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.880+0000 7fb767fff640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb768142b90 0x7fb768143ab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb760009d90 tx=0x7fb760004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.881+0000 7fb74ffff640 1 -- 172.21.15.120:0/1861240544 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760040650 con 0x7fb768142b90 2023-12-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.881+0000 7fb74ffff640 1 -- 172.21.15.120:0/1861240544 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7600407d0 con 0x7fb768142b90 2023-12-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.881+0000 7fb76e14e640 1 -- 172.21.15.120:0/1861240544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7681e14d0 con 0x7fb768142b90 2023-12-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.881+0000 7fb74ffff640 1 -- 172.21.15.120:0/1861240544 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb760040b80 con 0x7fb768142b90 2023-12-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.881+0000 7fb76e14e640 1 -- 172.21.15.120:0/1861240544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb768143400 con 0x7fb768142b90 2023-12-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.882+0000 7fb76e14e640 1 -- 172.21.15.120:0/1861240544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb768147930 con 0x7fb768142b90 2023-12-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.882+0000 7fb74ffff640 1 -- 172.21.15.120:0/1861240544 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb760040ce0 con 0x7fb768142b90 2023-12-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.883+0000 7fb74ffff640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb75406a430 0x7fb75406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.883+0000 7fb74ffff640 1 -- 172.21.15.120:0/1861240544 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7600ab700 con 0x7fb768142b90 2023-12-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.883+0000 7fb7677fe640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb75406a430 0x7fb75406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:38:59.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.883+0000 7fb7677fe640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb75406a430 0x7fb75406c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb7580016b0 tx=0x7fb758009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:38:59.888 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:38:59.887+0000 7fb74ffff640 1 -- 172.21.15.120:0/1861240544 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb768147930 con 0x7fb768142b90 2023-12-19T05:39:00.090 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.088+0000 7fb76e14e640 1 -- 172.21.15.120:0/1861240544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb768147930 con 0x7fb768142b90 2023-12-19T05:39:00.759 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.758+0000 7fb74ffff640 1 -- 172.21.15.120:0/1861240544 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb768147930 con 0x7fb768142b90 2023-12-19T05:39:00.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.761+0000 7fb76e14e640 1 -- 172.21.15.120:0/1861240544 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb75406a430 msgr2=0x7fb75406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.761+0000 7fb76e14e640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb75406a430 0x7fb75406c8f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb7580016b0 tx=0x7fb758009040 comp rx=0 tx=0).stop 2023-12-19T05:39:00.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.761+0000 7fb76e14e640 1 -- 172.21.15.120:0/1861240544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb768142b90 msgr2=0x7fb768143ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.761+0000 7fb76e14e640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb768142b90 0x7fb768143ab0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb760009d90 tx=0x7fb760004a40 comp rx=0 tx=0).stop 2023-12-19T05:39:00.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.761+0000 7fb76e14e640 1 -- 172.21.15.120:0/1861240544 shutdown_connections 2023-12-19T05:39:00.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.761+0000 7fb76e14e640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb75406a430 0x7fb75406c8f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.761+0000 7fb76e14e640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb768142b90 0x7fb768143ab0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.761+0000 7fb76e14e640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb76806b150 0x7fb76813ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.761+0000 7fb76e14e640 1 --2- 172.21.15.120:0/1861240544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb76806ad10 0x7fb768147c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.761+0000 7fb76e14e640 1 -- 172.21.15.120:0/1861240544 >> 172.21.15.120:0/1861240544 conn(0x7fb7680b91e0 msgr2=0x7fb7680b41f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:00.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.761+0000 7fb76e14e640 1 -- 172.21.15.120:0/1861240544 shutdown_connections 2023-12-19T05:39:00.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.761+0000 7fb76e14e640 1 -- 172.21.15.120:0/1861240544 wait complete. 2023-12-19T05:39:00.773 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T05:39:00.774 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:39:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.872+0000 7f60ee700640 1 Processor -- start 2023-12-19T05:39:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.872+0000 7f60ee700640 1 -- start start 2023-12-19T05:39:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60ee700640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f60e80b7d90 0x7f60e8144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60ee700640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f60e8145010 0x7f60e814b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60ee700640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e80b96b0 con 0x7f60e80b79b0 2023-12-19T05:39:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60ee700640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e814ae10 con 0x7f60e8145010 2023-12-19T05:39:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60ee700640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e80bacc0 con 0x7f60e80b7d90 2023-12-19T05:39:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60ecc9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f60e8145010 0x7f60e814b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60e7fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f60e80b79b0 0x7f60e80b8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50370/0 (socket says 172.21.15.120:50370) 2023-12-19T05:39:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60e7fff640 1 -- 172.21.15.120:0/1739279427 learned_addr learned my addr 172.21.15.120:0/1739279427 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60e77fe640 1 --2- 172.21.15.120:0/1739279427 >> v2:172.21.15.155:3300/0 conn(0x7f60e80b7d90 0x7f60e8144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60ecc9d640 1 -- 172.21.15.120:0/1739279427 >> v2:172.21.15.155:3300/0 conn(0x7f60e80b7d90 msgr2=0x7f60e8144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:00.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60ecc9d640 1 --2- 172.21.15.120:0/1739279427 >> v2:172.21.15.155:3300/0 conn(0x7f60e80b7d90 0x7f60e8144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60ecc9d640 1 -- 172.21.15.120:0/1739279427 >> v1:172.21.15.120:6789/0 conn(0x7f60e80b79b0 legacy=0x7f60e80b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60ecc9d640 1 -- 172.21.15.120:0/1739279427 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80b81d0 con 0x7f60e8145010 2023-12-19T05:39:00.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60e6ffd640 1 -- 172.21.15.120:0/1739279427 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645031497 0 0) 0x7f60e80b96b0 con 0x7f60e80b79b0 2023-12-19T05:39:00.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.873+0000 7f60e77fe640 1 --2- 172.21.15.120:0/1739279427 >> v2:172.21.15.155:3300/0 conn(0x7f60e80b7d90 0x7f60e8144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:00.879 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.874+0000 7f60ecc9d640 1 --2- 172.21.15.120:0/1739279427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e8145010 0x7f60e814b230 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60e8066740 tx=0x7f60e002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d65207c5edcd1f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:00.879 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.874+0000 7f60e6ffd640 1 -- 172.21.15.120:0/1739279427 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e002cc80 con 0x7f60e8145010 2023-12-19T05:39:00.879 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.874+0000 7f60e6ffd640 1 -- 172.21.15.120:0/1739279427 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e002cde0 con 0x7f60e8145010 2023-12-19T05:39:00.879 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.874+0000 7f60e6ffd640 1 -- 172.21.15.120:0/1739279427 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0034660 con 0x7f60e8145010 2023-12-19T05:39:00.879 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.875+0000 7f60ee700640 1 -- 172.21.15.120:0/1739279427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e8145010 msgr2=0x7f60e814b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.879 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.875+0000 7f60ee700640 1 --2- 172.21.15.120:0/1739279427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e8145010 0x7f60e814b230 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f60e8066740 tx=0x7f60e002bed0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.875+0000 7f60ee700640 1 -- 172.21.15.120:0/1739279427 shutdown_connections 2023-12-19T05:39:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.875+0000 7f60ee700640 1 --2- 172.21.15.120:0/1739279427 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e8145010 0x7f60e814b230 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.875+0000 7f60ee700640 1 --2- 172.21.15.120:0/1739279427 >> v2:172.21.15.155:3300/0 conn(0x7f60e80b7d90 0x7f60e8144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.875+0000 7f60ee700640 1 -- 172.21.15.120:0/1739279427 >> 172.21.15.120:0/1739279427 conn(0x7f60e80c0340 msgr2=0x7f60e80c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.875+0000 7f60ee700640 1 -- 172.21.15.120:0/1739279427 shutdown_connections 2023-12-19T05:39:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.875+0000 7f60ee700640 1 -- 172.21.15.120:0/1739279427 wait complete. 2023-12-19T05:39:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.876+0000 7f60ee700640 1 Processor -- start 2023-12-19T05:39:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.876+0000 7f60ee700640 1 -- start start 2023-12-19T05:39:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ee700640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60e80b79b0 0x7f60e8147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ee700640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e80b7d90 0x7f60e81df830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ee700640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e8145010 0x7f60e81dfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ee700640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e8145da0 con 0x7f60e8145010 2023-12-19T05:39:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ee700640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e81e02b0 con 0x7f60e80b7d90 2023-12-19T05:39:00.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ee700640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e80b5ae0 con 0x7f60e80b79b0 2023-12-19T05:39:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ecc9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e8145010 0x7f60e81dfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ecc9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e8145010 0x7f60e81dfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48568/0 (socket says 172.21.15.120:48568) 2023-12-19T05:39:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ecc9d640 1 -- 172.21.15.120:0/2678026491 learned_addr learned my addr 172.21.15.120:0/2678026491 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60e77fe640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e80b7d90 0x7f60e81df830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60e7fff640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60e80b79b0 0x7f60e8147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ecc9d640 1 -- 172.21.15.120:0/2678026491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60e80b79b0 msgr2=0x7f60e8147450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ecc9d640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60e80b79b0 0x7f60e8147450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ecc9d640 1 -- 172.21.15.120:0/2678026491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e80b7d90 msgr2=0x7f60e81df830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ecc9d640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e80b7d90 0x7f60e81df830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ecc9d640 1 -- 172.21.15.120:0/2678026491 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e0009a70 con 0x7f60e8145010 2023-12-19T05:39:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60e77fe640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e80b7d90 0x7f60e81df830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60e7fff640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60e80b79b0 0x7f60e8147450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ecc9d640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e8145010 0x7f60e81dfd70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f60e002c4e0 tx=0x7f60e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:00.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60e4ff9640 1 -- 172.21.15.120:0/2678026491 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e003e610 con 0x7f60e8145010 2023-12-19T05:39:00.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60e4ff9640 1 -- 172.21.15.120:0/2678026491 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e003e770 con 0x7f60e8145010 2023-12-19T05:39:00.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ee700640 1 -- 172.21.15.120:0/2678026491 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e8146020 con 0x7f60e8145010 2023-12-19T05:39:00.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60e4ff9640 1 -- 172.21.15.120:0/2678026491 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e003eb20 con 0x7f60e8145010 2023-12-19T05:39:00.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.877+0000 7f60ee700640 1 -- 172.21.15.120:0/2678026491 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e8099940 con 0x7f60e8145010 2023-12-19T05:39:00.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.878+0000 7f60ee700640 1 -- 172.21.15.120:0/2678026491 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e81461b0 con 0x7f60e8145010 2023-12-19T05:39:00.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.879+0000 7f60e4ff9640 1 -- 172.21.15.120:0/2678026491 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f60e003b050 con 0x7f60e8145010 2023-12-19T05:39:00.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.879+0000 7f60e4ff9640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f60c806a430 0x7f60c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:00.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.879+0000 7f60e4ff9640 1 -- 172.21.15.120:0/2678026491 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60e00ab1a0 con 0x7f60e8145010 2023-12-19T05:39:00.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.879+0000 7f60e7fff640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f60c806a430 0x7f60c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:00.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.879+0000 7f60e7fff640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f60c806a430 0x7f60c806c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f60d8000f60 tx=0x7f60d8007c10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:00.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:00.883+0000 7f60e4ff9640 1 -- 172.21.15.120:0/2678026491 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f60e0076940 con 0x7f60e8145010 2023-12-19T05:39:01.086 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.084+0000 7f60ee700640 1 -- 172.21.15.120:0/2678026491 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60e804e080 con 0x7f60e8145010 2023-12-19T05:39:01.086 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.085+0000 7f60e4ff9640 1 -- 172.21.15.120:0/2678026491 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3892 (secure 0 0 0) 0x7f60e0080070 con 0x7f60e8145010 2023-12-19T05:39:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:01.086 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/753508604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":753508604},{"type":"v1","addr":"172.21.15.155:6833","nonce":753508604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/3314096579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":3314096579},{"type":"v1","addr":"172.21.15.120:6836","nonce":3314096579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:38:58.081682+0000","modified":"2023-12-19T05:39:00.753884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/1608902018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":1608902018},{"type":"v1","addr":"172.21.15.120:6837","nonce":1608902018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:39:01.086 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2023-12-19T05:39:01.088 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.086+0000 7f60ee700640 1 -- 172.21.15.120:0/2678026491 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f60c806a430 msgr2=0x7f60c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.088 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.087+0000 7f60ee700640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f60c806a430 0x7f60c806c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f60d8000f60 tx=0x7f60d8007c10 comp rx=0 tx=0).stop 2023-12-19T05:39:01.088 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.087+0000 7f60ee700640 1 -- 172.21.15.120:0/2678026491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e8145010 msgr2=0x7f60e81dfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.088 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.087+0000 7f60ee700640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e8145010 0x7f60e81dfd70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f60e002c4e0 tx=0x7f60e0004a40 comp rx=0 tx=0).stop 2023-12-19T05:39:01.088 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.087+0000 7f60ee700640 1 -- 172.21.15.120:0/2678026491 shutdown_connections 2023-12-19T05:39:01.088 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.087+0000 7f60ee700640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f60c806a430 0x7f60c806c8f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.088 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.087+0000 7f60ee700640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60e8145010 0x7f60e81dfd70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.088 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.087+0000 7f60ee700640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60e80b7d90 0x7f60e81df830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.088 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.087+0000 7f60ee700640 1 --2- 172.21.15.120:0/2678026491 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f60e80b79b0 0x7f60e8147450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.088 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.087+0000 7f60ee700640 1 -- 172.21.15.120:0/2678026491 >> 172.21.15.120:0/2678026491 conn(0x7f60e80c0340 msgr2=0x7f60e80bd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:01.089 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.087+0000 7f60ee700640 1 -- 172.21.15.120:0/2678026491 shutdown_connections 2023-12-19T05:39:01.089 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.087+0000 7f60ee700640 1 -- 172.21.15.120:0/2678026491 wait complete. 2023-12-19T05:39:01.098 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:01.197 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.196+0000 7f9c76e70640 1 Processor -- start 2023-12-19T05:39:01.197 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.196+0000 7f9c76e70640 1 -- start start 2023-12-19T05:39:01.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.196+0000 7f9c76e70640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9c700b7d90 0x7f9c70144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.196+0000 7f9c76e70640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9c70145010 0x7f9c7014b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.196+0000 7f9c76e70640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c700b96b0 con 0x7f9c700b79b0 2023-12-19T05:39:01.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.197+0000 7f9c76e70640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7014ae10 con 0x7f9c70145010 2023-12-19T05:39:01.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.197+0000 7f9c76e70640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c700bacc0 con 0x7f9c700b7d90 2023-12-19T05:39:01.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.197+0000 7f9c7540d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9c70145010 0x7f9c7014b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.197+0000 7f9c7540d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9c70145010 0x7f9c7014b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48582/0 (socket says 172.21.15.120:48582) 2023-12-19T05:39:01.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.197+0000 7f9c7540d640 1 -- 172.21.15.120:0/1845619266 learned_addr learned my addr 172.21.15.120:0/1845619266 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:01.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.197+0000 7f9c6ffff640 1 --2- 172.21.15.120:0/1845619266 >> v2:172.21.15.155:3300/0 conn(0x7f9c700b7d90 0x7f9c70144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.197+0000 7f9c7540d640 1 -- 172.21.15.120:0/1845619266 >> v2:172.21.15.155:3300/0 conn(0x7f9c700b7d90 msgr2=0x7f9c70144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:01.200 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.197+0000 7f9c7540d640 1 --2- 172.21.15.120:0/1845619266 >> v2:172.21.15.155:3300/0 conn(0x7f9c700b7d90 0x7f9c70144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.200 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.197+0000 7f9c7540d640 1 -- 172.21.15.120:0/1845619266 >> v1:172.21.15.155:6789/0 conn(0x7f9c700b79b0 legacy=0x7f9c700b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.200 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.197+0000 7f9c7540d640 1 -- 172.21.15.120:0/1845619266 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c700b81d0 con 0x7f9c70145010 2023-12-19T05:39:01.200 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.198+0000 7f9c7540d640 1 --2- 172.21.15.120:0/1845619266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c70145010 0x7f9c7014b230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c70066740 tx=0x7f9c6802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf220f9d2dd8ed46 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:01.200 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.198+0000 7f9c6f7fe640 1 -- 172.21.15.120:0/1845619266 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6802cb20 con 0x7f9c70145010 2023-12-19T05:39:01.200 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.198+0000 7f9c6f7fe640 1 -- 172.21.15.120:0/1845619266 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6802cc80 con 0x7f9c70145010 2023-12-19T05:39:01.200 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.198+0000 7f9c6f7fe640 1 -- 172.21.15.120:0/1845619266 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680343f0 con 0x7f9c70145010 2023-12-19T05:39:01.203 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.198+0000 7f9c76e70640 1 -- 172.21.15.120:0/1845619266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c70145010 msgr2=0x7f9c7014b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.203 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.198+0000 7f9c76e70640 1 --2- 172.21.15.120:0/1845619266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c70145010 0x7f9c7014b230 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9c70066740 tx=0x7f9c6802bf80 comp rx=0 tx=0).stop 2023-12-19T05:39:01.203 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.198+0000 7f9c76e70640 1 -- 172.21.15.120:0/1845619266 shutdown_connections 2023-12-19T05:39:01.203 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.198+0000 7f9c76e70640 1 --2- 172.21.15.120:0/1845619266 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c70145010 0x7f9c7014b230 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.203 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.198+0000 7f9c76e70640 1 --2- 172.21.15.120:0/1845619266 >> v2:172.21.15.155:3300/0 conn(0x7f9c700b7d90 0x7f9c70144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.203 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.198+0000 7f9c76e70640 1 -- 172.21.15.120:0/1845619266 >> 172.21.15.120:0/1845619266 conn(0x7f9c700c0340 msgr2=0x7f9c700c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:01.203 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.198+0000 7f9c76e70640 1 -- 172.21.15.120:0/1845619266 shutdown_connections 2023-12-19T05:39:01.203 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.198+0000 7f9c76e70640 1 -- 172.21.15.120:0/1845619266 wait complete. 2023-12-19T05:39:01.203 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.199+0000 7f9c76e70640 1 Processor -- start 2023-12-19T05:39:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.199+0000 7f9c76e70640 1 -- start start 2023-12-19T05:39:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.200+0000 7f9c76e70640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c700b79b0 0x7f9c701d1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.200+0000 7f9c76e70640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c700b7d90 0x7f9c70149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.200+0000 7f9c76e70640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c70145010 0x7f9c701d2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.200+0000 7f9c76e70640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c701d1760 con 0x7f9c700b7d90 2023-12-19T05:39:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.200+0000 7f9c76e70640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c700b8880 con 0x7f9c70145010 2023-12-19T05:39:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.200+0000 7f9c76e70640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c70149a80 con 0x7f9c700b79b0 2023-12-19T05:39:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.200+0000 7f9c6ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c700b7d90 0x7f9c70149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.200+0000 7f9c6ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c700b7d90 0x7f9c70149540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48588/0 (socket says 172.21.15.120:48588) 2023-12-19T05:39:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.200+0000 7f9c6ffff640 1 -- 172.21.15.120:0/3964369668 learned_addr learned my addr 172.21.15.120:0/3964369668 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.200+0000 7f9c74c0c640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c700b79b0 0x7f9c701d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.200+0000 7f9c7540d640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c70145010 0x7f9c701d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.200+0000 7f9c6ffff640 1 -- 172.21.15.120:0/3964369668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c700b79b0 msgr2=0x7f9c701d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.200+0000 7f9c6ffff640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c700b79b0 0x7f9c701d1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.201+0000 7f9c6ffff640 1 -- 172.21.15.120:0/3964369668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c70145010 msgr2=0x7f9c701d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.201+0000 7f9c6ffff640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c70145010 0x7f9c701d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.201+0000 7f9c6ffff640 1 -- 172.21.15.120:0/3964369668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c68009b30 con 0x7f9c700b7d90 2023-12-19T05:39:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.201+0000 7f9c74c0c640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c700b79b0 0x7f9c701d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.201+0000 7f9c6ffff640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c700b7d90 0x7f9c70149540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00e9b0 tx=0x7f9c5c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.201+0000 7f9c6d7fa640 1 -- 172.21.15.120:0/3964369668 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c009670 con 0x7f9c700b7d90 2023-12-19T05:39:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.201+0000 7f9c6d7fa640 1 -- 172.21.15.120:0/3964369668 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c00c9a0 con 0x7f9c700b7d90 2023-12-19T05:39:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.201+0000 7f9c6d7fa640 1 -- 172.21.15.120:0/3964369668 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c00cd50 con 0x7f9c700b7d90 2023-12-19T05:39:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.201+0000 7f9c76e70640 1 -- 172.21.15.120:0/3964369668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c701d2640 con 0x7f9c700b7d90 2023-12-19T05:39:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.201+0000 7f9c76e70640 1 -- 172.21.15.120:0/3964369668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c700ba960 con 0x7f9c700b7d90 2023-12-19T05:39:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.202+0000 7f9c76e70640 1 -- 172.21.15.120:0/3964369668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c70066d30 con 0x7f9c700b7d90 2023-12-19T05:39:01.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.202+0000 7f9c6d7fa640 1 -- 172.21.15.120:0/3964369668 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c5c013470 con 0x7f9c700b7d90 2023-12-19T05:39:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.203+0000 7f9c6d7fa640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9c5406a430 0x7f9c5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.203+0000 7f9c74c0c640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9c5406a430 0x7f9c5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.203+0000 7f9c6d7fa640 1 -- 172.21.15.120:0/3964369668 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c5c088b50 con 0x7f9c700b7d90 2023-12-19T05:39:01.206 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.203+0000 7f9c74c0c640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9c5406a430 0x7f9c5406c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9c64007fd0 tx=0x7f9c64009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:01.208 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.207+0000 7f9c6d7fa640 1 -- 172.21.15.120:0/3964369668 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9c5c0541d0 con 0x7f9c700b7d90 2023-12-19T05:39:01.375 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.374+0000 7f9c76e70640 1 -- 172.21.15.120:0/3964369668 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c70149180 con 0x7f9c700b7d90 2023-12-19T05:39:01.376 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.375+0000 7f9c6d7fa640 1 -- 172.21.15.120:0/3964369668 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f9c5c017090 con 0x7f9c700b7d90 2023-12-19T05:39:01.376 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:01.376 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:01.378 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.377+0000 7f9c76e70640 1 -- 172.21.15.120:0/3964369668 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9c5406a430 msgr2=0x7f9c5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.378 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.377+0000 7f9c76e70640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9c5406a430 0x7f9c5406c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9c64007fd0 tx=0x7f9c64009040 comp rx=0 tx=0).stop 2023-12-19T05:39:01.378 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.377+0000 7f9c76e70640 1 -- 172.21.15.120:0/3964369668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c700b7d90 msgr2=0x7f9c70149540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.378 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.377+0000 7f9c76e70640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c700b7d90 0x7f9c70149540 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c00e9b0 tx=0x7f9c5c00ee70 comp rx=0 tx=0).stop 2023-12-19T05:39:01.378 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.377+0000 7f9c76e70640 1 -- 172.21.15.120:0/3964369668 shutdown_connections 2023-12-19T05:39:01.379 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.377+0000 7f9c76e70640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9c5406a430 0x7f9c5406c8f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.379 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.377+0000 7f9c76e70640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c70145010 0x7f9c701d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.379 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.377+0000 7f9c76e70640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9c700b7d90 0x7f9c70149540 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.379 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.377+0000 7f9c76e70640 1 --2- 172.21.15.120:0/3964369668 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9c700b79b0 0x7f9c701d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.379 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.377+0000 7f9c76e70640 1 -- 172.21.15.120:0/3964369668 >> 172.21.15.120:0/3964369668 conn(0x7f9c700c0340 msgr2=0x7f9c700bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:01.379 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.377+0000 7f9c76e70640 1 -- 172.21.15.120:0/3964369668 shutdown_connections 2023-12-19T05:39:01.379 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.377+0000 7f9c76e70640 1 -- 172.21.15.120:0/3964369668 wait complete. 2023-12-19T05:39:01.389 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T05:39:01.389 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:01.488 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.487+0000 7f17a0bf1640 1 Processor -- start 2023-12-19T05:39:01.488 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.487+0000 7f17a0bf1640 1 -- start start 2023-12-19T05:39:01.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f17a0bf1640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f179c0b2d90 0x7f179c0b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f17a0bf1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179c06a120 0x7f179c14bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f17a0bf1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f179c06a560 0x7f179c14c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f17a0bf1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179c0b3170 con 0x7f179c06a560 2023-12-19T05:39:01.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f17a0bf1640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179c0b4650 con 0x7f179c0b2d90 2023-12-19T05:39:01.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f17a0bf1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c148b20 con 0x7f179c06a120 2023-12-19T05:39:01.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f179ad9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f179c06a560 0x7f179c14c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f179ad9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f179c06a560 0x7f179c14c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48598/0 (socket says 172.21.15.120:48598) 2023-12-19T05:39:01.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f179ad9d640 1 -- 172.21.15.120:0/772517946 learned_addr learned my addr 172.21.15.120:0/772517946 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:01.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f1799d9b640 1 --2- 172.21.15.120:0/772517946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179c06a120 0x7f179c14bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f179a59c640 1 --2- 172.21.15.120:0/772517946 >> v2:172.21.15.155:3300/0 conn(0x7f179c0b2d90 0x7f179c0b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f179ad9d640 1 -- 172.21.15.120:0/772517946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179c06a120 msgr2=0x7f179c14bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:01.491 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f179ad9d640 1 --2- 172.21.15.120:0/772517946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179c06a120 0x7f179c14bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.491 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f179ad9d640 1 -- 172.21.15.120:0/772517946 >> v2:172.21.15.155:3300/0 conn(0x7f179c0b2d90 msgr2=0x7f179c0b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:01.491 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f179ad9d640 1 --2- 172.21.15.120:0/772517946 >> v2:172.21.15.155:3300/0 conn(0x7f179c0b2d90 0x7f179c0b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.491 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.488+0000 7f179ad9d640 1 -- 172.21.15.120:0/772517946 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c148e00 con 0x7f179c06a560 2023-12-19T05:39:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.489+0000 7f179ad9d640 1 --2- 172.21.15.120:0/772517946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c06a560 0x7f179c14c2c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f179c06d1c0 tx=0x7f179402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ae1dcaf396d7ea server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.489+0000 7f179959a640 1 -- 172.21.15.120:0/772517946 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794030860 con 0x7f179c06a560 2023-12-19T05:39:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.489+0000 7f179959a640 1 -- 172.21.15.120:0/772517946 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17940309c0 con 0x7f179c06a560 2023-12-19T05:39:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.489+0000 7f179959a640 1 -- 172.21.15.120:0/772517946 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1794030d50 con 0x7f179c06a560 2023-12-19T05:39:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.490+0000 7f17a0bf1640 1 -- 172.21.15.120:0/772517946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c06a560 msgr2=0x7f179c14c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.490+0000 7f17a0bf1640 1 --2- 172.21.15.120:0/772517946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c06a560 0x7f179c14c2c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f179c06d1c0 tx=0x7f179402b9a0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.490+0000 7f17a0bf1640 1 -- 172.21.15.120:0/772517946 shutdown_connections 2023-12-19T05:39:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.490+0000 7f17a0bf1640 1 --2- 172.21.15.120:0/772517946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c06a560 0x7f179c14c2c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.490+0000 7f17a0bf1640 1 --2- 172.21.15.120:0/772517946 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179c06a120 0x7f179c14bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.490+0000 7f17a0bf1640 1 --2- 172.21.15.120:0/772517946 >> v2:172.21.15.155:3300/0 conn(0x7f179c0b2d90 0x7f179c0b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.490+0000 7f17a0bf1640 1 -- 172.21.15.120:0/772517946 >> 172.21.15.120:0/772517946 conn(0x7f179c0b8dd0 msgr2=0x7f179c0b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:01.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.490+0000 7f17a0bf1640 1 -- 172.21.15.120:0/772517946 shutdown_connections 2023-12-19T05:39:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.490+0000 7f17a0bf1640 1 -- 172.21.15.120:0/772517946 wait complete. 2023-12-19T05:39:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.491+0000 7f17a0bf1640 1 Processor -- start 2023-12-19T05:39:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.491+0000 7f17a0bf1640 1 -- start start 2023-12-19T05:39:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f17a0bf1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179c06a120 0x7f179c0ba470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f17a0bf1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c06a560 0x7f179c145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f17a0bf1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f179c0b2d90 0x7f179c145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f17a0bf1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c144180 con 0x7f179c06a560 2023-12-19T05:39:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f17a0bf1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c143570 con 0x7f179c0b2d90 2023-12-19T05:39:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f17a0bf1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c143850 con 0x7f179c06a120 2023-12-19T05:39:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f1799d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c06a560 0x7f179c145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f1799d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c06a560 0x7f179c145000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:48602/0 (socket says 172.21.15.120:48602) 2023-12-19T05:39:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f1799d9b640 1 -- 172.21.15.120:0/1318707328 learned_addr learned my addr 172.21.15.120:0/1318707328 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f179a59c640 1 --2- 172.21.15.120:0/1318707328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179c06a120 0x7f179c0ba470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f179ad9d640 1 --2- 172.21.15.120:0/1318707328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f179c0b2d90 0x7f179c145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f1799d9b640 1 -- 172.21.15.120:0/1318707328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179c06a120 msgr2=0x7f179c0ba470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f1799d9b640 1 --2- 172.21.15.120:0/1318707328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179c06a120 0x7f179c0ba470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f1799d9b640 1 -- 172.21.15.120:0/1318707328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f179c0b2d90 msgr2=0x7f179c145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f1799d9b640 1 --2- 172.21.15.120:0/1318707328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f179c0b2d90 0x7f179c145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f1799d9b640 1 -- 172.21.15.120:0/1318707328 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17940094d0 con 0x7f179c06a560 2023-12-19T05:39:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f1799d9b640 1 --2- 172.21.15.120:0/1318707328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c06a560 0x7f179c145000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f178400d800 tx=0x7f178400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f1792ffd640 1 -- 172.21.15.120:0/1318707328 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178400b6c0 con 0x7f179c06a560 2023-12-19T05:39:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f1792ffd640 1 -- 172.21.15.120:0/1318707328 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178400b820 con 0x7f179c06a560 2023-12-19T05:39:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f1792ffd640 1 -- 172.21.15.120:0/1318707328 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178400bbb0 con 0x7f179c06a560 2023-12-19T05:39:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.492+0000 7f17a0bf1640 1 -- 172.21.15.120:0/1318707328 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c143b30 con 0x7f179c06a560 2023-12-19T05:39:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.493+0000 7f17a0bf1640 1 -- 172.21.15.120:0/1318707328 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c0ba9b0 con 0x7f179c06a560 2023-12-19T05:39:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.494+0000 7f17a0bf1640 1 -- 172.21.15.120:0/1318707328 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c1442f0 con 0x7f179c06a560 2023-12-19T05:39:01.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.494+0000 7f1792ffd640 1 -- 172.21.15.120:0/1318707328 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f178400bd10 con 0x7f179c06a560 2023-12-19T05:39:01.499 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.494+0000 7f1792ffd640 1 --2- 172.21.15.120:0/1318707328 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f177c06a460 0x7f177c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.499 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.494+0000 7f1792ffd640 1 -- 172.21.15.120:0/1318707328 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1784088c50 con 0x7f179c06a560 2023-12-19T05:39:01.499 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.494+0000 7f179a59c640 1 --2- 172.21.15.120:0/1318707328 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f177c06a460 0x7f177c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.499 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.495+0000 7f179a59c640 1 --2- 172.21.15.120:0/1318707328 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f177c06a460 0x7f177c06c920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f178c0039e0 tx=0x7f178c009830 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:01.499 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.498+0000 7f1792ffd640 1 -- 172.21.15.120:0/1318707328 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f178408e020 con 0x7f179c06a560 2023-12-19T05:39:01.664 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.662+0000 7f17a0bf1640 1 -- 172.21.15.120:0/1318707328 --> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f179c1493c0 con 0x7f177c06a460 2023-12-19T05:39:01.669 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.669+0000 7f1792ffd640 1 -- 172.21.15.120:0/1318707328 <== mgr.4101 v2:172.21.15.120:6832/89586 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249777 (secure 0 0 0) 0x7f178c004640 con 0x7f177c06a460 2023-12-19T05:39:01.674 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:01.676 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2023-12-19T05:39:01.679 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.671+0000 7f17a0bf1640 1 -- 172.21.15.120:0/1318707328 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f177c06a460 msgr2=0x7f177c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.679 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.671+0000 7f17a0bf1640 1 --2- 172.21.15.120:0/1318707328 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f177c06a460 0x7f177c06c920 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f178c0039e0 tx=0x7f178c009830 comp rx=0 tx=0).stop 2023-12-19T05:39:01.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.672+0000 7f17a0bf1640 1 -- 172.21.15.120:0/1318707328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c06a560 msgr2=0x7f179c145000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.672+0000 7f17a0bf1640 1 --2- 172.21.15.120:0/1318707328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c06a560 0x7f179c145000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f178400d800 tx=0x7f178400dcc0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.672+0000 7f17a0bf1640 1 -- 172.21.15.120:0/1318707328 shutdown_connections 2023-12-19T05:39:01.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.672+0000 7f17a0bf1640 1 --2- 172.21.15.120:0/1318707328 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f177c06a460 0x7f177c06c920 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.672+0000 7f17a0bf1640 1 --2- 172.21.15.120:0/1318707328 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f179c0b2d90 0x7f179c145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.680 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.672+0000 7f17a0bf1640 1 --2- 172.21.15.120:0/1318707328 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c06a560 0x7f179c145000 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.681 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.672+0000 7f17a0bf1640 1 --2- 172.21.15.120:0/1318707328 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179c06a120 0x7f179c0ba470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.681 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.672+0000 7f17a0bf1640 1 -- 172.21.15.120:0/1318707328 >> 172.21.15.120:0/1318707328 conn(0x7f179c0b8dd0 msgr2=0x7f179c0b91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:01.681 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.672+0000 7f17a0bf1640 1 -- 172.21.15.120:0/1318707328 shutdown_connections 2023-12-19T05:39:01.681 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.672+0000 7f17a0bf1640 1 -- 172.21.15.120:0/1318707328 wait complete. 2023-12-19T05:39:01.684 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-12-19T05:38:59.936787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":219232,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755488,"statfs":{"total":773094113280,"available":772869619712,"internally_reserved":0,"allocated":2424832,"data_stored":1544546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000683"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-19T05:38:50.279719+0000","last_change":"2023-12-19T05:38:47.150620+0000","last_active":"2023-12-19T05:38:50.279719+0000","last_peered":"2023-12-19T05:38:50.279719+0000","last_clean":"2023-12-19T05:38:50.279719+0000","last_became_active":"2023-12-19T05:38:47.149844+0000","last_became_peered":"2023-12-19T05:38:47.149844+0000","last_unstale":"2023-12-19T05:38:50.279719+0000","last_undegraded":"2023-12-19T05:38:50.279719+0000","last_fullsized":"2023-12-19T05:38:50.279719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_clean_scrub_stamp":"2023-12-19T05:38:46.034642+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:51.920917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:57.726959+0000","last_change":"2023-12-19T05:38:57.726959+0000","last_active":"2023-12-19T05:38:57.726959+0000","last_peered":"2023-12-19T05:38:57.726959+0000","last_clean":"2023-12-19T05:38:57.726959+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:57.726959+0000","last_undegraded":"2023-12-19T05:38:57.726959+0000","last_fullsized":"2023-12-19T05:38:57.726959+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:38:56.722605+0000","last_change":"2023-12-19T05:38:56.722605+0000","last_active":"2023-12-19T05:38:56.722605+0000","last_peered":"2023-12-19T05:38:56.722605+0000","last_clean":"2023-12-19T05:38:56.722605+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:38:56.722605+0000","last_undegraded":"2023-12-19T05:38:56.722605+0000","last_fullsized":"2023-12-19T05:38:56.722605+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28308,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343532,"statfs":{"total":96636764160,"available":96607776768,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27100,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344740,"statfs":{"total":96636764160,"available":96609013760,"internally_reserved":0,"allocated":151552,"data_stored":44712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.255}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27104,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28304,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343536,"statfs":{"total":96636764160,"available":96607780864,"internally_reserved":0,"allocated":745472,"data_stored":635080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T05:39:01.691 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:01.697 INFO:tasks.ceph.mds.a.smithi120.stderr:2023-12-19T05:39:01.696+0000 7fc7ba1d3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:39:01.796 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.795+0000 7ff984c5f640 1 Processor -- start 2023-12-19T05:39:01.797 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.795+0000 7ff984c5f640 1 -- start start 2023-12-19T05:39:01.800 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff984c5f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff9800b7d90 0x7ff980144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.800 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff984c5f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff980145010 0x7ff98014b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.800 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff984c5f640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9800b96b0 con 0x7ff9800b79b0 2023-12-19T05:39:01.801 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff984c5f640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98014ae10 con 0x7ff9800b7d90 2023-12-19T05:39:01.801 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff984c5f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800bacc0 con 0x7ff980145010 2023-12-19T05:39:01.801 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff97dd9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff9800b7d90 0x7ff980144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.801 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff97e59c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff9800b79b0 0x7ff9800b8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49546/0 (socket says 172.21.15.120:49546) 2023-12-19T05:39:01.801 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff97e59c640 1 -- 172.21.15.120:0/782399927 learned_addr learned my addr 172.21.15.120:0/782399927 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:01.801 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff97ed9d640 1 --2- 172.21.15.120:0/782399927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff980145010 0x7ff98014b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff97dd9b640 1 -- 172.21.15.120:0/782399927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff980145010 msgr2=0x7ff98014b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff97dd9b640 1 --2- 172.21.15.120:0/782399927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff980145010 0x7ff98014b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff97dd9b640 1 -- 172.21.15.120:0/782399927 >> v1:172.21.15.120:6789/0 conn(0x7ff9800b79b0 legacy=0x7ff9800b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff97d59a640 1 -- 172.21.15.120:0/782399927 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238038308 0 0) 0x7ff9800b96b0 con 0x7ff9800b79b0 2023-12-19T05:39:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff97dd9b640 1 -- 172.21.15.120:0/782399927 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9800b81d0 con 0x7ff9800b7d90 2023-12-19T05:39:01.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.796+0000 7ff97ed9d640 1 --2- 172.21.15.120:0/782399927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff980145010 0x7ff98014b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.797+0000 7ff97dd9b640 1 --2- 172.21.15.120:0/782399927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9800b7d90 0x7ff980144ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff9740097a0 tx=0x7ff97402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c316301ebf51d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.797+0000 7ff97d59a640 1 -- 172.21.15.120:0/782399927 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974031830 con 0x7ff9800b7d90 2023-12-19T05:39:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.797+0000 7ff97d59a640 1 -- 172.21.15.120:0/782399927 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff974031990 con 0x7ff9800b7d90 2023-12-19T05:39:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.797+0000 7ff97d59a640 1 -- 172.21.15.120:0/782399927 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff974031d20 con 0x7ff9800b7d90 2023-12-19T05:39:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.798+0000 7ff984c5f640 1 -- 172.21.15.120:0/782399927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9800b7d90 msgr2=0x7ff980144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.798+0000 7ff984c5f640 1 --2- 172.21.15.120:0/782399927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9800b7d90 0x7ff980144ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff9740097a0 tx=0x7ff97402b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.803 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.798+0000 7ff984c5f640 1 -- 172.21.15.120:0/782399927 shutdown_connections 2023-12-19T05:39:01.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.798+0000 7ff984c5f640 1 --2- 172.21.15.120:0/782399927 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9800b7d90 0x7ff980144ad0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.798+0000 7ff984c5f640 1 --2- 172.21.15.120:0/782399927 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff980145010 0x7ff98014b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.798+0000 7ff984c5f640 1 -- 172.21.15.120:0/782399927 >> 172.21.15.120:0/782399927 conn(0x7ff9800c0340 msgr2=0x7ff9800c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:01.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.798+0000 7ff984c5f640 1 -- 172.21.15.120:0/782399927 shutdown_connections 2023-12-19T05:39:01.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.798+0000 7ff984c5f640 1 -- 172.21.15.120:0/782399927 wait complete. 2023-12-19T05:39:01.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.799+0000 7ff984c5f640 1 Processor -- start 2023-12-19T05:39:01.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.799+0000 7ff984c5f640 1 -- start start 2023-12-19T05:39:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff984c5f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800b79b0 0x7ff980149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff984c5f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9800b7d90 0x7ff9800b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff984c5f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff980145010 0x7ff9800af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff984c5f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800b0920 con 0x7ff9800b7d90 2023-12-19T05:39:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff984c5f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800b5e40 con 0x7ff980145010 2023-12-19T05:39:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff984c5f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9800a5f00 con 0x7ff9800b79b0 2023-12-19T05:39:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff97dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9800b7d90 0x7ff9800b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff97dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9800b7d90 0x7ff9800b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45044/0 (socket says 172.21.15.120:45044) 2023-12-19T05:39:01.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff97dd9b640 1 -- 172.21.15.120:0/366361055 learned_addr learned my addr 172.21.15.120:0/366361055 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:01.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff97e59c640 1 --2- 172.21.15.120:0/366361055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800b79b0 0x7ff980149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff97ed9d640 1 --2- 172.21.15.120:0/366361055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff980145010 0x7ff9800af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff97dd9b640 1 -- 172.21.15.120:0/366361055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800b79b0 msgr2=0x7ff980149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff97dd9b640 1 --2- 172.21.15.120:0/366361055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800b79b0 0x7ff980149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff97dd9b640 1 -- 172.21.15.120:0/366361055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff980145010 msgr2=0x7ff9800af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff97dd9b640 1 --2- 172.21.15.120:0/366361055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff980145010 0x7ff9800af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff97dd9b640 1 -- 172.21.15.120:0/366361055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff974009400 con 0x7ff9800b7d90 2023-12-19T05:39:01.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff97dd9b640 1 --2- 172.21.15.120:0/366361055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9800b7d90 0x7ff9800b5900 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff9740098c0 tx=0x7ff9740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:01.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff96effd640 1 -- 172.21.15.120:0/366361055 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97403ba70 con 0x7ff9800b7d90 2023-12-19T05:39:01.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff96effd640 1 -- 172.21.15.120:0/366361055 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97403bbf0 con 0x7ff9800b7d90 2023-12-19T05:39:01.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff984c5f640 1 -- 172.21.15.120:0/366361055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9800a6cf0 con 0x7ff9800b7d90 2023-12-19T05:39:01.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff96effd640 1 -- 172.21.15.120:0/366361055 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9740453f0 con 0x7ff9800b7d90 2023-12-19T05:39:01.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.800+0000 7ff984c5f640 1 -- 172.21.15.120:0/366361055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9800b0540 con 0x7ff9800b7d90 2023-12-19T05:39:01.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.801+0000 7ff984c5f640 1 -- 172.21.15.120:0/366361055 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9800b00c0 con 0x7ff9800b7d90 2023-12-19T05:39:01.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.802+0000 7ff96effd640 1 -- 172.21.15.120:0/366361055 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff974045550 con 0x7ff9800b7d90 2023-12-19T05:39:01.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.802+0000 7ff96effd640 1 --2- 172.21.15.120:0/366361055 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff96006a430 0x7ff96006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:01.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.802+0000 7ff96effd640 1 -- 172.21.15.120:0/366361055 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9740aabf0 con 0x7ff9800b7d90 2023-12-19T05:39:01.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.802+0000 7ff97e59c640 1 --2- 172.21.15.120:0/366361055 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff96006a430 0x7ff96006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.802+0000 7ff97e59c640 1 --2- 172.21.15.120:0/366361055 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff96006a430 0x7ff96006c8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9700012e0 tx=0x7ff970001700 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:01.812 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.806+0000 7ff96effd640 1 -- 172.21.15.120:0/366361055 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff9800b00c0 con 0x7ff9800b7d90 2023-12-19T05:39:01.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.970+0000 7ff984c5f640 1 -- 172.21.15.120:0/366361055 --> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9800b93d0 con 0x7ff96006a430 2023-12-19T05:39:01.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.977+0000 7ff96effd640 1 -- 172.21.15.120:0/366361055 <== mgr.4101 v2:172.21.15.120:6832/89586 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264629 (secure 0 0 0) 0x7ff970004de0 con 0x7ff96006a430 2023-12-19T05:39:01.980 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:01.982 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2023-12-19T05:39:01.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.979+0000 7ff984c5f640 1 -- 172.21.15.120:0/366361055 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff96006a430 msgr2=0x7ff96006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.979+0000 7ff984c5f640 1 --2- 172.21.15.120:0/366361055 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff96006a430 0x7ff96006c8f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff9700012e0 tx=0x7ff970001700 comp rx=0 tx=0).stop 2023-12-19T05:39:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.979+0000 7ff984c5f640 1 -- 172.21.15.120:0/366361055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9800b7d90 msgr2=0x7ff9800b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.979+0000 7ff984c5f640 1 --2- 172.21.15.120:0/366361055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9800b7d90 0x7ff9800b5900 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff9740098c0 tx=0x7ff9740046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.980+0000 7ff984c5f640 1 -- 172.21.15.120:0/366361055 shutdown_connections 2023-12-19T05:39:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.980+0000 7ff984c5f640 1 --2- 172.21.15.120:0/366361055 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff96006a430 0x7ff96006c8f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.980+0000 7ff984c5f640 1 --2- 172.21.15.120:0/366361055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff980145010 0x7ff9800af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.980+0000 7ff984c5f640 1 --2- 172.21.15.120:0/366361055 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff9800b7d90 0x7ff9800b5900 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.980+0000 7ff984c5f640 1 --2- 172.21.15.120:0/366361055 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff9800b79b0 0x7ff980149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.980+0000 7ff984c5f640 1 -- 172.21.15.120:0/366361055 >> 172.21.15.120:0/366361055 conn(0x7ff9800c0340 msgr2=0x7ff980149b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.980+0000 7ff984c5f640 1 -- 172.21.15.120:0/366361055 shutdown_connections 2023-12-19T05:39:01.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:01.980+0000 7ff984c5f640 1 -- 172.21.15.120:0/366361055 wait complete. 2023-12-19T05:39:01.991 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-19T05:39:01.937108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218432,"kb_used_data":2816,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756288,"statfs":{"total":773094113280,"available":772870438912,"internally_reserved":0,"allocated":2883584,"data_stored":1750606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.209862"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581779+0000","last_change":"2023-12-19T05:38:58.110250+0000","last_active":"2023-12-19T05:38:59.581779+0000","last_peered":"2023-12-19T05:38:59.581779+0000","last_clean":"2023-12-19T05:38:59.581779+0000","last_became_active":"2023-12-19T05:38:58.109517+0000","last_became_peered":"2023-12-19T05:38:58.109517+0000","last_unstale":"2023-12-19T05:38:59.581779+0000","last_undegraded":"2023-12-19T05:38:59.581779+0000","last_fullsized":"2023-12-19T05:38:59.581779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583825+0000","last_change":"2023-12-19T05:38:58.105317+0000","last_active":"2023-12-19T05:38:59.583825+0000","last_peered":"2023-12-19T05:38:59.583825+0000","last_clean":"2023-12-19T05:38:59.583825+0000","last_became_active":"2023-12-19T05:38:58.105045+0000","last_became_peered":"2023-12-19T05:38:58.105045+0000","last_unstale":"2023-12-19T05:38:59.583825+0000","last_undegraded":"2023-12-19T05:38:59.583825+0000","last_fullsized":"2023-12-19T05:38:59.583825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581433+0000","last_change":"2023-12-19T05:38:58.100348+0000","last_active":"2023-12-19T05:38:59.581433+0000","last_peered":"2023-12-19T05:38:59.581433+0000","last_clean":"2023-12-19T05:38:59.581433+0000","last_became_active":"2023-12-19T05:38:58.100063+0000","last_became_peered":"2023-12-19T05:38:58.100063+0000","last_unstale":"2023-12-19T05:38:59.581433+0000","last_undegraded":"2023-12-19T05:38:59.581433+0000","last_fullsized":"2023-12-19T05:38:59.581433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:21:31.517735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581706+0000","last_change":"2023-12-19T05:38:58.104289+0000","last_active":"2023-12-19T05:38:59.581706+0000","last_peered":"2023-12-19T05:38:59.581706+0000","last_clean":"2023-12-19T05:38:59.581706+0000","last_became_active":"2023-12-19T05:38:58.104000+0000","last_became_peered":"2023-12-19T05:38:58.104000+0000","last_unstale":"2023-12-19T05:38:59.581706+0000","last_undegraded":"2023-12-19T05:38:59.581706+0000","last_fullsized":"2023-12-19T05:38:59.581706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:59.418017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581619+0000","last_change":"2023-12-19T05:38:58.107206+0000","last_active":"2023-12-19T05:38:59.581619+0000","last_peered":"2023-12-19T05:38:59.581619+0000","last_clean":"2023-12-19T05:38:59.581619+0000","last_became_active":"2023-12-19T05:38:58.106923+0000","last_became_peered":"2023-12-19T05:38:58.106923+0000","last_unstale":"2023-12-19T05:38:59.581619+0000","last_undegraded":"2023-12-19T05:38:59.581619+0000","last_fullsized":"2023-12-19T05:38:59.581619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:43.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581843+0000","last_change":"2023-12-19T05:38:58.105909+0000","last_active":"2023-12-19T05:38:59.581843+0000","last_peered":"2023-12-19T05:38:59.581843+0000","last_clean":"2023-12-19T05:38:59.581843+0000","last_became_active":"2023-12-19T05:38:58.105631+0000","last_became_peered":"2023-12-19T05:38:58.105631+0000","last_unstale":"2023-12-19T05:38:59.581843+0000","last_undegraded":"2023-12-19T05:38:59.581843+0000","last_fullsized":"2023-12-19T05:38:59.581843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:43.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581275+0000","last_change":"2023-12-19T05:38:58.111894+0000","last_active":"2023-12-19T05:38:59.581275+0000","last_peered":"2023-12-19T05:38:59.581275+0000","last_clean":"2023-12-19T05:38:59.581275+0000","last_became_active":"2023-12-19T05:38:58.111533+0000","last_became_peered":"2023-12-19T05:38:58.111533+0000","last_unstale":"2023-12-19T05:38:59.581275+0000","last_undegraded":"2023-12-19T05:38:59.581275+0000","last_fullsized":"2023-12-19T05:38:59.581275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:40:14.448992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090400+0000","last_change":"2023-12-19T05:38:58.101614+0000","last_active":"2023-12-19T05:38:59.090400+0000","last_peered":"2023-12-19T05:38:59.090400+0000","last_clean":"2023-12-19T05:38:59.090400+0000","last_became_active":"2023-12-19T05:38:58.101372+0000","last_became_peered":"2023-12-19T05:38:58.101372+0000","last_unstale":"2023-12-19T05:38:59.090400+0000","last_undegraded":"2023-12-19T05:38:59.090400+0000","last_fullsized":"2023-12-19T05:38:59.090400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581894+0000","last_change":"2023-12-19T05:38:58.113056+0000","last_active":"2023-12-19T05:38:59.581894+0000","last_peered":"2023-12-19T05:38:59.581894+0000","last_clean":"2023-12-19T05:38:59.581894+0000","last_became_active":"2023-12-19T05:38:58.112370+0000","last_became_peered":"2023-12-19T05:38:58.112370+0000","last_unstale":"2023-12-19T05:38:59.581894+0000","last_undegraded":"2023-12-19T05:38:59.581894+0000","last_fullsized":"2023-12-19T05:38:59.581894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:45:31.440161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090265+0000","last_change":"2023-12-19T05:38:58.098952+0000","last_active":"2023-12-19T05:38:59.090265+0000","last_peered":"2023-12-19T05:38:59.090265+0000","last_clean":"2023-12-19T05:38:59.090265+0000","last_became_active":"2023-12-19T05:38:58.098688+0000","last_became_peered":"2023-12-19T05:38:58.098688+0000","last_unstale":"2023-12-19T05:38:59.090265+0000","last_undegraded":"2023-12-19T05:38:59.090265+0000","last_fullsized":"2023-12-19T05:38:59.090265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089927+0000","last_change":"2023-12-19T05:38:58.101480+0000","last_active":"2023-12-19T05:38:59.089927+0000","last_peered":"2023-12-19T05:38:59.089927+0000","last_clean":"2023-12-19T05:38:59.089927+0000","last_became_active":"2023-12-19T05:38:58.101192+0000","last_became_peered":"2023-12-19T05:38:58.101192+0000","last_unstale":"2023-12-19T05:38:59.089927+0000","last_undegraded":"2023-12-19T05:38:59.089927+0000","last_fullsized":"2023-12-19T05:38:59.089927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:27.315801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090474+0000","last_change":"2023-12-19T05:38:58.091884+0000","last_active":"2023-12-19T05:38:59.090474+0000","last_peered":"2023-12-19T05:38:59.090474+0000","last_clean":"2023-12-19T05:38:59.090474+0000","last_became_active":"2023-12-19T05:38:58.091578+0000","last_became_peered":"2023-12-19T05:38:58.091578+0000","last_unstale":"2023-12-19T05:38:59.090474+0000","last_undegraded":"2023-12-19T05:38:59.090474+0000","last_fullsized":"2023-12-19T05:38:59.090474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:16.970670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090626+0000","last_change":"2023-12-19T05:38:58.101436+0000","last_active":"2023-12-19T05:38:59.090626+0000","last_peered":"2023-12-19T05:38:59.090626+0000","last_clean":"2023-12-19T05:38:59.090626+0000","last_became_active":"2023-12-19T05:38:58.100401+0000","last_became_peered":"2023-12-19T05:38:58.100401+0000","last_unstale":"2023-12-19T05:38:59.090626+0000","last_undegraded":"2023-12-19T05:38:59.090626+0000","last_fullsized":"2023-12-19T05:38:59.090626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:11:32.894490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581146+0000","last_change":"2023-12-19T05:38:58.102811+0000","last_active":"2023-12-19T05:38:59.581146+0000","last_peered":"2023-12-19T05:38:59.581146+0000","last_clean":"2023-12-19T05:38:59.581146+0000","last_became_active":"2023-12-19T05:38:58.102580+0000","last_became_peered":"2023-12-19T05:38:58.102580+0000","last_unstale":"2023-12-19T05:38:59.581146+0000","last_undegraded":"2023-12-19T05:38:59.581146+0000","last_fullsized":"2023-12-19T05:38:59.581146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583668+0000","last_change":"2023-12-19T05:38:58.102035+0000","last_active":"2023-12-19T05:38:59.583668+0000","last_peered":"2023-12-19T05:38:59.583668+0000","last_clean":"2023-12-19T05:38:59.583668+0000","last_became_active":"2023-12-19T05:38:58.101153+0000","last_became_peered":"2023-12-19T05:38:58.101153+0000","last_unstale":"2023-12-19T05:38:59.583668+0000","last_undegraded":"2023-12-19T05:38:59.583668+0000","last_fullsized":"2023-12-19T05:38:59.583668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:27.315801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581251+0000","last_change":"2023-12-19T05:38:58.106052+0000","last_active":"2023-12-19T05:38:59.581251+0000","last_peered":"2023-12-19T05:38:59.581251+0000","last_clean":"2023-12-19T05:38:59.581251+0000","last_became_active":"2023-12-19T05:38:58.105526+0000","last_became_peered":"2023-12-19T05:38:58.105526+0000","last_unstale":"2023-12-19T05:38:59.581251+0000","last_undegraded":"2023-12-19T05:38:59.581251+0000","last_fullsized":"2023-12-19T05:38:59.581251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582066+0000","last_change":"2023-12-19T05:38:58.108370+0000","last_active":"2023-12-19T05:38:59.582066+0000","last_peered":"2023-12-19T05:38:59.582066+0000","last_clean":"2023-12-19T05:38:59.582066+0000","last_became_active":"2023-12-19T05:38:58.108107+0000","last_became_peered":"2023-12-19T05:38:58.108107+0000","last_unstale":"2023-12-19T05:38:59.582066+0000","last_undegraded":"2023-12-19T05:38:59.582066+0000","last_fullsized":"2023-12-19T05:38:59.582066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:52.928586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583650+0000","last_change":"2023-12-19T05:38:58.102611+0000","last_active":"2023-12-19T05:38:59.583650+0000","last_peered":"2023-12-19T05:38:59.583650+0000","last_clean":"2023-12-19T05:38:59.583650+0000","last_became_active":"2023-12-19T05:38:58.102361+0000","last_became_peered":"2023-12-19T05:38:58.102361+0000","last_unstale":"2023-12-19T05:38:59.583650+0000","last_undegraded":"2023-12-19T05:38:59.583650+0000","last_fullsized":"2023-12-19T05:38:59.583650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:31.277716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582028+0000","last_change":"2023-12-19T05:38:58.107547+0000","last_active":"2023-12-19T05:38:59.582028+0000","last_peered":"2023-12-19T05:38:59.582028+0000","last_clean":"2023-12-19T05:38:59.582028+0000","last_became_active":"2023-12-19T05:38:58.106808+0000","last_became_peered":"2023-12-19T05:38:58.106808+0000","last_unstale":"2023-12-19T05:38:59.582028+0000","last_undegraded":"2023-12-19T05:38:59.582028+0000","last_fullsized":"2023-12-19T05:38:59.582028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:52.928586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089864+0000","last_change":"2023-12-19T05:38:58.094094+0000","last_active":"2023-12-19T05:38:59.089864+0000","last_peered":"2023-12-19T05:38:59.089864+0000","last_clean":"2023-12-19T05:38:59.089864+0000","last_became_active":"2023-12-19T05:38:58.093233+0000","last_became_peered":"2023-12-19T05:38:58.093233+0000","last_unstale":"2023-12-19T05:38:59.089864+0000","last_undegraded":"2023-12-19T05:38:59.089864+0000","last_fullsized":"2023-12-19T05:38:59.089864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581342+0000","last_change":"2023-12-19T05:38:58.098898+0000","last_active":"2023-12-19T05:38:59.581342+0000","last_peered":"2023-12-19T05:38:59.581342+0000","last_clean":"2023-12-19T05:38:59.581342+0000","last_became_active":"2023-12-19T05:38:58.098655+0000","last_became_peered":"2023-12-19T05:38:58.098655+0000","last_unstale":"2023-12-19T05:38:59.581342+0000","last_undegraded":"2023-12-19T05:38:59.581342+0000","last_fullsized":"2023-12-19T05:38:59.581342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582246+0000","last_change":"2023-12-19T05:38:58.109033+0000","last_active":"2023-12-19T05:38:59.582246+0000","last_peered":"2023-12-19T05:38:59.582246+0000","last_clean":"2023-12-19T05:38:59.582246+0000","last_became_active":"2023-12-19T05:38:58.108755+0000","last_became_peered":"2023-12-19T05:38:58.108755+0000","last_unstale":"2023-12-19T05:38:59.582246+0000","last_undegraded":"2023-12-19T05:38:59.582246+0000","last_fullsized":"2023-12-19T05:38:59.582246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:45:31.440161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090497+0000","last_change":"2023-12-19T05:38:58.103472+0000","last_active":"2023-12-19T05:38:59.090497+0000","last_peered":"2023-12-19T05:38:59.090497+0000","last_clean":"2023-12-19T05:38:59.090497+0000","last_became_active":"2023-12-19T05:38:58.103212+0000","last_became_peered":"2023-12-19T05:38:58.103212+0000","last_unstale":"2023-12-19T05:38:59.090497+0000","last_undegraded":"2023-12-19T05:38:59.090497+0000","last_fullsized":"2023-12-19T05:38:59.090497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581328+0000","last_change":"2023-12-19T05:38:58.100231+0000","last_active":"2023-12-19T05:38:59.581328+0000","last_peered":"2023-12-19T05:38:59.581328+0000","last_clean":"2023-12-19T05:38:59.581328+0000","last_became_active":"2023-12-19T05:38:58.100015+0000","last_became_peered":"2023-12-19T05:38:58.100015+0000","last_unstale":"2023-12-19T05:38:59.581328+0000","last_undegraded":"2023-12-19T05:38:59.581328+0000","last_fullsized":"2023-12-19T05:38:59.581328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:06:44.968515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090809+0000","last_change":"2023-12-19T05:38:58.104008+0000","last_active":"2023-12-19T05:38:59.090809+0000","last_peered":"2023-12-19T05:38:59.090809+0000","last_clean":"2023-12-19T05:38:59.090809+0000","last_became_active":"2023-12-19T05:38:58.103773+0000","last_became_peered":"2023-12-19T05:38:58.103773+0000","last_unstale":"2023-12-19T05:38:59.090809+0000","last_undegraded":"2023-12-19T05:38:59.090809+0000","last_fullsized":"2023-12-19T05:38:59.090809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:39:36.270833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090360+0000","last_change":"2023-12-19T05:38:58.098405+0000","last_active":"2023-12-19T05:38:59.090360+0000","last_peered":"2023-12-19T05:38:59.090360+0000","last_clean":"2023-12-19T05:38:59.090360+0000","last_became_active":"2023-12-19T05:38:58.098169+0000","last_became_peered":"2023-12-19T05:38:58.098169+0000","last_unstale":"2023-12-19T05:38:59.090360+0000","last_undegraded":"2023-12-19T05:38:59.090360+0000","last_fullsized":"2023-12-19T05:38:59.090360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583795+0000","last_change":"2023-12-19T05:38:58.103378+0000","last_active":"2023-12-19T05:38:59.583795+0000","last_peered":"2023-12-19T05:38:59.583795+0000","last_clean":"2023-12-19T05:38:59.583795+0000","last_became_active":"2023-12-19T05:38:58.103170+0000","last_became_peered":"2023-12-19T05:38:58.103170+0000","last_unstale":"2023-12-19T05:38:59.583795+0000","last_undegraded":"2023-12-19T05:38:59.583795+0000","last_fullsized":"2023-12-19T05:38:59.583795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090735+0000","last_change":"2023-12-19T05:38:58.104682+0000","last_active":"2023-12-19T05:38:59.090735+0000","last_peered":"2023-12-19T05:38:59.090735+0000","last_clean":"2023-12-19T05:38:59.090735+0000","last_became_active":"2023-12-19T05:38:58.104111+0000","last_became_peered":"2023-12-19T05:38:58.104111+0000","last_unstale":"2023-12-19T05:38:59.090735+0000","last_undegraded":"2023-12-19T05:38:59.090735+0000","last_fullsized":"2023-12-19T05:38:59.090735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:04:17.113504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581369+0000","last_change":"2023-12-19T05:38:58.109481+0000","last_active":"2023-12-19T05:38:59.581369+0000","last_peered":"2023-12-19T05:38:59.581369+0000","last_clean":"2023-12-19T05:38:59.581369+0000","last_became_active":"2023-12-19T05:38:58.109231+0000","last_became_peered":"2023-12-19T05:38:58.109231+0000","last_unstale":"2023-12-19T05:38:59.581369+0000","last_undegraded":"2023-12-19T05:38:59.581369+0000","last_fullsized":"2023-12-19T05:38:59.581369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:11:32.894490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581984+0000","last_change":"2023-12-19T05:38:58.099092+0000","last_active":"2023-12-19T05:38:59.581984+0000","last_peered":"2023-12-19T05:38:59.581984+0000","last_clean":"2023-12-19T05:38:59.581984+0000","last_became_active":"2023-12-19T05:38:58.098814+0000","last_became_peered":"2023-12-19T05:38:58.098814+0000","last_unstale":"2023-12-19T05:38:59.581984+0000","last_undegraded":"2023-12-19T05:38:59.581984+0000","last_fullsized":"2023-12-19T05:38:59.581984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:49:37.511914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583537+0000","last_change":"2023-12-19T05:38:58.101510+0000","last_active":"2023-12-19T05:38:59.583537+0000","last_peered":"2023-12-19T05:38:59.583537+0000","last_clean":"2023-12-19T05:38:59.583537+0000","last_became_active":"2023-12-19T05:38:58.101267+0000","last_became_peered":"2023-12-19T05:38:58.101267+0000","last_unstale":"2023-12-19T05:38:59.583537+0000","last_undegraded":"2023-12-19T05:38:59.583537+0000","last_fullsized":"2023-12-19T05:38:59.583537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:12.386527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089518+0000","last_change":"2023-12-19T05:38:58.090308+0000","last_active":"2023-12-19T05:38:59.089518+0000","last_peered":"2023-12-19T05:38:59.089518+0000","last_clean":"2023-12-19T05:38:59.089518+0000","last_became_active":"2023-12-19T05:38:58.090012+0000","last_became_peered":"2023-12-19T05:38:58.090012+0000","last_unstale":"2023-12-19T05:38:59.089518+0000","last_undegraded":"2023-12-19T05:38:59.089518+0000","last_fullsized":"2023-12-19T05:38:59.089518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089935+0000","last_change":"2023-12-19T05:38:58.104390+0000","last_active":"2023-12-19T05:38:59.089935+0000","last_peered":"2023-12-19T05:38:59.089935+0000","last_clean":"2023-12-19T05:38:59.089935+0000","last_became_active":"2023-12-19T05:38:58.103851+0000","last_became_peered":"2023-12-19T05:38:58.103851+0000","last_unstale":"2023-12-19T05:38:59.089935+0000","last_undegraded":"2023-12-19T05:38:59.089935+0000","last_fullsized":"2023-12-19T05:38:59.089935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:31.277716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090708+0000","last_change":"2023-12-19T05:38:57.749842+0000","last_active":"2023-12-19T05:38:59.090708+0000","last_peered":"2023-12-19T05:38:59.090708+0000","last_clean":"2023-12-19T05:38:59.090708+0000","last_became_active":"2023-12-19T05:38:57.749527+0000","last_became_peered":"2023-12-19T05:38:57.749527+0000","last_unstale":"2023-12-19T05:38:59.090708+0000","last_undegraded":"2023-12-19T05:38:59.090708+0000","last_fullsized":"2023-12-19T05:38:59.090708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:33:24.465492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581443+0000","last_change":"2023-12-19T05:38:58.097552+0000","last_active":"2023-12-19T05:38:59.581443+0000","last_peered":"2023-12-19T05:38:59.581443+0000","last_clean":"2023-12-19T05:38:59.581443+0000","last_became_active":"2023-12-19T05:38:58.095804+0000","last_became_peered":"2023-12-19T05:38:58.095804+0000","last_unstale":"2023-12-19T05:38:59.581443+0000","last_undegraded":"2023-12-19T05:38:59.581443+0000","last_fullsized":"2023-12-19T05:38:59.581443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:43.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089572+0000","last_change":"2023-12-19T05:38:57.745855+0000","last_active":"2023-12-19T05:38:59.089572+0000","last_peered":"2023-12-19T05:38:59.089572+0000","last_clean":"2023-12-19T05:38:59.089572+0000","last_became_active":"2023-12-19T05:38:57.745612+0000","last_became_peered":"2023-12-19T05:38:57.745612+0000","last_unstale":"2023-12-19T05:38:59.089572+0000","last_undegraded":"2023-12-19T05:38:59.089572+0000","last_fullsized":"2023-12-19T05:38:59.089572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:04.242717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090578+0000","last_change":"2023-12-19T05:38:57.743029+0000","last_active":"2023-12-19T05:38:59.090578+0000","last_peered":"2023-12-19T05:38:59.090578+0000","last_clean":"2023-12-19T05:38:59.090578+0000","last_became_active":"2023-12-19T05:38:57.742745+0000","last_became_peered":"2023-12-19T05:38:57.742745+0000","last_unstale":"2023-12-19T05:38:59.090578+0000","last_undegraded":"2023-12-19T05:38:59.090578+0000","last_fullsized":"2023-12-19T05:38:59.090578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:50:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090439+0000","last_change":"2023-12-19T05:38:58.105433+0000","last_active":"2023-12-19T05:38:59.090439+0000","last_peered":"2023-12-19T05:38:59.090439+0000","last_clean":"2023-12-19T05:38:59.090439+0000","last_became_active":"2023-12-19T05:38:58.105208+0000","last_became_peered":"2023-12-19T05:38:58.105208+0000","last_unstale":"2023-12-19T05:38:59.090439+0000","last_undegraded":"2023-12-19T05:38:59.090439+0000","last_fullsized":"2023-12-19T05:38:59.090439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:21:31.517735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581358+0000","last_change":"2023-12-19T05:38:57.748694+0000","last_active":"2023-12-19T05:38:59.581358+0000","last_peered":"2023-12-19T05:38:59.581358+0000","last_clean":"2023-12-19T05:38:59.581358+0000","last_became_active":"2023-12-19T05:38:57.748438+0000","last_became_peered":"2023-12-19T05:38:57.748438+0000","last_unstale":"2023-12-19T05:38:59.581358+0000","last_undegraded":"2023-12-19T05:38:59.581358+0000","last_fullsized":"2023-12-19T05:38:59.581358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:50:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583565+0000","last_change":"2023-12-19T05:38:58.104021+0000","last_active":"2023-12-19T05:38:59.583565+0000","last_peered":"2023-12-19T05:38:59.583565+0000","last_clean":"2023-12-19T05:38:59.583565+0000","last_became_active":"2023-12-19T05:38:58.103716+0000","last_became_peered":"2023-12-19T05:38:58.103716+0000","last_unstale":"2023-12-19T05:38:59.583565+0000","last_undegraded":"2023-12-19T05:38:59.583565+0000","last_fullsized":"2023-12-19T05:38:59.583565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090207+0000","last_change":"2023-12-19T05:38:57.741260+0000","last_active":"2023-12-19T05:38:59.090207+0000","last_peered":"2023-12-19T05:38:59.090207+0000","last_clean":"2023-12-19T05:38:59.090207+0000","last_became_active":"2023-12-19T05:38:57.740992+0000","last_became_peered":"2023-12-19T05:38:57.740992+0000","last_unstale":"2023-12-19T05:38:59.090207+0000","last_undegraded":"2023-12-19T05:38:59.090207+0000","last_fullsized":"2023-12-19T05:38:59.090207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:33.835019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581639+0000","last_change":"2023-12-19T05:38:58.107290+0000","last_active":"2023-12-19T05:38:59.581639+0000","last_peered":"2023-12-19T05:38:59.581639+0000","last_clean":"2023-12-19T05:38:59.581639+0000","last_became_active":"2023-12-19T05:38:58.107029+0000","last_became_peered":"2023-12-19T05:38:58.107029+0000","last_unstale":"2023-12-19T05:38:59.581639+0000","last_undegraded":"2023-12-19T05:38:59.581639+0000","last_fullsized":"2023-12-19T05:38:59.581639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581826+0000","last_change":"2023-12-19T05:38:57.742723+0000","last_active":"2023-12-19T05:38:59.581826+0000","last_peered":"2023-12-19T05:38:59.581826+0000","last_clean":"2023-12-19T05:38:59.581826+0000","last_became_active":"2023-12-19T05:38:57.742471+0000","last_became_peered":"2023-12-19T05:38:57.742471+0000","last_unstale":"2023-12-19T05:38:59.581826+0000","last_undegraded":"2023-12-19T05:38:59.581826+0000","last_fullsized":"2023-12-19T05:38:59.581826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581502+0000","last_change":"2023-12-19T05:38:58.099111+0000","last_active":"2023-12-19T05:38:59.581502+0000","last_peered":"2023-12-19T05:38:59.581502+0000","last_clean":"2023-12-19T05:38:59.581502+0000","last_became_active":"2023-12-19T05:38:58.098866+0000","last_became_peered":"2023-12-19T05:38:58.098866+0000","last_unstale":"2023-12-19T05:38:59.581502+0000","last_undegraded":"2023-12-19T05:38:59.581502+0000","last_fullsized":"2023-12-19T05:38:59.581502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583938+0000","last_change":"2023-12-19T05:38:57.748284+0000","last_active":"2023-12-19T05:38:59.583938+0000","last_peered":"2023-12-19T05:38:59.583938+0000","last_clean":"2023-12-19T05:38:59.583938+0000","last_became_active":"2023-12-19T05:38:57.747886+0000","last_became_peered":"2023-12-19T05:38:57.747886+0000","last_unstale":"2023-12-19T05:38:59.583938+0000","last_undegraded":"2023-12-19T05:38:59.583938+0000","last_fullsized":"2023-12-19T05:38:59.583938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:04.242717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090492+0000","last_change":"2023-12-19T05:38:58.109568+0000","last_active":"2023-12-19T05:38:59.090492+0000","last_peered":"2023-12-19T05:38:59.090492+0000","last_clean":"2023-12-19T05:38:59.090492+0000","last_became_active":"2023-12-19T05:38:58.108532+0000","last_became_peered":"2023-12-19T05:38:58.108532+0000","last_unstale":"2023-12-19T05:38:59.090492+0000","last_undegraded":"2023-12-19T05:38:59.090492+0000","last_fullsized":"2023-12-19T05:38:59.090492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:38:34.042375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089982+0000","last_change":"2023-12-19T05:38:57.744873+0000","last_active":"2023-12-19T05:38:59.089982+0000","last_peered":"2023-12-19T05:38:59.089982+0000","last_clean":"2023-12-19T05:38:59.089982+0000","last_became_active":"2023-12-19T05:38:57.744145+0000","last_became_peered":"2023-12-19T05:38:57.744145+0000","last_unstale":"2023-12-19T05:38:59.089982+0000","last_undegraded":"2023-12-19T05:38:59.089982+0000","last_fullsized":"2023-12-19T05:38:59.089982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581811+0000","last_change":"2023-12-19T05:38:58.110455+0000","last_active":"2023-12-19T05:38:59.581811+0000","last_peered":"2023-12-19T05:38:59.581811+0000","last_clean":"2023-12-19T05:38:59.581811+0000","last_became_active":"2023-12-19T05:38:58.109945+0000","last_became_peered":"2023-12-19T05:38:58.109945+0000","last_unstale":"2023-12-19T05:38:59.581811+0000","last_undegraded":"2023-12-19T05:38:59.581811+0000","last_fullsized":"2023-12-19T05:38:59.581811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:33:14.172127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581486+0000","last_change":"2023-12-19T05:38:57.748546+0000","last_active":"2023-12-19T05:38:59.581486+0000","last_peered":"2023-12-19T05:38:59.581486+0000","last_clean":"2023-12-19T05:38:59.581486+0000","last_became_active":"2023-12-19T05:38:57.748278+0000","last_became_peered":"2023-12-19T05:38:57.748278+0000","last_unstale":"2023-12-19T05:38:59.581486+0000","last_undegraded":"2023-12-19T05:38:59.581486+0000","last_fullsized":"2023-12-19T05:38:59.581486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581224+0000","last_change":"2023-12-19T05:38:58.098339+0000","last_active":"2023-12-19T05:38:59.581224+0000","last_peered":"2023-12-19T05:38:59.581224+0000","last_clean":"2023-12-19T05:38:59.581224+0000","last_became_active":"2023-12-19T05:38:58.098089+0000","last_became_peered":"2023-12-19T05:38:58.098089+0000","last_unstale":"2023-12-19T05:38:59.581224+0000","last_undegraded":"2023-12-19T05:38:59.581224+0000","last_fullsized":"2023-12-19T05:38:59.581224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:04:17.113504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582073+0000","last_change":"2023-12-19T05:38:57.745004+0000","last_active":"2023-12-19T05:38:59.582073+0000","last_peered":"2023-12-19T05:38:59.582073+0000","last_clean":"2023-12-19T05:38:59.582073+0000","last_became_active":"2023-12-19T05:38:57.744741+0000","last_became_peered":"2023-12-19T05:38:57.744741+0000","last_unstale":"2023-12-19T05:38:59.582073+0000","last_undegraded":"2023-12-19T05:38:59.582073+0000","last_fullsized":"2023-12-19T05:38:59.582073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:33:24.465492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581723+0000","last_change":"2023-12-19T05:38:58.111124+0000","last_active":"2023-12-19T05:38:59.581723+0000","last_peered":"2023-12-19T05:38:59.581723+0000","last_clean":"2023-12-19T05:38:59.581723+0000","last_became_active":"2023-12-19T05:38:58.110863+0000","last_became_peered":"2023-12-19T05:38:58.110863+0000","last_unstale":"2023-12-19T05:38:59.581723+0000","last_undegraded":"2023-12-19T05:38:59.581723+0000","last_fullsized":"2023-12-19T05:38:59.581723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:11:32.894490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089625+0000","last_change":"2023-12-19T05:38:57.746422+0000","last_active":"2023-12-19T05:38:59.089625+0000","last_peered":"2023-12-19T05:38:59.089625+0000","last_clean":"2023-12-19T05:38:59.089625+0000","last_became_active":"2023-12-19T05:38:57.745789+0000","last_became_peered":"2023-12-19T05:38:57.745789+0000","last_unstale":"2023-12-19T05:38:59.089625+0000","last_undegraded":"2023-12-19T05:38:59.089625+0000","last_fullsized":"2023-12-19T05:38:59.089625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:33:24.465492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089575+0000","last_change":"2023-12-19T05:38:58.090187+0000","last_active":"2023-12-19T05:38:59.089575+0000","last_peered":"2023-12-19T05:38:59.089575+0000","last_clean":"2023-12-19T05:38:59.089575+0000","last_became_active":"2023-12-19T05:38:58.089802+0000","last_became_peered":"2023-12-19T05:38:58.089802+0000","last_unstale":"2023-12-19T05:38:59.089575+0000","last_undegraded":"2023-12-19T05:38:59.089575+0000","last_fullsized":"2023-12-19T05:38:59.089575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:39:36.270833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583432+0000","last_change":"2023-12-19T05:38:57.741208+0000","last_active":"2023-12-19T05:38:59.583432+0000","last_peered":"2023-12-19T05:38:59.583432+0000","last_clean":"2023-12-19T05:38:59.583432+0000","last_became_active":"2023-12-19T05:38:57.740907+0000","last_became_peered":"2023-12-19T05:38:57.740907+0000","last_unstale":"2023-12-19T05:38:59.583432+0000","last_undegraded":"2023-12-19T05:38:59.583432+0000","last_fullsized":"2023-12-19T05:38:59.583432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581282+0000","last_change":"2023-12-19T05:38:58.113284+0000","last_active":"2023-12-19T05:38:59.581282+0000","last_peered":"2023-12-19T05:38:59.581282+0000","last_clean":"2023-12-19T05:38:59.581282+0000","last_became_active":"2023-12-19T05:38:58.112846+0000","last_became_peered":"2023-12-19T05:38:58.112846+0000","last_unstale":"2023-12-19T05:38:59.581282+0000","last_undegraded":"2023-12-19T05:38:59.581282+0000","last_fullsized":"2023-12-19T05:38:59.581282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:49:37.511914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090448+0000","last_change":"2023-12-19T05:38:57.745168+0000","last_active":"2023-12-19T05:38:59.090448+0000","last_peered":"2023-12-19T05:38:59.090448+0000","last_clean":"2023-12-19T05:38:59.090448+0000","last_became_active":"2023-12-19T05:38:57.744905+0000","last_became_peered":"2023-12-19T05:38:57.744905+0000","last_unstale":"2023-12-19T05:38:59.090448+0000","last_undegraded":"2023-12-19T05:38:59.090448+0000","last_fullsized":"2023-12-19T05:38:59.090448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:51:13.990639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581693+0000","last_change":"2023-12-19T05:38:58.108513+0000","last_active":"2023-12-19T05:38:59.581693+0000","last_peered":"2023-12-19T05:38:59.581693+0000","last_clean":"2023-12-19T05:38:59.581693+0000","last_became_active":"2023-12-19T05:38:58.108250+0000","last_became_peered":"2023-12-19T05:38:58.108250+0000","last_unstale":"2023-12-19T05:38:59.581693+0000","last_undegraded":"2023-12-19T05:38:59.581693+0000","last_fullsized":"2023-12-19T05:38:59.581693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:59.418017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583713+0000","last_change":"2023-12-19T05:38:57.745413+0000","last_active":"2023-12-19T05:38:59.583713+0000","last_peered":"2023-12-19T05:38:59.583713+0000","last_clean":"2023-12-19T05:38:59.583713+0000","last_became_active":"2023-12-19T05:38:57.745149+0000","last_became_peered":"2023-12-19T05:38:57.745149+0000","last_unstale":"2023-12-19T05:38:59.583713+0000","last_undegraded":"2023-12-19T05:38:59.583713+0000","last_fullsized":"2023-12-19T05:38:59.583713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:50:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582004+0000","last_change":"2023-12-19T05:38:58.112902+0000","last_active":"2023-12-19T05:38:59.582004+0000","last_peered":"2023-12-19T05:38:59.582004+0000","last_clean":"2023-12-19T05:38:59.582004+0000","last_became_active":"2023-12-19T05:38:58.112627+0000","last_became_peered":"2023-12-19T05:38:58.112627+0000","last_unstale":"2023-12-19T05:38:59.582004+0000","last_undegraded":"2023-12-19T05:38:59.582004+0000","last_fullsized":"2023-12-19T05:38:59.582004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:06:44.968515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583906+0000","last_change":"2023-12-19T05:38:57.748007+0000","last_active":"2023-12-19T05:38:59.583906+0000","last_peered":"2023-12-19T05:38:59.583906+0000","last_clean":"2023-12-19T05:38:59.583906+0000","last_became_active":"2023-12-19T05:38:57.747719+0000","last_became_peered":"2023-12-19T05:38:57.747719+0000","last_unstale":"2023-12-19T05:38:59.583906+0000","last_undegraded":"2023-12-19T05:38:59.583906+0000","last_fullsized":"2023-12-19T05:38:59.583906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:30.273362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582169+0000","last_change":"2023-12-19T05:38:58.104239+0000","last_active":"2023-12-19T05:38:59.582169+0000","last_peered":"2023-12-19T05:38:59.582169+0000","last_clean":"2023-12-19T05:38:59.582169+0000","last_became_active":"2023-12-19T05:38:58.103949+0000","last_became_peered":"2023-12-19T05:38:58.103949+0000","last_unstale":"2023-12-19T05:38:59.582169+0000","last_undegraded":"2023-12-19T05:38:59.582169+0000","last_fullsized":"2023-12-19T05:38:59.582169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:11:32.894490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583613+0000","last_change":"2023-12-19T05:38:57.743974+0000","last_active":"2023-12-19T05:38:59.583613+0000","last_peered":"2023-12-19T05:38:59.583613+0000","last_clean":"2023-12-19T05:38:59.583613+0000","last_became_active":"2023-12-19T05:38:57.743685+0000","last_became_peered":"2023-12-19T05:38:57.743685+0000","last_unstale":"2023-12-19T05:38:59.583613+0000","last_undegraded":"2023-12-19T05:38:59.583613+0000","last_fullsized":"2023-12-19T05:38:59.583613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:33:24.465492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581912+0000","last_change":"2023-12-19T05:38:58.106818+0000","last_active":"2023-12-19T05:38:59.581912+0000","last_peered":"2023-12-19T05:38:59.581912+0000","last_clean":"2023-12-19T05:38:59.581912+0000","last_became_active":"2023-12-19T05:38:58.106450+0000","last_became_peered":"2023-12-19T05:38:58.106450+0000","last_unstale":"2023-12-19T05:38:59.581912+0000","last_undegraded":"2023-12-19T05:38:59.581912+0000","last_fullsized":"2023-12-19T05:38:59.581912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:44:05.254781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:38:58.098353+0000","last_change":"2023-12-19T05:38:47.150620+0000","last_active":"2023-12-19T05:38:58.098353+0000","last_peered":"2023-12-19T05:38:58.098353+0000","last_clean":"2023-12-19T05:38:58.098353+0000","last_became_active":"2023-12-19T05:38:47.149844+0000","last_became_peered":"2023-12-19T05:38:47.149844+0000","last_unstale":"2023-12-19T05:38:58.098353+0000","last_undegraded":"2023-12-19T05:38:58.098353+0000","last_fullsized":"2023-12-19T05:38:58.098353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_clean_scrub_stamp":"2023-12-19T05:38:46.034642+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:51.920917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581466+0000","last_change":"2023-12-19T05:38:57.741233+0000","last_active":"2023-12-19T05:38:59.581466+0000","last_peered":"2023-12-19T05:38:59.581466+0000","last_clean":"2023-12-19T05:38:59.581466+0000","last_became_active":"2023-12-19T05:38:57.740919+0000","last_became_peered":"2023-12-19T05:38:57.740919+0000","last_unstale":"2023-12-19T05:38:59.581466+0000","last_undegraded":"2023-12-19T05:38:59.581466+0000","last_fullsized":"2023-12-19T05:38:59.581466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:33.835019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090563+0000","last_change":"2023-12-19T05:38:58.101883+0000","last_active":"2023-12-19T05:38:59.090563+0000","last_peered":"2023-12-19T05:38:59.090563+0000","last_clean":"2023-12-19T05:38:59.090563+0000","last_became_active":"2023-12-19T05:38:58.101654+0000","last_became_peered":"2023-12-19T05:38:58.101654+0000","last_unstale":"2023-12-19T05:38:59.090563+0000","last_undegraded":"2023-12-19T05:38:59.090563+0000","last_fullsized":"2023-12-19T05:38:59.090563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581246+0000","last_change":"2023-12-19T05:38:57.753323+0000","last_active":"2023-12-19T05:38:59.581246+0000","last_peered":"2023-12-19T05:38:59.581246+0000","last_clean":"2023-12-19T05:38:59.581246+0000","last_became_active":"2023-12-19T05:38:57.752998+0000","last_became_peered":"2023-12-19T05:38:57.752998+0000","last_unstale":"2023-12-19T05:38:59.581246+0000","last_undegraded":"2023-12-19T05:38:59.581246+0000","last_fullsized":"2023-12-19T05:38:59.581246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:33.835019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581129+0000","last_change":"2023-12-19T05:38:58.093174+0000","last_active":"2023-12-19T05:38:59.581129+0000","last_peered":"2023-12-19T05:38:59.581129+0000","last_clean":"2023-12-19T05:38:59.581129+0000","last_became_active":"2023-12-19T05:38:58.092933+0000","last_became_peered":"2023-12-19T05:38:58.092933+0000","last_unstale":"2023-12-19T05:38:59.581129+0000","last_undegraded":"2023-12-19T05:38:59.581129+0000","last_fullsized":"2023-12-19T05:38:59.581129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:52.928586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583580+0000","last_change":"2023-12-19T05:38:57.745338+0000","last_active":"2023-12-19T05:38:59.583580+0000","last_peered":"2023-12-19T05:38:59.583580+0000","last_clean":"2023-12-19T05:38:59.583580+0000","last_became_active":"2023-12-19T05:38:57.745038+0000","last_became_peered":"2023-12-19T05:38:57.745038+0000","last_unstale":"2023-12-19T05:38:59.583580+0000","last_undegraded":"2023-12-19T05:38:59.583580+0000","last_fullsized":"2023-12-19T05:38:59.583580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583564+0000","last_change":"2023-12-19T05:38:58.102456+0000","last_active":"2023-12-19T05:38:59.583564+0000","last_peered":"2023-12-19T05:38:59.583564+0000","last_clean":"2023-12-19T05:38:59.583564+0000","last_became_active":"2023-12-19T05:38:58.102200+0000","last_became_peered":"2023-12-19T05:38:58.102200+0000","last_unstale":"2023-12-19T05:38:59.583564+0000","last_undegraded":"2023-12-19T05:38:59.583564+0000","last_fullsized":"2023-12-19T05:38:59.583564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:04:17.113504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582159+0000","last_change":"2023-12-19T05:38:57.743585+0000","last_active":"2023-12-19T05:38:59.582159+0000","last_peered":"2023-12-19T05:38:59.582159+0000","last_clean":"2023-12-19T05:38:59.582159+0000","last_became_active":"2023-12-19T05:38:57.743280+0000","last_became_peered":"2023-12-19T05:38:57.743280+0000","last_unstale":"2023-12-19T05:38:59.582159+0000","last_undegraded":"2023-12-19T05:38:59.582159+0000","last_fullsized":"2023-12-19T05:38:59.582159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090317+0000","last_change":"2023-12-19T05:38:58.091932+0000","last_active":"2023-12-19T05:38:59.090317+0000","last_peered":"2023-12-19T05:38:59.090317+0000","last_clean":"2023-12-19T05:38:59.090317+0000","last_became_active":"2023-12-19T05:38:58.091652+0000","last_became_peered":"2023-12-19T05:38:58.091652+0000","last_unstale":"2023-12-19T05:38:59.090317+0000","last_undegraded":"2023-12-19T05:38:59.090317+0000","last_fullsized":"2023-12-19T05:38:59.090317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:12.386527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583836+0000","last_change":"2023-12-19T05:38:57.745683+0000","last_active":"2023-12-19T05:38:59.583836+0000","last_peered":"2023-12-19T05:38:59.583836+0000","last_clean":"2023-12-19T05:38:59.583836+0000","last_became_active":"2023-12-19T05:38:57.745397+0000","last_became_peered":"2023-12-19T05:38:57.745397+0000","last_unstale":"2023-12-19T05:38:59.583836+0000","last_undegraded":"2023-12-19T05:38:59.583836+0000","last_fullsized":"2023-12-19T05:38:59.583836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581745+0000","last_change":"2023-12-19T05:38:58.103911+0000","last_active":"2023-12-19T05:38:59.581745+0000","last_peered":"2023-12-19T05:38:59.581745+0000","last_clean":"2023-12-19T05:38:59.581745+0000","last_became_active":"2023-12-19T05:38:58.103234+0000","last_became_peered":"2023-12-19T05:38:58.103234+0000","last_unstale":"2023-12-19T05:38:59.581745+0000","last_undegraded":"2023-12-19T05:38:59.581745+0000","last_fullsized":"2023-12-19T05:38:59.581745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:33:14.172127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582052+0000","last_change":"2023-12-19T05:38:57.753286+0000","last_active":"2023-12-19T05:38:59.582052+0000","last_peered":"2023-12-19T05:38:59.582052+0000","last_clean":"2023-12-19T05:38:59.582052+0000","last_became_active":"2023-12-19T05:38:57.752956+0000","last_became_peered":"2023-12-19T05:38:57.752956+0000","last_unstale":"2023-12-19T05:38:59.582052+0000","last_undegraded":"2023-12-19T05:38:59.582052+0000","last_fullsized":"2023-12-19T05:38:59.582052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583722+0000","last_change":"2023-12-19T05:38:58.106316+0000","last_active":"2023-12-19T05:38:59.583722+0000","last_peered":"2023-12-19T05:38:59.583722+0000","last_clean":"2023-12-19T05:38:59.583722+0000","last_became_active":"2023-12-19T05:38:58.106080+0000","last_became_peered":"2023-12-19T05:38:58.106080+0000","last_unstale":"2023-12-19T05:38:59.583722+0000","last_undegraded":"2023-12-19T05:38:59.583722+0000","last_fullsized":"2023-12-19T05:38:59.583722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:39:36.270833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583846+0000","last_change":"2023-12-19T05:38:57.745431+0000","last_active":"2023-12-19T05:38:59.583846+0000","last_peered":"2023-12-19T05:38:59.583846+0000","last_clean":"2023-12-19T05:38:59.583846+0000","last_became_active":"2023-12-19T05:38:57.745111+0000","last_became_peered":"2023-12-19T05:38:57.745111+0000","last_unstale":"2023-12-19T05:38:59.583846+0000","last_undegraded":"2023-12-19T05:38:59.583846+0000","last_fullsized":"2023-12-19T05:38:59.583846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:15.966316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090806+0000","last_change":"2023-12-19T05:38:58.104157+0000","last_active":"2023-12-19T05:38:59.090806+0000","last_peered":"2023-12-19T05:38:59.090806+0000","last_clean":"2023-12-19T05:38:59.090806+0000","last_became_active":"2023-12-19T05:38:58.103934+0000","last_became_peered":"2023-12-19T05:38:58.103934+0000","last_unstale":"2023-12-19T05:38:59.090806+0000","last_undegraded":"2023-12-19T05:38:59.090806+0000","last_fullsized":"2023-12-19T05:38:59.090806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:52.928586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090306+0000","last_change":"2023-12-19T05:38:57.747086+0000","last_active":"2023-12-19T05:38:59.090306+0000","last_peered":"2023-12-19T05:38:59.090306+0000","last_clean":"2023-12-19T05:38:59.090306+0000","last_became_active":"2023-12-19T05:38:57.746818+0000","last_became_peered":"2023-12-19T05:38:57.746818+0000","last_unstale":"2023-12-19T05:38:59.090306+0000","last_undegraded":"2023-12-19T05:38:59.090306+0000","last_fullsized":"2023-12-19T05:38:59.090306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:15.966316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581497+0000","last_change":"2023-12-19T05:38:58.103335+0000","last_active":"2023-12-19T05:38:59.581497+0000","last_peered":"2023-12-19T05:38:59.581497+0000","last_clean":"2023-12-19T05:38:59.581497+0000","last_became_active":"2023-12-19T05:38:58.103108+0000","last_became_peered":"2023-12-19T05:38:58.103108+0000","last_unstale":"2023-12-19T05:38:59.581497+0000","last_undegraded":"2023-12-19T05:38:59.581497+0000","last_fullsized":"2023-12-19T05:38:59.581497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:27.315801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581446+0000","last_change":"2023-12-19T05:38:57.753153+0000","last_active":"2023-12-19T05:38:59.581446+0000","last_peered":"2023-12-19T05:38:59.581446+0000","last_clean":"2023-12-19T05:38:59.581446+0000","last_became_active":"2023-12-19T05:38:57.752881+0000","last_became_peered":"2023-12-19T05:38:57.752881+0000","last_unstale":"2023-12-19T05:38:59.581446+0000","last_undegraded":"2023-12-19T05:38:59.581446+0000","last_fullsized":"2023-12-19T05:38:59.581446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:04.242717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089877+0000","last_change":"2023-12-19T05:38:58.101259+0000","last_active":"2023-12-19T05:38:59.089877+0000","last_peered":"2023-12-19T05:38:59.089877+0000","last_clean":"2023-12-19T05:38:59.089877+0000","last_became_active":"2023-12-19T05:38:58.100992+0000","last_became_peered":"2023-12-19T05:38:58.100992+0000","last_unstale":"2023-12-19T05:38:59.089877+0000","last_undegraded":"2023-12-19T05:38:59.089877+0000","last_fullsized":"2023-12-19T05:38:59.089877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:05.247071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583860+0000","last_change":"2023-12-19T05:38:57.745745+0000","last_active":"2023-12-19T05:38:59.583860+0000","last_peered":"2023-12-19T05:38:59.583860+0000","last_clean":"2023-12-19T05:38:59.583860+0000","last_became_active":"2023-12-19T05:38:57.745477+0000","last_became_peered":"2023-12-19T05:38:57.745477+0000","last_unstale":"2023-12-19T05:38:59.583860+0000","last_undegraded":"2023-12-19T05:38:59.583860+0000","last_fullsized":"2023-12-19T05:38:59.583860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090521+0000","last_change":"2023-12-19T05:38:58.107888+0000","last_active":"2023-12-19T05:38:59.090521+0000","last_peered":"2023-12-19T05:38:59.090521+0000","last_clean":"2023-12-19T05:38:59.090521+0000","last_became_active":"2023-12-19T05:38:58.107286+0000","last_became_peered":"2023-12-19T05:38:58.107286+0000","last_unstale":"2023-12-19T05:38:59.090521+0000","last_undegraded":"2023-12-19T05:38:59.090521+0000","last_fullsized":"2023-12-19T05:38:59.090521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:27.315801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583857+0000","last_change":"2023-12-19T05:38:57.745515+0000","last_active":"2023-12-19T05:38:59.583857+0000","last_peered":"2023-12-19T05:38:59.583857+0000","last_clean":"2023-12-19T05:38:59.583857+0000","last_became_active":"2023-12-19T05:38:57.745072+0000","last_became_peered":"2023-12-19T05:38:57.745072+0000","last_unstale":"2023-12-19T05:38:59.583857+0000","last_undegraded":"2023-12-19T05:38:59.583857+0000","last_fullsized":"2023-12-19T05:38:59.583857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:33.835019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090635+0000","last_change":"2023-12-19T05:38:58.106802+0000","last_active":"2023-12-19T05:38:59.090635+0000","last_peered":"2023-12-19T05:38:59.090635+0000","last_clean":"2023-12-19T05:38:59.090635+0000","last_became_active":"2023-12-19T05:38:58.106522+0000","last_became_peered":"2023-12-19T05:38:58.106522+0000","last_unstale":"2023-12-19T05:38:59.090635+0000","last_undegraded":"2023-12-19T05:38:59.090635+0000","last_fullsized":"2023-12-19T05:38:59.090635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581817+0000","last_change":"2023-12-19T05:38:57.748708+0000","last_active":"2023-12-19T05:38:59.581817+0000","last_peered":"2023-12-19T05:38:59.581817+0000","last_clean":"2023-12-19T05:38:59.581817+0000","last_became_active":"2023-12-19T05:38:57.748432+0000","last_became_peered":"2023-12-19T05:38:57.748432+0000","last_unstale":"2023-12-19T05:38:59.581817+0000","last_undegraded":"2023-12-19T05:38:59.581817+0000","last_fullsized":"2023-12-19T05:38:59.581817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089691+0000","last_change":"2023-12-19T05:38:58.093836+0000","last_active":"2023-12-19T05:38:59.089691+0000","last_peered":"2023-12-19T05:38:59.089691+0000","last_clean":"2023-12-19T05:38:59.089691+0000","last_became_active":"2023-12-19T05:38:58.093559+0000","last_became_peered":"2023-12-19T05:38:58.093559+0000","last_unstale":"2023-12-19T05:38:59.089691+0000","last_undegraded":"2023-12-19T05:38:59.089691+0000","last_fullsized":"2023-12-19T05:38:59.089691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:04:17.113504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581656+0000","last_change":"2023-12-19T05:38:58.104146+0000","last_active":"2023-12-19T05:38:59.581656+0000","last_peered":"2023-12-19T05:38:59.581656+0000","last_clean":"2023-12-19T05:38:59.581656+0000","last_became_active":"2023-12-19T05:38:58.102734+0000","last_became_peered":"2023-12-19T05:38:58.102734+0000","last_unstale":"2023-12-19T05:38:59.581656+0000","last_undegraded":"2023-12-19T05:38:59.581656+0000","last_fullsized":"2023-12-19T05:38:59.581656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581673+0000","last_change":"2023-12-19T05:38:57.750833+0000","last_active":"2023-12-19T05:38:59.581673+0000","last_peered":"2023-12-19T05:38:59.581673+0000","last_clean":"2023-12-19T05:38:59.581673+0000","last_became_active":"2023-12-19T05:38:57.750555+0000","last_became_peered":"2023-12-19T05:38:57.750555+0000","last_unstale":"2023-12-19T05:38:59.581673+0000","last_undegraded":"2023-12-19T05:38:59.581673+0000","last_fullsized":"2023-12-19T05:38:59.581673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:15.966316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581801+0000","last_change":"2023-12-19T05:38:58.103122+0000","last_active":"2023-12-19T05:38:59.581801+0000","last_peered":"2023-12-19T05:38:59.581801+0000","last_clean":"2023-12-19T05:38:59.581801+0000","last_became_active":"2023-12-19T05:38:58.102705+0000","last_became_peered":"2023-12-19T05:38:58.102705+0000","last_unstale":"2023-12-19T05:38:59.581801+0000","last_undegraded":"2023-12-19T05:38:59.581801+0000","last_fullsized":"2023-12-19T05:38:59.581801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581950+0000","last_change":"2023-12-19T05:38:57.750383+0000","last_active":"2023-12-19T05:38:59.581950+0000","last_peered":"2023-12-19T05:38:59.581950+0000","last_clean":"2023-12-19T05:38:59.581950+0000","last_became_active":"2023-12-19T05:38:57.750076+0000","last_became_peered":"2023-12-19T05:38:57.750076+0000","last_unstale":"2023-12-19T05:38:59.581950+0000","last_undegraded":"2023-12-19T05:38:59.581950+0000","last_fullsized":"2023-12-19T05:38:59.581950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:30.273362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581472+0000","last_change":"2023-12-19T05:38:58.099053+0000","last_active":"2023-12-19T05:38:59.581472+0000","last_peered":"2023-12-19T05:38:59.581472+0000","last_clean":"2023-12-19T05:38:59.581472+0000","last_became_active":"2023-12-19T05:38:58.098823+0000","last_became_peered":"2023-12-19T05:38:58.098823+0000","last_unstale":"2023-12-19T05:38:59.581472+0000","last_undegraded":"2023-12-19T05:38:59.581472+0000","last_fullsized":"2023-12-19T05:38:59.581472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090815+0000","last_change":"2023-12-19T05:38:57.750220+0000","last_active":"2023-12-19T05:38:59.090815+0000","last_peered":"2023-12-19T05:38:59.090815+0000","last_clean":"2023-12-19T05:38:59.090815+0000","last_became_active":"2023-12-19T05:38:57.749929+0000","last_became_peered":"2023-12-19T05:38:57.749929+0000","last_unstale":"2023-12-19T05:38:59.090815+0000","last_undegraded":"2023-12-19T05:38:59.090815+0000","last_fullsized":"2023-12-19T05:38:59.090815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:12:26.203081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090707+0000","last_change":"2023-12-19T05:38:58.101262+0000","last_active":"2023-12-19T05:38:59.090707+0000","last_peered":"2023-12-19T05:38:59.090707+0000","last_clean":"2023-12-19T05:38:59.090707+0000","last_became_active":"2023-12-19T05:38:58.100440+0000","last_became_peered":"2023-12-19T05:38:58.100440+0000","last_unstale":"2023-12-19T05:38:59.090707+0000","last_undegraded":"2023-12-19T05:38:59.090707+0000","last_fullsized":"2023-12-19T05:38:59.090707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:43.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581530+0000","last_change":"2023-12-19T05:38:57.748866+0000","last_active":"2023-12-19T05:38:59.581530+0000","last_peered":"2023-12-19T05:38:59.581530+0000","last_clean":"2023-12-19T05:38:59.581530+0000","last_became_active":"2023-12-19T05:38:57.748578+0000","last_became_peered":"2023-12-19T05:38:57.748578+0000","last_unstale":"2023-12-19T05:38:59.581530+0000","last_undegraded":"2023-12-19T05:38:59.581530+0000","last_fullsized":"2023-12-19T05:38:59.581530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:50:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":69969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T05:39:01.996 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T05:39:01.996 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-19T05:39:01.996 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-19T05:39:01.996 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-19T05:39:01.997 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-19T05:39:02.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.130+0000 7f18d9747640 1 Processor -- start 2023-12-19T05:39:02.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.130+0000 7f18d9747640 1 -- start start 2023-12-19T05:39:02.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.130+0000 7f18d9747640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18d40b7d90 0x7f18d4144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.130+0000 7f18d9747640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18d4145010 0x7f18d414b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.130+0000 7f18d9747640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d40b96b0 con 0x7f18d40b79b0 2023-12-19T05:39:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.130+0000 7f18d9747640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d414ae10 con 0x7f18d40b7d90 2023-12-19T05:39:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.130+0000 7f18d9747640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40bacc0 con 0x7f18d4145010 2023-12-19T05:39:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.131+0000 7f18d37fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18d4145010 0x7f18d414b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.131+0000 7f18d27fc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f18d40b7d90 0x7f18d4144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.131+0000 7f18d37fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18d4145010 0x7f18d414b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:43956/0 (socket says 172.21.15.120:43956) 2023-12-19T05:39:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.131+0000 7f18d37fe640 1 -- 172.21.15.120:0/2972653299 learned_addr learned my addr 172.21.15.120:0/2972653299 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.131+0000 7f18d27fc640 1 -- 172.21.15.120:0/2972653299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18d4145010 msgr2=0x7f18d414b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.131+0000 7f18d27fc640 1 --2- 172.21.15.120:0/2972653299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18d4145010 0x7f18d414b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.131+0000 7f18d27fc640 1 -- 172.21.15.120:0/2972653299 >> v1:172.21.15.155:6789/0 conn(0x7f18d40b79b0 legacy=0x7f18d40b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.131+0000 7f18d27fc640 1 -- 172.21.15.120:0/2972653299 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d40b81d0 con 0x7f18d40b7d90 2023-12-19T05:39:02.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.131+0000 7f18d37fe640 1 --2- 172.21.15.120:0/2972653299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18d4145010 0x7f18d414b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.132+0000 7f18d27fc640 1 --2- 172.21.15.120:0/2972653299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18d40b7d90 0x7f18d4144ad0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f18c40097a0 tx=0x7f18c402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2714a530dcab938 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.132+0000 7f18d1ffb640 1 -- 172.21.15.120:0/2972653299 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4031830 con 0x7f18d40b7d90 2023-12-19T05:39:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.132+0000 7f18d1ffb640 1 -- 172.21.15.120:0/2972653299 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c4031990 con 0x7f18d40b7d90 2023-12-19T05:39:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.132+0000 7f18d1ffb640 1 -- 172.21.15.120:0/2972653299 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4031d20 con 0x7f18d40b7d90 2023-12-19T05:39:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.132+0000 7f18d9747640 1 -- 172.21.15.120:0/2972653299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18d40b7d90 msgr2=0x7f18d4144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.132+0000 7f18d9747640 1 --2- 172.21.15.120:0/2972653299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18d40b7d90 0x7f18d4144ad0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f18c40097a0 tx=0x7f18c402b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.132+0000 7f18d9747640 1 -- 172.21.15.120:0/2972653299 shutdown_connections 2023-12-19T05:39:02.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.132+0000 7f18d9747640 1 --2- 172.21.15.120:0/2972653299 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18d4145010 0x7f18d414b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.132+0000 7f18d9747640 1 --2- 172.21.15.120:0/2972653299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18d40b7d90 0x7f18d4144ad0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.132+0000 7f18d9747640 1 -- 172.21.15.120:0/2972653299 >> 172.21.15.120:0/2972653299 conn(0x7f18d40c0340 msgr2=0x7f18d40c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.132+0000 7f18d9747640 1 -- 172.21.15.120:0/2972653299 shutdown_connections 2023-12-19T05:39:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.132+0000 7f18d9747640 1 -- 172.21.15.120:0/2972653299 wait complete. 2023-12-19T05:39:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.134+0000 7f18d9747640 1 Processor -- start 2023-12-19T05:39:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.134+0000 7f18d9747640 1 -- start start 2023-12-19T05:39:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.134+0000 7f18d9747640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18d40b79b0 0x7f18d40b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.134+0000 7f18d9747640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18d40b7d90 0x7f18d41464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.134+0000 7f18d9747640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18d4145010 0x7f18d4146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.134+0000 7f18d9747640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40b5e20 con 0x7f18d40b7d90 2023-12-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.134+0000 7f18d9747640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d41df810 con 0x7f18d4145010 2023-12-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.134+0000 7f18d9747640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d41dfa20 con 0x7f18d40b79b0 2023-12-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.134+0000 7f18d27fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18d40b7d90 0x7f18d41464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.134+0000 7f18d27fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18d40b7d90 0x7f18d41464c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45052/0 (socket says 172.21.15.120:45052) 2023-12-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.134+0000 7f18d27fc640 1 -- 172.21.15.120:0/2596243785 learned_addr learned my addr 172.21.15.120:0/2596243785 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.135+0000 7f18d37fe640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18d4145010 0x7f18d4146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.135+0000 7f18d2ffd640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18d40b79b0 0x7f18d40b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.135+0000 7f18d27fc640 1 -- 172.21.15.120:0/2596243785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18d40b79b0 msgr2=0x7f18d40b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.135+0000 7f18d27fc640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18d40b79b0 0x7f18d40b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.135+0000 7f18d27fc640 1 -- 172.21.15.120:0/2596243785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18d4145010 msgr2=0x7f18d4146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.135+0000 7f18d27fc640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18d4145010 0x7f18d4146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.135+0000 7f18d27fc640 1 -- 172.21.15.120:0/2596243785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc009b30 con 0x7f18d40b7d90 2023-12-19T05:39:02.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.135+0000 7f18d37fe640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18d4145010 0x7f18d4146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:02.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.135+0000 7f18d27fc640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18d40b7d90 0x7f18d41464c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f18c402bee0 tx=0x7f18c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.135+0000 7f18bb7fe640 1 -- 172.21.15.120:0/2596243785 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c403a6f0 con 0x7f18d40b7d90 2023-12-19T05:39:02.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.135+0000 7f18bb7fe640 1 -- 172.21.15.120:0/2596243785 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c403a870 con 0x7f18d40b7d90 2023-12-19T05:39:02.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.135+0000 7f18d9747640 1 -- 172.21.15.120:0/2596243785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c4009400 con 0x7f18d40b7d90 2023-12-19T05:39:02.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.135+0000 7f18bb7fe640 1 -- 172.21.15.120:0/2596243785 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c403ac20 con 0x7f18d40b7d90 2023-12-19T05:39:02.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.135+0000 7f18d9747640 1 -- 172.21.15.120:0/2596243785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d41dffe0 con 0x7f18d40b7d90 2023-12-19T05:39:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.136+0000 7f18d9747640 1 -- 172.21.15.120:0/2596243785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d404e080 con 0x7f18d40b7d90 2023-12-19T05:39:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.136+0000 7f18bb7fe640 1 -- 172.21.15.120:0/2596243785 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f18c404c3b0 con 0x7f18d40b7d90 2023-12-19T05:39:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.137+0000 7f18bb7fe640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f18c006a430 0x7f18c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.137+0000 7f18d2ffd640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f18c006a430 0x7f18c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.137+0000 7f18bb7fe640 1 -- 172.21.15.120:0/2596243785 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18c40aa560 con 0x7f18d40b7d90 2023-12-19T05:39:02.141 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.137+0000 7f18d2ffd640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f18c006a430 0x7f18c006c8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18c8000f60 tx=0x7f18c8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.141+0000 7f18bb7fe640 1 -- 172.21.15.120:0/2596243785 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f18c4075be0 con 0x7f18d40b7d90 2023-12-19T05:39:02.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.351+0000 7f18d9747640 1 -- 172.21.15.120:0/2596243785 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f18d40bb5d0 con 0x7f18d40b7d90 2023-12-19T05:39:02.355 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.354+0000 7f18bb7fe640 1 -- 172.21.15.120:0/2596243785 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169969 (secure 0 0 0) 0x7f18c4079200 con 0x7f18d40b7d90 2023-12-19T05:39:02.357 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.356+0000 7f18d9747640 1 -- 172.21.15.120:0/2596243785 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f18c006a430 msgr2=0x7f18c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.356+0000 7f18d9747640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f18c006a430 0x7f18c006c8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f18c8000f60 tx=0x7f18c8009040 comp rx=0 tx=0).stop 2023-12-19T05:39:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.356+0000 7f18d9747640 1 -- 172.21.15.120:0/2596243785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18d40b7d90 msgr2=0x7f18d41464c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.356+0000 7f18d9747640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18d40b7d90 0x7f18d41464c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f18c402bee0 tx=0x7f18c40046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.357+0000 7f18d9747640 1 -- 172.21.15.120:0/2596243785 shutdown_connections 2023-12-19T05:39:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.357+0000 7f18d9747640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f18c006a430 0x7f18c006c8f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.357+0000 7f18d9747640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18d4145010 0x7f18d4146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.357+0000 7f18d9747640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f18d40b7d90 0x7f18d41464c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.357+0000 7f18d9747640 1 --2- 172.21.15.120:0/2596243785 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f18d40b79b0 0x7f18d40b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.357+0000 7f18d9747640 1 -- 172.21.15.120:0/2596243785 >> 172.21.15.120:0/2596243785 conn(0x7f18d40c0340 msgr2=0x7f18d41499e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.357+0000 7f18d9747640 1 -- 172.21.15.120:0/2596243785 shutdown_connections 2023-12-19T05:39:02.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.357+0000 7f18d9747640 1 -- 172.21.15.120:0/2596243785 wait complete. 2023-12-19T05:39:02.368 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6832","nonce":89586},{"type":"v1","addr":"172.21.15.120:6833","nonce":89586}]},"active_addr":"172.21.15.120:6833/89586","active_change":"2023-12-19T05:38:37.928927+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":587578862}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":2028919114}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":1438969576}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.120:0","nonce":3983495429}]}]} 2023-12-19T05:39:02.371 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-19T05:39:02.372 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-19T05:39:02.372 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:02.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.470+0000 7f7ebac51640 1 Processor -- start 2023-12-19T05:39:02.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.470+0000 7f7ebac51640 1 -- start start 2023-12-19T05:39:02.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.471+0000 7f7ebac51640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7eb406da70 0x7f7eb41429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.471+0000 7f7ebac51640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7eb4142ee0 0x7f7eb40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.471+0000 7f7ebac51640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7eb40b4e30 0x7f7eb40b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.471+0000 7f7ebac51640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb406ebc0 con 0x7f7eb4142ee0 2023-12-19T05:39:02.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.471+0000 7f7ebac51640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb40b3db0 con 0x7f7eb40b4e30 2023-12-19T05:39:02.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.471+0000 7f7ebac51640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb406e690 con 0x7f7eb406da70 2023-12-19T05:39:02.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.471+0000 7f7eb3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7eb4142ee0 0x7f7eb40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.471+0000 7f7eb3fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7eb4142ee0 0x7f7eb40b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45058/0 (socket says 172.21.15.120:45058) 2023-12-19T05:39:02.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.471+0000 7f7eb3fff640 1 -- 172.21.15.120:0/3785330157 learned_addr learned my addr 172.21.15.120:0/3785330157 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:02.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.471+0000 7f7eb89ed640 1 --2- 172.21.15.120:0/3785330157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7eb406da70 0x7f7eb41429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.472+0000 7f7eb91ee640 1 --2- 172.21.15.120:0/3785330157 >> v2:172.21.15.155:3300/0 conn(0x7f7eb40b4e30 0x7f7eb40b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.472+0000 7f7eb3fff640 1 -- 172.21.15.120:0/3785330157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7eb406da70 msgr2=0x7f7eb41429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:02.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.472+0000 7f7eb3fff640 1 --2- 172.21.15.120:0/3785330157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7eb406da70 0x7f7eb41429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.472+0000 7f7eb3fff640 1 -- 172.21.15.120:0/3785330157 >> v2:172.21.15.155:3300/0 conn(0x7f7eb40b4e30 msgr2=0x7f7eb40b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:02.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.472+0000 7f7eb3fff640 1 --2- 172.21.15.120:0/3785330157 >> v2:172.21.15.155:3300/0 conn(0x7f7eb40b4e30 0x7f7eb40b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.472+0000 7f7eb3fff640 1 -- 172.21.15.120:0/3785330157 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40b9f60 con 0x7f7eb4142ee0 2023-12-19T05:39:02.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.472+0000 7f7eb89ed640 1 --2- 172.21.15.120:0/3785330157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7eb406da70 0x7f7eb41429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:02.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.472+0000 7f7eb91ee640 1 --2- 172.21.15.120:0/3785330157 >> v2:172.21.15.155:3300/0 conn(0x7f7eb40b4e30 0x7f7eb40b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:02.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.472+0000 7f7eb3fff640 1 --2- 172.21.15.120:0/3785330157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7eb4142ee0 0x7f7eb40b3090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7eb414d030 tx=0x7f7ea802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70567a24398175e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.472+0000 7f7eb37fe640 1 -- 172.21.15.120:0/3785330157 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80317e0 con 0x7f7eb4142ee0 2023-12-19T05:39:02.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.473+0000 7f7eb37fe640 1 -- 172.21.15.120:0/3785330157 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea8031940 con 0x7f7eb4142ee0 2023-12-19T05:39:02.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.473+0000 7f7eb37fe640 1 -- 172.21.15.120:0/3785330157 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8031cd0 con 0x7f7eb4142ee0 2023-12-19T05:39:02.477 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.473+0000 7f7ebac51640 1 -- 172.21.15.120:0/3785330157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7eb4142ee0 msgr2=0x7f7eb40b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.473+0000 7f7ebac51640 1 --2- 172.21.15.120:0/3785330157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7eb4142ee0 0x7f7eb40b3090 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7eb414d030 tx=0x7f7ea802b880 comp rx=0 tx=0).stop 2023-12-19T05:39:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.473+0000 7f7ebac51640 1 -- 172.21.15.120:0/3785330157 shutdown_connections 2023-12-19T05:39:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.473+0000 7f7ebac51640 1 --2- 172.21.15.120:0/3785330157 >> v2:172.21.15.155:3300/0 conn(0x7f7eb40b4e30 0x7f7eb40b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.473+0000 7f7ebac51640 1 --2- 172.21.15.120:0/3785330157 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7eb4142ee0 0x7f7eb40b3090 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.473+0000 7f7ebac51640 1 --2- 172.21.15.120:0/3785330157 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7eb406da70 0x7f7eb41429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.473+0000 7f7ebac51640 1 -- 172.21.15.120:0/3785330157 >> 172.21.15.120:0/3785330157 conn(0x7f7eb40bac10 msgr2=0x7f7eb40bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.473+0000 7f7ebac51640 1 -- 172.21.15.120:0/3785330157 shutdown_connections 2023-12-19T05:39:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.473+0000 7f7ebac51640 1 -- 172.21.15.120:0/3785330157 wait complete. 2023-12-19T05:39:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.474+0000 7f7ebac51640 1 Processor -- start 2023-12-19T05:39:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.474+0000 7f7ebac51640 1 -- start start 2023-12-19T05:39:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7ebac51640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7eb406da70 0x7f7eb41412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7ebac51640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb40b4e30 0x7f7eb41e1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7ebac51640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7eb4142ee0 0x7f7eb41333f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7ebac51640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb41417f0 con 0x7f7eb406da70 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7ebac51640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4138dc0 con 0x7f7eb40b4e30 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7ebac51640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb41e1030 con 0x7f7eb4142ee0 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7eb89ed640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7eb406da70 0x7f7eb41412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7eb89ed640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7eb406da70 0x7f7eb41412b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45064/0 (socket says 172.21.15.120:45064) 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7eb89ed640 1 -- 172.21.15.120:0/3924090106 learned_addr learned my addr 172.21.15.120:0/3924090106 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7eb3fff640 1 --2- 172.21.15.120:0/3924090106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb40b4e30 0x7f7eb41e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7eb91ee640 1 --2- 172.21.15.120:0/3924090106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7eb4142ee0 0x7f7eb41333f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7eb89ed640 1 -- 172.21.15.120:0/3924090106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7eb4142ee0 msgr2=0x7f7eb41333f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7eb89ed640 1 --2- 172.21.15.120:0/3924090106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7eb4142ee0 0x7f7eb41333f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7eb89ed640 1 -- 172.21.15.120:0/3924090106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb40b4e30 msgr2=0x7f7eb41e1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7eb89ed640 1 --2- 172.21.15.120:0/3924090106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb40b4e30 0x7f7eb41e1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7eb89ed640 1 -- 172.21.15.120:0/3924090106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea80094d0 con 0x7f7eb406da70 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.475+0000 7f7eb89ed640 1 --2- 172.21.15.120:0/3924090106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7eb406da70 0x7f7eb41412b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400e810 tx=0x7f7ea400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.476+0000 7f7eb17fa640 1 -- 172.21.15.120:0/3924090106 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4004030 con 0x7f7eb406da70 2023-12-19T05:39:02.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.476+0000 7f7eb17fa640 1 -- 172.21.15.120:0/3924090106 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea4004190 con 0x7f7eb406da70 2023-12-19T05:39:02.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.476+0000 7f7ebac51640 1 -- 172.21.15.120:0/3924090106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb40bd6d0 con 0x7f7eb406da70 2023-12-19T05:39:02.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.476+0000 7f7eb17fa640 1 -- 172.21.15.120:0/3924090106 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4004520 con 0x7f7eb406da70 2023-12-19T05:39:02.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.476+0000 7f7ebac51640 1 -- 172.21.15.120:0/3924090106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb4138fb0 con 0x7f7eb406da70 2023-12-19T05:39:02.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.477+0000 7f7ebac51640 1 -- 172.21.15.120:0/3924090106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb4066dd0 con 0x7f7eb406da70 2023-12-19T05:39:02.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.477+0000 7f7eb17fa640 1 -- 172.21.15.120:0/3924090106 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7ea400c6d0 con 0x7f7eb406da70 2023-12-19T05:39:02.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.477+0000 7f7eb17fa640 1 --2- 172.21.15.120:0/3924090106 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f7ea006a430 0x7f7ea006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.478+0000 7f7eb17fa640 1 -- 172.21.15.120:0/3924090106 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ea4088420 con 0x7f7eb406da70 2023-12-19T05:39:02.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.478+0000 7f7eb3fff640 1 --2- 172.21.15.120:0/3924090106 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f7ea006a430 0x7f7ea006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.478+0000 7f7eb3fff640 1 --2- 172.21.15.120:0/3924090106 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f7ea006a430 0x7f7ea006c8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8036000 tx=0x7f7ea803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.482+0000 7f7eb17fa640 1 -- 172.21.15.120:0/3924090106 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7ea4053aa0 con 0x7f7eb406da70 2023-12-19T05:39:02.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.647+0000 7f7ebac51640 1 -- 172.21.15.120:0/3924090106 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7eb404e080 con 0x7f7eb406da70 2023-12-19T05:39:02.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.648+0000 7f7eb17fa640 1 -- 172.21.15.120:0/3924090106 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f7ea40570c0 con 0x7f7eb406da70 2023-12-19T05:39:02.649 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:02.649 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:02.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.650+0000 7f7ebac51640 1 -- 172.21.15.120:0/3924090106 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f7ea006a430 msgr2=0x7f7ea006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.650+0000 7f7ebac51640 1 --2- 172.21.15.120:0/3924090106 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f7ea006a430 0x7f7ea006c8f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8036000 tx=0x7f7ea803d040 comp rx=0 tx=0).stop 2023-12-19T05:39:02.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.650+0000 7f7ebac51640 1 -- 172.21.15.120:0/3924090106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7eb406da70 msgr2=0x7f7eb41412b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.650+0000 7f7ebac51640 1 --2- 172.21.15.120:0/3924090106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7eb406da70 0x7f7eb41412b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400e810 tx=0x7f7ea400ecd0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.650+0000 7f7ebac51640 1 -- 172.21.15.120:0/3924090106 shutdown_connections 2023-12-19T05:39:02.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.650+0000 7f7ebac51640 1 --2- 172.21.15.120:0/3924090106 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f7ea006a430 0x7f7ea006c8f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.652 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.650+0000 7f7ebac51640 1 --2- 172.21.15.120:0/3924090106 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7eb4142ee0 0x7f7eb41333f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.652 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.650+0000 7f7ebac51640 1 --2- 172.21.15.120:0/3924090106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7eb40b4e30 0x7f7eb41e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.652 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.650+0000 7f7ebac51640 1 --2- 172.21.15.120:0/3924090106 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7eb406da70 0x7f7eb41412b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.652 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.650+0000 7f7ebac51640 1 -- 172.21.15.120:0/3924090106 >> 172.21.15.120:0/3924090106 conn(0x7f7eb40bac10 msgr2=0x7f7eb40b8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:02.652 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.650+0000 7f7ebac51640 1 -- 172.21.15.120:0/3924090106 shutdown_connections 2023-12-19T05:39:02.652 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.650+0000 7f7ebac51640 1 -- 172.21.15.120:0/3924090106 wait complete. 2023-12-19T05:39:02.662 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-19T05:39:02.662 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:02.761 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.760+0000 7f9ca68d5640 1 Processor -- start 2023-12-19T05:39:02.761 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.760+0000 7f9ca68d5640 1 -- start start 2023-12-19T05:39:02.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.761+0000 7f9ca68d5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9ca00b79b0 0x7f9ca00b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.761+0000 7f9ca68d5640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca00b96b0 con 0x7f9ca014b230 2023-12-19T05:39:02.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.761+0000 7f9ca68d5640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca00b90f0 con 0x7f9ca00b8860 2023-12-19T05:39:02.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.761+0000 7f9ca68d5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca014ae10 con 0x7f9ca00b79b0 2023-12-19T05:39:02.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.761+0000 7f9ca4e72640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9ca014b230 0x7f9ca01553c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49560/0 (socket says 172.21.15.120:49560) 2023-12-19T05:39:02.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.761+0000 7f9ca4e72640 1 -- 172.21.15.120:0/539496068 learned_addr learned my addr 172.21.15.120:0/539496068 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:02.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.761+0000 7f9c9ffff640 1 --2- 172.21.15.120:0/539496068 >> v2:172.21.15.155:3300/0 conn(0x7f9ca00b79b0 0x7f9ca00b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.762+0000 7f9c9ffff640 1 -- 172.21.15.120:0/539496068 >> v1:172.21.15.155:6789/0 conn(0x7f9ca00b8860 legacy=0x7f9ca0144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.762+0000 7f9c9ffff640 1 -- 172.21.15.120:0/539496068 >> v1:172.21.15.120:6789/0 conn(0x7f9ca014b230 legacy=0x7f9ca01553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.762+0000 7f9c9ffff640 1 -- 172.21.15.120:0/539496068 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca00b93d0 con 0x7f9ca00b79b0 2023-12-19T05:39:02.764 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.762+0000 7f9c9ffff640 1 --2- 172.21.15.120:0/539496068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca00b79b0 0x7f9ca00b7d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c900097a0 tx=0x7f9c9002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baebdc42b9e6c14b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.769+0000 7f9c9effd640 1 -- 172.21.15.120:0/539496068 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90030610 con 0x7f9ca00b79b0 2023-12-19T05:39:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.770+0000 7f9c9effd640 1 -- 172.21.15.120:0/539496068 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c90030770 con 0x7f9ca00b79b0 2023-12-19T05:39:02.771 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.770+0000 7f9c9effd640 1 -- 172.21.15.120:0/539496068 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90030b00 con 0x7f9ca00b79b0 2023-12-19T05:39:02.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.770+0000 7f9ca68d5640 1 -- 172.21.15.120:0/539496068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca00b79b0 msgr2=0x7f9ca00b7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.770+0000 7f9ca68d5640 1 --2- 172.21.15.120:0/539496068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca00b79b0 0x7f9ca00b7d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c900097a0 tx=0x7f9c9002b960 comp rx=0 tx=0).stop 2023-12-19T05:39:02.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.770+0000 7f9ca68d5640 1 -- 172.21.15.120:0/539496068 shutdown_connections 2023-12-19T05:39:02.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.770+0000 7f9ca68d5640 1 --2- 172.21.15.120:0/539496068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca00b79b0 0x7f9ca00b7d90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.770+0000 7f9ca68d5640 1 -- 172.21.15.120:0/539496068 >> 172.21.15.120:0/539496068 conn(0x7f9ca00c0340 msgr2=0x7f9ca00c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:02.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.770+0000 7f9ca68d5640 1 -- 172.21.15.120:0/539496068 shutdown_connections 2023-12-19T05:39:02.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.770+0000 7f9ca68d5640 1 -- 172.21.15.120:0/539496068 wait complete. 2023-12-19T05:39:02.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.771+0000 7f9ca68d5640 1 Processor -- start 2023-12-19T05:39:02.773 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.771+0000 7f9ca68d5640 1 -- start start 2023-12-19T05:39:02.774 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9ca68d5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca00b79b0 0x7f9ca01d6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9ca68d5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ca00b8860 0x7f9ca0147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9ca68d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ca014b230 0x7f9ca0147680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9ca68d5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca01e3d80 con 0x7f9ca00b8860 2023-12-19T05:39:02.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9ca68d5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca01d6a50 con 0x7f9ca00b79b0 2023-12-19T05:39:02.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9ca68d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca01e3450 con 0x7f9ca014b230 2023-12-19T05:39:02.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9c9f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ca00b8860 0x7f9ca0147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9c9f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ca00b8860 0x7f9ca0147140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45074/0 (socket says 172.21.15.120:45074) 2023-12-19T05:39:02.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9c9f7fe640 1 -- 172.21.15.120:0/37103352 learned_addr learned my addr 172.21.15.120:0/37103352 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:02.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9ca4e72640 1 --2- 172.21.15.120:0/37103352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ca014b230 0x7f9ca0147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9c9ffff640 1 --2- 172.21.15.120:0/37103352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca00b79b0 0x7f9ca01d6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9c9f7fe640 1 -- 172.21.15.120:0/37103352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ca014b230 msgr2=0x7f9ca0147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9c9f7fe640 1 --2- 172.21.15.120:0/37103352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ca014b230 0x7f9ca0147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9c9f7fe640 1 -- 172.21.15.120:0/37103352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca00b79b0 msgr2=0x7f9ca01d6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9c9f7fe640 1 --2- 172.21.15.120:0/37103352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca00b79b0 0x7f9ca01d6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.772+0000 7f9c9f7fe640 1 -- 172.21.15.120:0/37103352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c90009400 con 0x7f9ca00b8860 2023-12-19T05:39:02.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.773+0000 7f9c9f7fe640 1 --2- 172.21.15.120:0/37103352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ca00b8860 0x7f9ca0147140 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400c450 tx=0x7f9c9400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.773+0000 7f9c9cff9640 1 -- 172.21.15.120:0/37103352 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c940052d0 con 0x7f9ca00b8860 2023-12-19T05:39:02.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.773+0000 7f9c9cff9640 1 -- 172.21.15.120:0/37103352 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c94005430 con 0x7f9ca00b8860 2023-12-19T05:39:02.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.773+0000 7f9ca68d5640 1 -- 172.21.15.120:0/37103352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca01e3730 con 0x7f9ca00b8860 2023-12-19T05:39:02.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.773+0000 7f9c9cff9640 1 -- 172.21.15.120:0/37103352 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94012870 con 0x7f9ca00b8860 2023-12-19T05:39:02.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.773+0000 7f9ca68d5640 1 -- 172.21.15.120:0/37103352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca00b8410 con 0x7f9ca00b8860 2023-12-19T05:39:02.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.774+0000 7f9ca68d5640 1 -- 172.21.15.120:0/37103352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca00b85d0 con 0x7f9ca00b8860 2023-12-19T05:39:02.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.774+0000 7f9c9cff9640 1 -- 172.21.15.120:0/37103352 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c940129d0 con 0x7f9ca00b8860 2023-12-19T05:39:02.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.774+0000 7f9c9cff9640 1 --2- 172.21.15.120:0/37103352 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9c8c06a460 0x7f9c8c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:02.779 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.775+0000 7f9c9ffff640 1 --2- 172.21.15.120:0/37103352 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9c8c06a460 0x7f9c8c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:02.779 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.775+0000 7f9c9cff9640 1 -- 172.21.15.120:0/37103352 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c94088320 con 0x7f9ca00b8860 2023-12-19T05:39:02.779 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.775+0000 7f9c9ffff640 1 --2- 172.21.15.120:0/37103352 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9c8c06a460 0x7f9c8c06c920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9c90036000 tx=0x7f9c9003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:02.780 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.779+0000 7f9c9cff9640 1 -- 172.21.15.120:0/37103352 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9c940539a0 con 0x7f9ca00b8860 2023-12-19T05:39:02.946 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.945+0000 7f9ca68d5640 1 -- 172.21.15.120:0/37103352 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ca0146f00 con 0x7f9ca00b8860 2023-12-19T05:39:02.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.946+0000 7f9c9cff9640 1 -- 172.21.15.120:0/37103352 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f9c94056fc0 con 0x7f9ca00b8860 2023-12-19T05:39:02.947 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:02.947 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:02.949 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.947+0000 7f9ca68d5640 1 -- 172.21.15.120:0/37103352 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9c8c06a460 msgr2=0x7f9c8c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.949 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.947+0000 7f9ca68d5640 1 --2- 172.21.15.120:0/37103352 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9c8c06a460 0x7f9c8c06c920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9c90036000 tx=0x7f9c9003b040 comp rx=0 tx=0).stop 2023-12-19T05:39:02.949 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.948+0000 7f9ca68d5640 1 -- 172.21.15.120:0/37103352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ca00b8860 msgr2=0x7f9ca0147140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:02.949 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.948+0000 7f9ca68d5640 1 --2- 172.21.15.120:0/37103352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ca00b8860 0x7f9ca0147140 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400c450 tx=0x7f9c9400c910 comp rx=0 tx=0).stop 2023-12-19T05:39:02.949 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.948+0000 7f9ca68d5640 1 -- 172.21.15.120:0/37103352 shutdown_connections 2023-12-19T05:39:02.949 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.948+0000 7f9ca68d5640 1 --2- 172.21.15.120:0/37103352 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9c8c06a460 0x7f9c8c06c920 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.949 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.948+0000 7f9ca68d5640 1 --2- 172.21.15.120:0/37103352 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ca014b230 0x7f9ca0147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.950 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.948+0000 7f9ca68d5640 1 --2- 172.21.15.120:0/37103352 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ca00b8860 0x7f9ca0147140 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.950 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.948+0000 7f9ca68d5640 1 --2- 172.21.15.120:0/37103352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ca00b79b0 0x7f9ca01d6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:02.950 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.948+0000 7f9ca68d5640 1 -- 172.21.15.120:0/37103352 >> 172.21.15.120:0/37103352 conn(0x7f9ca00c0340 msgr2=0x7f9ca00babc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:02.950 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.948+0000 7f9ca68d5640 1 -- 172.21.15.120:0/37103352 shutdown_connections 2023-12-19T05:39:02.950 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:02.948+0000 7f9ca68d5640 1 -- 172.21.15.120:0/37103352 wait complete. 2023-12-19T05:39:02.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-19T05:39:02.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-19T05:39:02.961 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-19T05:39:02.961 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-19T05:39:02.962 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-19T05:39:02.962 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-19T05:39:02.962 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-19T05:39:02.963 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-19T05:39:03.128 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.127+0000 7fa07676e640 1 Processor -- start 2023-12-19T05:39:03.130 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.129+0000 7f30c8fcf640 1 Processor -- start 2023-12-19T05:39:03.130 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.127+0000 7fa07676e640 1 -- start start 2023-12-19T05:39:03.130 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.128+0000 7fa07676e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa068007590 0x7fa06803a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.130 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.128+0000 7fa07676e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0680d67b0 0x7fa0680cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.130 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.128+0000 7fa07676e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06803bd80 con 0x7fa06803c9b0 2023-12-19T05:39:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.128+0000 7fa07676e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0680d5840 con 0x7fa068007590 2023-12-19T05:39:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.128+0000 7fa07676e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06803ac50 con 0x7fa0680d67b0 2023-12-19T05:39:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.129+0000 7fa075f6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0680d67b0 0x7fa0680cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.129+0000 7fa075f6d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0680d67b0 0x7fa0680cf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:44000/0 (socket says 172.21.15.120:44000) 2023-12-19T05:39:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.129+0000 7fa075f6d640 1 -- 172.21.15.120:0/3750409830 learned_addr learned my addr 172.21.15.120:0/3750409830 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.129+0000 7f30c8fcf640 1 -- start start 2023-12-19T05:39:03.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.129+0000 7fa07576c640 1 --2- 172.21.15.120:0/3750409830 >> v2:172.21.15.155:3300/0 conn(0x7fa068007590 0x7fa06803a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.130+0000 7f30c8fcf640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f30c40b21f0 0x7f30c40b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.130+0000 7f30c8fcf640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f30c406c3e0 0x7f30c4159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.130+0000 7f30c8fcf640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c40b1730 con 0x7f30c41490e0 2023-12-19T05:39:03.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.129+0000 7fa075f6d640 1 -- 172.21.15.120:0/3750409830 >> v2:172.21.15.155:3300/0 conn(0x7fa068007590 msgr2=0x7fa06803a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.129+0000 7fa075f6d640 1 --2- 172.21.15.120:0/3750409830 >> v2:172.21.15.155:3300/0 conn(0x7fa068007590 0x7fa06803a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.129+0000 7fa075f6d640 1 -- 172.21.15.120:0/3750409830 >> v1:172.21.15.120:6789/0 conn(0x7fa06803c9b0 legacy=0x7fa0680d5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.129+0000 7fa075f6d640 1 -- 172.21.15.120:0/3750409830 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06803af30 con 0x7fa0680d67b0 2023-12-19T05:39:03.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.129+0000 7fa07576c640 1 --2- 172.21.15.120:0/3750409830 >> v2:172.21.15.155:3300/0 conn(0x7fa068007590 0x7fa06803a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:03.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.130+0000 7f30c8fcf640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c40b8540 con 0x7f30c406c3e0 2023-12-19T05:39:03.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.130+0000 7f30c8fcf640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c40b19f0 con 0x7f30c40b21f0 2023-12-19T05:39:03.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.130+0000 7f30c37fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f30c41490e0 0x7f30c414eca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49574/0 (socket says 172.21.15.120:49574) 2023-12-19T05:39:03.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.130+0000 7f30c37fe640 1 -- 172.21.15.120:0/3515116727 learned_addr learned my addr 172.21.15.120:0/3515116727 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.130+0000 7f95d9068640 1 Processor -- start 2023-12-19T05:39:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.130+0000 7face1468640 1 Processor -- start 2023-12-19T05:39:03.134 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.130+0000 7f30c3fff640 1 --2- 172.21.15.120:0/3515116727 >> v2:172.21.15.120:3300/0 conn(0x7f30c406c3e0 0x7f30c4159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.135 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.130+0000 7face1468640 1 -- start start 2023-12-19T05:39:03.135 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.130+0000 7f95d9068640 1 -- start start 2023-12-19T05:39:03.135 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.131+0000 7f30c27fc640 1 -- 172.21.15.120:0/3515116727 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129062287 0 0) 0x7f30c40b1730 con 0x7f30c41490e0 2023-12-19T05:39:03.136 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.130+0000 7f8072ad4640 1 Processor -- start 2023-12-19T05:39:03.136 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.131+0000 7f8072ad4640 1 -- start start 2023-12-19T05:39:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.131+0000 7f30c27fc640 1 -- 172.21.15.120:0/3515116727 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30ac003520 con 0x7f30c41490e0 2023-12-19T05:39:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.131+0000 7f30c27fc640 1 -- 172.21.15.120:0/3515116727 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 978212524 0 0) 0x7f30ac003520 con 0x7f30c41490e0 2023-12-19T05:39:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.131+0000 7f30c3fff640 1 -- 172.21.15.120:0/3515116727 >> v2:172.21.15.155:3300/0 conn(0x7f30c40b21f0 msgr2=0x7f30c40b7bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T05:39:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.131+0000 7f30c3fff640 1 --2- 172.21.15.120:0/3515116727 >> v2:172.21.15.155:3300/0 conn(0x7f30c40b21f0 0x7f30c40b7bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.131+0000 7f30c3fff640 1 -- 172.21.15.120:0/3515116727 >> v1:172.21.15.120:6789/0 conn(0x7f30c41490e0 legacy=0x7f30c414eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.131+0000 7f30c3fff640 1 -- 172.21.15.120:0/3515116727 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c40b1cd0 con 0x7f30c406c3e0 2023-12-19T05:39:03.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.131+0000 7face1468640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7facdc0b51e0 0x7facdc0b5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f95d9068640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f95cc0cda00 0x7f95cc0d8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f95d3fff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f95cc007260 0x7f95cc0c7040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:39824/0 (socket says 172.21.15.120:39824) 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f95d9068640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc03db80 con 0x7f95cc03b630 2023-12-19T05:39:03.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f95d9068640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc03d250 con 0x7f95cc007260 2023-12-19T05:39:03.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f8072ad4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f806c0b9400 0x7f806c152c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f8072ad4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806c0b8860 con 0x7f806c152820 2023-12-19T05:39:03.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f95d9068640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95cc03c210 con 0x7f95cc0cda00 2023-12-19T05:39:03.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f8072ad4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806c0bcb50 con 0x7f806c0bc6e0 2023-12-19T05:39:03.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f8072ad4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806c0b9a70 con 0x7f806c0b9400 2023-12-19T05:39:03.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f8070870640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f806c152820 0x7f806c0b66a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49592/0 (socket says 172.21.15.120:49592) 2023-12-19T05:39:03.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f8070870640 1 -- 172.21.15.120:0/1114447367 learned_addr learned my addr 172.21.15.120:0/1114447367 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:03.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f95d3fff640 1 -- 172.21.15.120:0/360205201 learned_addr learned my addr 172.21.15.120:0/360205201 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:03.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7fa075f6d640 1 --2- 172.21.15.120:0/3750409830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0680d67b0 0x7fa0680cf260 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa070068ba0 tx=0x7fa0700a58d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad689c6a284a33b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7facdbfff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7facdc06b650 0x7facdc144ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:39822/0 (socket says 172.21.15.120:39822) 2023-12-19T05:39:03.141 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7face1468640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7facdc14ac10 0x7facdc14b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.141 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f8284a37640 1 Processor -- start 2023-12-19T05:39:03.141 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7facdbfff640 1 -- 172.21.15.120:0/1862923978 learned_addr learned my addr 172.21.15.120:0/1862923978 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:03.141 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f95d8867640 1 --2- 172.21.15.120:0/360205201 >> v2:172.21.15.120:3300/0 conn(0x7f95cc0cda00 0x7f95cc0d8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f95d2ffd640 1 -- 172.21.15.120:0/360205201 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354402122 0 0) 0x7f95cc03d250 con 0x7f95cc007260 2023-12-19T05:39:03.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f95d2ffd640 1 -- 172.21.15.120:0/360205201 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95c4003520 con 0x7f95cc007260 2023-12-19T05:39:03.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7fa067fff640 1 -- 172.21.15.120:0/3750409830 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07006cea0 con 0x7fa0680d67b0 2023-12-19T05:39:03.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7fa067fff640 1 -- 172.21.15.120:0/3750409830 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0700ab930 con 0x7fa0680d67b0 2023-12-19T05:39:03.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7fa067fff640 1 -- 172.21.15.120:0/3750409830 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0700abd60 con 0x7fa0680d67b0 2023-12-19T05:39:03.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7ff1741f0640 1 Processor -- start 2023-12-19T05:39:03.143 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f8071071640 1 --2- 172.21.15.120:0/1114447367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f806c0b9400 0x7f806c152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.143 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7face1468640 1 -- 172.21.15.120:0/1862923978 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facdc0b6820 con 0x7facdc06b650 2023-12-19T05:39:03.143 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7face0c67640 1 --2- 172.21.15.120:0/1862923978 >> v2:172.21.15.120:3300/0 conn(0x7facdc14ac10 0x7facdc14b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.144 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f30c3fff640 1 --2- 172.21.15.120:0/3515116727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30c406c3e0 0x7f30c4159540 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f30c4066940 tx=0x7f30bc02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0578faba7f3311 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.144 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f30c27fc640 1 -- 172.21.15.120:0/3515116727 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4001670 con 0x7f30c406c3e0 2023-12-19T05:39:03.144 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f30c27fc640 1 -- 172.21.15.120:0/3515116727 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc02c8e0 con 0x7f30c406c3e0 2023-12-19T05:39:03.144 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f30c27fc640 1 -- 172.21.15.120:0/3515116727 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4001670 con 0x7f30c406c3e0 2023-12-19T05:39:03.144 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f95d2ffd640 1 -- 172.21.15.120:0/360205201 <== mon.1 v1:172.21.15.155:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3522593914 0 0) 0x7f95c4003520 con 0x7f95cc007260 2023-12-19T05:39:03.144 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f95d2ffd640 1 -- 172.21.15.120:0/360205201 >> v2:172.21.15.120:3300/0 conn(0x7f95cc0cda00 msgr2=0x7f95cc0d8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.144 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f95d2ffd640 1 --2- 172.21.15.120:0/360205201 >> v2:172.21.15.120:3300/0 conn(0x7f95cc0cda00 0x7f95cc0d8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.144 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f95d2ffd640 1 -- 172.21.15.120:0/360205201 >> v1:172.21.15.120:6789/0 conn(0x7f95cc03b630 legacy=0x7f95cc0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.144 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f95d2ffd640 1 -- 172.21.15.120:0/360205201 --> v1:172.21.15.155:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc03d530 con 0x7f95cc007260 2023-12-19T05:39:03.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f95d2ffd640 1 -- 172.21.15.120:0/360205201 <== mon.1 v1:172.21.15.155:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f95c8001670 con 0x7f95cc007260 2023-12-19T05:39:03.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f95d2ffd640 1 -- 172.21.15.120:0/360205201 >> v1:172.21.15.155:6789/0 conn(0x7f95cc007260 legacy=0x7f95cc0c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f95d2ffd640 1 --2- 172.21.15.120:0/360205201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c4003970 0x7f95c4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f95d2ffd640 1 --2- 172.21.15.120:0/360205201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95c40047c0 0x7f95c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f95d3fff640 1 --2- 172.21.15.120:0/360205201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c4003970 0x7f95c4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f95d2ffd640 1 --2- 172.21.15.120:0/360205201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c40051d0 0x7f95c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f95d2ffd640 1 -- 172.21.15.120:0/360205201 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c400c0d0 con 0x7f95c40047c0 2023-12-19T05:39:03.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f95d2ffd640 1 -- 172.21.15.120:0/360205201 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c400c240 con 0x7f95c4003970 2023-12-19T05:39:03.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f95d2ffd640 1 -- 172.21.15.120:0/360205201 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c400c400 con 0x7f95c40051d0 2023-12-19T05:39:03.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7fa07676e640 1 -- 172.21.15.120:0/3750409830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0680d67b0 msgr2=0x7fa0680cf260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7fa07676e640 1 --2- 172.21.15.120:0/3750409830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0680d67b0 0x7fa0680cf260 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa070068ba0 tx=0x7fa0700a58d0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7fa07676e640 1 -- 172.21.15.120:0/3750409830 shutdown_connections 2023-12-19T05:39:03.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7fa07676e640 1 --2- 172.21.15.120:0/3750409830 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa0680d67b0 0x7fa0680cf260 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7fa07676e640 1 --2- 172.21.15.120:0/3750409830 >> v2:172.21.15.155:3300/0 conn(0x7fa068007590 0x7fa06803a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7fa07676e640 1 -- 172.21.15.120:0/3750409830 >> 172.21.15.120:0/3750409830 conn(0x7fa06803f2a0 msgr2=0x7fa06803f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7fa07676e640 1 -- 172.21.15.120:0/3750409830 shutdown_connections 2023-12-19T05:39:03.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7ff1741f0640 1 -- start start 2023-12-19T05:39:03.147 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7f8284a37640 1 -- start start 2023-12-19T05:39:03.147 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f8284a37640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8280149eb0 0x7f828014a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.147 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f8284a37640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828006caf0 con 0x7f82800b9360 2023-12-19T05:39:03.147 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f8284a37640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828014ab40 con 0x7f8280140e50 2023-12-19T05:39:03.147 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f8284a37640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828014ae20 con 0x7f8280149eb0 2023-12-19T05:39:03.147 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f827f59e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8280149eb0 0x7f828014a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.147 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f8071071640 1 -- 172.21.15.120:0/1114447367 >> v1:172.21.15.155:6789/0 conn(0x7f806c0bc6e0 legacy=0x7f806c0b8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.148 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f827ed9d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f82800b9360 0x7f82800b7070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49600/0 (socket says 172.21.15.120:49600) 2023-12-19T05:39:03.148 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7f827ed9d640 1 -- 172.21.15.120:0/2999193070 learned_addr learned my addr 172.21.15.120:0/2999193070 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:03.148 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f95d37fe640 1 --2- 172.21.15.120:0/360205201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95c40047c0 0x7f95c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.148 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f827f59e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8280149eb0 0x7f828014a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45116/0 (socket says 172.21.15.120:45116) 2023-12-19T05:39:03.149 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7facdb7fe640 1 --2- 172.21.15.120:0/1862923978 >> v2:172.21.15.155:3300/0 conn(0x7facdc0b51e0 0x7facdc0b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.149 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7face1468640 1 -- 172.21.15.120:0/1862923978 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facdc0b5640 con 0x7facdc14ac10 2023-12-19T05:39:03.149 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.132+0000 7face1468640 1 -- 172.21.15.120:0/1862923978 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facdc14b5e0 con 0x7facdc0b51e0 2023-12-19T05:39:03.149 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7fa07676e640 1 -- 172.21.15.120:0/3750409830 wait complete. 2023-12-19T05:39:03.150 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f8071071640 1 -- 172.21.15.120:0/1114447367 >> v1:172.21.15.120:6789/0 conn(0x7f806c152820 legacy=0x7f806c0b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.150 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7f30c8fcf640 1 -- 172.21.15.120:0/3515116727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30c406c3e0 msgr2=0x7f30c4159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.150 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7face0c67640 1 -- 172.21.15.120:0/1862923978 >> v2:172.21.15.155:3300/0 conn(0x7facdc0b51e0 msgr2=0x7facdc0b5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.150 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7face0c67640 1 --2- 172.21.15.120:0/1862923978 >> v2:172.21.15.155:3300/0 conn(0x7facdc0b51e0 0x7facdc0b5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.150 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7face0c67640 1 -- 172.21.15.120:0/1862923978 >> v1:172.21.15.155:6789/0 conn(0x7facdc06b650 legacy=0x7facdc144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.150 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7face0c67640 1 -- 172.21.15.120:0/1862923978 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc1451f0 con 0x7facdc14ac10 2023-12-19T05:39:03.151 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7f30c8fcf640 1 --2- 172.21.15.120:0/3515116727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30c406c3e0 0x7f30c4159540 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f30c4066940 tx=0x7f30bc02bdb0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.151 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7fad6b1e9640 1 Processor -- start 2023-12-19T05:39:03.152 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7f827f59e640 1 -- 172.21.15.120:0/2999193070 >> v1:172.21.15.155:6789/0 conn(0x7f8280140e50 legacy=0x7f828006c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.152 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7f827f59e640 1 -- 172.21.15.120:0/2999193070 >> v1:172.21.15.120:6789/0 conn(0x7f82800b9360 legacy=0x7f82800b7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.152 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7f827f59e640 1 -- 172.21.15.120:0/2999193070 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82800b6870 con 0x7f8280149eb0 2023-12-19T05:39:03.152 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f8071071640 1 -- 172.21.15.120:0/1114447367 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c1532f0 con 0x7f806c0b9400 2023-12-19T05:39:03.152 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7f95d3fff640 1 -- 172.21.15.120:0/360205201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c40051d0 msgr2=0x7f95c400b980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T05:39:03.152 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7f95d3fff640 1 --2- 172.21.15.120:0/360205201 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c40051d0 0x7f95c400b980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.153 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7f8071071640 1 --2- 172.21.15.120:0/1114447367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f806c0b9400 0x7f806c152c00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8064009dc0 tx=0x7f806402bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa77ded03daeecd3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.153 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7f95d3fff640 1 -- 172.21.15.120:0/360205201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95c40047c0 msgr2=0x7f95c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.153 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7f95d3fff640 1 --2- 172.21.15.120:0/360205201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95c40047c0 0x7f95c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.154 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7f95d3fff640 1 -- 172.21.15.120:0/360205201 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c4003520 con 0x7f95c4003970 2023-12-19T05:39:03.154 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7f95d8867640 1 -- 172.21.15.120:0/360205201 reap_dead start 2023-12-19T05:39:03.154 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.133+0000 7f806b7fe640 1 -- 172.21.15.120:0/1114447367 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304380094 0 0) 0x7f806c0b8860 con 0x7f806c152820 2023-12-19T05:39:03.154 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7f806b7fe640 1 -- 172.21.15.120:0/1114447367 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806402ccc0 con 0x7f806c0b9400 2023-12-19T05:39:03.154 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7ff1741f0640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff1640418d0 0x7ff1640425a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.155 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7face0c67640 1 --2- 172.21.15.120:0/1862923978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facdc14ac10 0x7facdc14b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7facdc0bdc90 tx=0x7facd4034780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254e8c16fa64ed37 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.155 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7f806b7fe640 1 -- 172.21.15.120:0/1114447367 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806402ce20 con 0x7f806c0b9400 2023-12-19T05:39:03.155 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7fa07676e640 1 Processor -- start 2023-12-19T05:39:03.156 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.134+0000 7fad6b1e9640 1 -- start start 2023-12-19T05:39:03.156 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7f30c8fcf640 1 -- 172.21.15.120:0/3515116727 shutdown_connections 2023-12-19T05:39:03.156 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7f30c8fcf640 1 --2- 172.21.15.120:0/3515116727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30c406c3e0 0x7f30c4159540 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.156 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7f30c8fcf640 1 --2- 172.21.15.120:0/3515116727 >> v2:172.21.15.155:3300/0 conn(0x7f30c40b21f0 0x7f30c40b7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.156 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7f30c8fcf640 1 -- 172.21.15.120:0/3515116727 >> 172.21.15.120:0/3515116727 conn(0x7f30c40b8840 msgr2=0x7f30c40b8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.156 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7fa07676e640 1 -- start start 2023-12-19T05:39:03.157 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7f30c8fcf640 1 -- 172.21.15.120:0/3515116727 shutdown_connections 2023-12-19T05:39:03.157 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7f30c8fcf640 1 -- 172.21.15.120:0/3515116727 wait complete. 2023-12-19T05:39:03.157 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7ff171f8c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff1640c7b50 0x7ff1640d19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49604/0 (socket says 172.21.15.120:49604) 2023-12-19T05:39:03.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7facdaffd640 1 -- 172.21.15.120:0/1862923978 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4007740 con 0x7facdc14ac10 2023-12-19T05:39:03.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7facdaffd640 1 -- 172.21.15.120:0/1862923978 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd4037050 con 0x7facdc14ac10 2023-12-19T05:39:03.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7facdaffd640 1 -- 172.21.15.120:0/1862923978 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd4007b00 con 0x7facdc14ac10 2023-12-19T05:39:03.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7ff1741f0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff16403b9b0 0x7ff164042ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.159 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7ff1741f0640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff164043020 con 0x7ff1640c7b50 2023-12-19T05:39:03.159 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7ff1741f0640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff164042090 con 0x7ff1640418d0 2023-12-19T05:39:03.159 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7ff1741f0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1640d0fd0 con 0x7ff16403b9b0 2023-12-19T05:39:03.159 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7f827f59e640 1 --2- 172.21.15.120:0/2999193070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8280149eb0 0x7f828014a2e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8278009d90 tx=0x7f827802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ad5441a637f9c56 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.159 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7ff171f8c640 1 -- 172.21.15.120:0/1391733226 learned_addr learned my addr 172.21.15.120:0/1391733226 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7ff17178b640 1 --2- 172.21.15.120:0/1391733226 >> v2:172.21.15.120:3300/0 conn(0x7ff1640418d0 0x7ff1640425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.135+0000 7ff17278d640 1 --2- 172.21.15.120:0/1391733226 >> v2:172.21.15.155:3300/0 conn(0x7ff16403b9b0 0x7ff164042ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa07676e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa068007590 0x7fa0680d20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa07676e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa06803c9b0 0x7fa06815f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa07676e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680d67b0 0x7fa068037fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7f8072ad4640 1 -- 172.21.15.120:0/1114447367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f806c0b9400 msgr2=0x7f806c152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.161 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7f8072ad4640 1 --2- 172.21.15.120:0/1114447367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f806c0b9400 0x7f806c152c00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8064009dc0 tx=0x7f806402bf10 comp rx=0 tx=0).stop 2023-12-19T05:39:03.161 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa07676e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0680d2620 con 0x7fa06803c9b0 2023-12-19T05:39:03.161 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7ff170f8a640 1 -- 172.21.15.120:0/1391733226 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161915605 0 0) 0x7ff164043020 con 0x7ff1640c7b50 2023-12-19T05:39:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fad6b1e9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fad640b21f0 0x7fad640b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fad6b1e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad6406c3e0 0x7fad64159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fad6b1e9640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad640b1730 con 0x7fad641490e0 2023-12-19T05:39:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fad6b1e9640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad640b8540 con 0x7fad640b21f0 2023-12-19T05:39:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fad6b1e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad640b19f0 con 0x7fad6406c3e0 2023-12-19T05:39:03.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa07676e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa068039700 con 0x7fa0680d67b0 2023-12-19T05:39:03.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7f8072ad4640 1 -- 172.21.15.120:0/1114447367 shutdown_connections 2023-12-19T05:39:03.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7f8072ad4640 1 --2- 172.21.15.120:0/1114447367 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f806c0b9400 0x7f806c152c00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa07676e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06815e890 con 0x7fa068007590 2023-12-19T05:39:03.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7f8072ad4640 1 -- 172.21.15.120:0/1114447367 >> 172.21.15.120:0/1114447367 conn(0x7f806c0c0340 msgr2=0x7f806c0c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7f827e59c640 1 -- 172.21.15.120:0/2999193070 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827802cc60 con 0x7f8280149eb0 2023-12-19T05:39:03.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa075f6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680d67b0 0x7fa068037fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa075f6d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680d67b0 0x7fa068037fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59508/0 (socket says 172.21.15.120:59508) 2023-12-19T05:39:03.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7f827e59c640 1 -- 172.21.15.120:0/2999193070 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827802cdc0 con 0x7f8280149eb0 2023-12-19T05:39:03.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7f8072ad4640 1 -- 172.21.15.120:0/1114447367 shutdown_connections 2023-12-19T05:39:03.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7f827e59c640 1 -- 172.21.15.120:0/2999193070 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278034660 con 0x7f8280149eb0 2023-12-19T05:39:03.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7f8072ad4640 1 -- 172.21.15.120:0/1114447367 wait complete. 2023-12-19T05:39:03.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7f30c8fcf640 1 Processor -- start 2023-12-19T05:39:03.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7f95d3fff640 1 --2- 172.21.15.120:0/360205201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c4003970 0x7f95c4003d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f95c8004fc0 tx=0x7f95c40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2582672692b1cd9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7face1468640 1 -- 172.21.15.120:0/1862923978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facdc14ac10 msgr2=0x7facdc14b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7face1468640 1 --2- 172.21.15.120:0/1862923978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facdc14ac10 0x7facdc14b0a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7facdc0bdc90 tx=0x7facd4034780 comp rx=0 tx=0).stop 2023-12-19T05:39:03.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7face1468640 1 -- 172.21.15.120:0/1862923978 shutdown_connections 2023-12-19T05:39:03.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7face1468640 1 --2- 172.21.15.120:0/1862923978 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facdc14ac10 0x7facdc14b0a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7face1468640 1 --2- 172.21.15.120:0/1862923978 >> v2:172.21.15.155:3300/0 conn(0x7facdc0b51e0 0x7facdc0b5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7face1468640 1 -- 172.21.15.120:0/1862923978 >> 172.21.15.120:0/1862923978 conn(0x7facdc0c0110 msgr2=0x7facdc0c0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa075f6d640 1 -- 172.21.15.120:0/4065843523 learned_addr learned my addr 172.21.15.120:0/4065843523 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa075f6d640 1 -- 172.21.15.120:0/4065843523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa068007590 msgr2=0x7fa0680d20e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T05:39:03.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa075f6d640 1 --2- 172.21.15.120:0/4065843523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa068007590 0x7fa0680d20e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa075f6d640 1 -- 172.21.15.120:0/4065843523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa06803c9b0 msgr2=0x7fa06815f750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T05:39:03.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa074f6b640 1 --2- 172.21.15.120:0/4065843523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa06803c9b0 0x7fa06815f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa075f6d640 1 --2- 172.21.15.120:0/4065843523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa06803c9b0 0x7fa06815f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fa075f6d640 1 -- 172.21.15.120:0/4065843523 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa060009400 con 0x7fa0680d67b0 2023-12-19T05:39:03.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fad6a9e8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad6406c3e0 0x7fad64159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fad6a9e8640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad6406c3e0 0x7fad64159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:44028/0 (socket says 172.21.15.120:44028) 2023-12-19T05:39:03.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fad6a9e8640 1 -- 172.21.15.120:0/639299186 learned_addr learned my addr 172.21.15.120:0/639299186 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7fad699e6640 1 --2- 172.21.15.120:0/639299186 >> v2:172.21.15.120:3300/0 conn(0x7fad640b21f0 0x7fad640b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7fad6a9e8640 1 -- 172.21.15.120:0/639299186 >> v2:172.21.15.120:3300/0 conn(0x7fad640b21f0 msgr2=0x7fad640b7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7fad6a9e8640 1 --2- 172.21.15.120:0/639299186 >> v2:172.21.15.120:3300/0 conn(0x7fad640b21f0 0x7fad640b7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7fad6a9e8640 1 -- 172.21.15.120:0/639299186 >> v1:172.21.15.120:6789/0 conn(0x7fad641490e0 legacy=0x7fad6414eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7fad6a9e8640 1 -- 172.21.15.120:0/639299186 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad640b1cd0 con 0x7fad6406c3e0 2023-12-19T05:39:03.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7fa075f6d640 1 --2- 172.21.15.120:0/4065843523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680d67b0 0x7fa068037fe0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa0700638d0 tx=0x7fa070061ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7f30c8fcf640 1 -- start start 2023-12-19T05:39:03.169 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7fa065ffb640 1 -- 172.21.15.120:0/4065843523 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0700b48f0 con 0x7fa0680d67b0 2023-12-19T05:39:03.169 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7f8284a37640 1 -- 172.21.15.120:0/2999193070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8280149eb0 msgr2=0x7f828014a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.169 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7f8284a37640 1 --2- 172.21.15.120:0/2999193070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8280149eb0 0x7f828014a2e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8278009d90 tx=0x7f827802beb0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.169 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7fa065ffb640 1 -- 172.21.15.120:0/4065843523 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0700b8070 con 0x7fa0680d67b0 2023-12-19T05:39:03.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7ff170f8a640 1 -- 172.21.15.120:0/1391733226 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff158003520 con 0x7ff1640c7b50 2023-12-19T05:39:03.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7f8284a37640 1 -- 172.21.15.120:0/2999193070 shutdown_connections 2023-12-19T05:39:03.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7f8284a37640 1 --2- 172.21.15.120:0/2999193070 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8280149eb0 0x7f828014a2e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7f8284a37640 1 -- 172.21.15.120:0/2999193070 >> 172.21.15.120:0/2999193070 conn(0x7f82800b8840 msgr2=0x7f82800b8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7fa07676e640 1 -- 172.21.15.120:0/4065843523 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0681600d0 con 0x7fa0680d67b0 2023-12-19T05:39:03.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7fa065ffb640 1 -- 172.21.15.120:0/4065843523 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0700b4c90 con 0x7fa0680d67b0 2023-12-19T05:39:03.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7ff17278d640 1 -- 172.21.15.120:0/1391733226 >> v2:172.21.15.120:3300/0 conn(0x7ff1640418d0 msgr2=0x7ff1640425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7ff17278d640 1 --2- 172.21.15.120:0/1391733226 >> v2:172.21.15.120:3300/0 conn(0x7ff1640418d0 0x7ff1640425a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7ff17278d640 1 -- 172.21.15.120:0/1391733226 >> v1:172.21.15.120:6789/0 conn(0x7ff1640c7b50 legacy=0x7ff1640d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.136+0000 7ff17278d640 1 -- 172.21.15.120:0/1391733226 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff164041db0 con 0x7ff16403b9b0 2023-12-19T05:39:03.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.137+0000 7fa07676e640 1 -- 172.21.15.120:0/4065843523 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06815ee10 con 0x7fa0680d67b0 2023-12-19T05:39:03.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7f8284a37640 1 -- 172.21.15.120:0/2999193070 shutdown_connections 2023-12-19T05:39:03.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7f8284a37640 1 -- 172.21.15.120:0/2999193070 wait complete. 2023-12-19T05:39:03.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7face1468640 1 -- 172.21.15.120:0/1862923978 shutdown_connections 2023-12-19T05:39:03.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7face1468640 1 -- 172.21.15.120:0/1862923978 wait complete. 2023-12-19T05:39:03.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7f95d2ffd640 1 -- 172.21.15.120:0/360205201 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c8005ad0 con 0x7f95c4003970 2023-12-19T05:39:03.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7f95d2ffd640 1 -- 172.21.15.120:0/360205201 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c802f070 con 0x7f95c4003970 2023-12-19T05:39:03.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7f95d2ffd640 1 -- 172.21.15.120:0/360205201 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c80080d0 con 0x7f95c4003970 2023-12-19T05:39:03.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7f8072ad4640 1 Processor -- start 2023-12-19T05:39:03.174 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7f8072ad4640 1 -- start start 2023-12-19T05:39:03.174 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7f30c8fcf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30c406c3e0 0x7f30c414b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.174 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7f30c8fcf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30c40b21f0 0x7f30c4149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7ff17278d640 1 --2- 172.21.15.120:0/1391733226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16403b9b0 0x7ff164042ae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff1640442d0 tx=0x7ff168034100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b9dc10bd563a182 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7ff170f8a640 1 -- 172.21.15.120:0/1391733226 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16803c440 con 0x7ff16403b9b0 2023-12-19T05:39:03.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7ff170f8a640 1 -- 172.21.15.120:0/1391733226 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16803c5a0 con 0x7ff16403b9b0 2023-12-19T05:39:03.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.138+0000 7ff170f8a640 1 -- 172.21.15.120:0/1391733226 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16803c910 con 0x7ff16403b9b0 2023-12-19T05:39:03.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7fa07676e640 1 -- 172.21.15.120:0/4065843523 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa06803a970 con 0x7fa0680d67b0 2023-12-19T05:39:03.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f8072ad4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806c0b9400 0x7f806c1ec500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.176 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f8072ad4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f806c0bc6e0 0x7f806c0be6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.176 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f8072ad4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f806c152820 0x7f806c1e6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.176 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f8072ad4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806c1eca40 con 0x7f806c0b9400 2023-12-19T05:39:03.176 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f8072ad4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806c14ceb0 con 0x7f806c0bc6e0 2023-12-19T05:39:03.176 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f8072ad4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806c14e580 con 0x7f806c152820 2023-12-19T05:39:03.176 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f95d9068640 1 -- 172.21.15.120:0/360205201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c4003970 msgr2=0x7f95c4003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.176 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f8071071640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f806c152820 0x7f806c1e6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.177 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f806bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f806c0bc6e0 0x7f806c0be6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.177 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f8071071640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f806c152820 0x7f806c1e6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:44042/0 (socket says 172.21.15.120:44042) 2023-12-19T05:39:03.177 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f8071071640 1 -- 172.21.15.120:0/3317057953 learned_addr learned my addr 172.21.15.120:0/3317057953 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.177 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f30c8fcf640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30c41490e0 0x7f30c41e4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.177 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7fa065ffb640 1 -- 172.21.15.120:0/4065843523 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa0700c83f0 con 0x7fa0680d67b0 2023-12-19T05:39:03.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f30c8fcf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40b5710 con 0x7f30c40b21f0 2023-12-19T05:39:03.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f30c37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30c406c3e0 0x7f30c414b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f30c2ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30c40b21f0 0x7f30c4149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f30c2ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30c40b21f0 0x7f30c4149fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45180/0 (socket says 172.21.15.120:45180) 2023-12-19T05:39:03.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f30c2ffd640 1 -- 172.21.15.120:0/28224554 learned_addr learned my addr 172.21.15.120:0/28224554 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f30c8fcf640 1 -- 172.21.15.120:0/28224554 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40b53c0 con 0x7f30c406c3e0 2023-12-19T05:39:03.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7face1468640 1 Processor -- start 2023-12-19T05:39:03.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7ff1741f0640 1 -- 172.21.15.120:0/1391733226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16403b9b0 msgr2=0x7ff164042ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7ff1741f0640 1 --2- 172.21.15.120:0/1391733226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16403b9b0 0x7ff164042ae0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff1640442d0 tx=0x7ff168034100 comp rx=0 tx=0).stop 2023-12-19T05:39:03.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7fa065ffb640 1 --2- 172.21.15.120:0/4065843523 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa05406a430 0x7fa05406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f8070870640 1 --2- 172.21.15.120:0/3317057953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806c0b9400 0x7f806c1ec500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f8284a37640 1 Processor -- start 2023-12-19T05:39:03.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f30c8fcf640 1 -- 172.21.15.120:0/28224554 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c414a850 con 0x7f30c41490e0 2023-12-19T05:39:03.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f30c37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30c406c3e0 0x7f30c414b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59520/0 (socket says 172.21.15.120:59520) 2023-12-19T05:39:03.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f30c3fff640 1 --2- 172.21.15.120:0/28224554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30c41490e0 0x7f30c41e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.139+0000 7f95d9068640 1 --2- 172.21.15.120:0/360205201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c4003970 0x7f95c4003d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f95c8004fc0 tx=0x7f95c40057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7face1468640 1 -- start start 2023-12-19T05:39:03.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7ff1741f0640 1 -- 172.21.15.120:0/1391733226 shutdown_connections 2023-12-19T05:39:03.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7ff1741f0640 1 --2- 172.21.15.120:0/1391733226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16403b9b0 0x7ff164042ae0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7ff1741f0640 1 --2- 172.21.15.120:0/1391733226 >> v2:172.21.15.120:3300/0 conn(0x7ff1640418d0 0x7ff1640425a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7ff1741f0640 1 -- 172.21.15.120:0/1391733226 >> 172.21.15.120:0/1391733226 conn(0x7ff16400f620 msgr2=0x7ff164006150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f95d9068640 1 -- 172.21.15.120:0/360205201 shutdown_connections 2023-12-19T05:39:03.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f95d9068640 1 --2- 172.21.15.120:0/360205201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c4003970 0x7f95c4003d50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f95d9068640 1 -- 172.21.15.120:0/360205201 >> 172.21.15.120:0/360205201 conn(0x7f95cc03ef70 msgr2=0x7f95cc03f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7fa065ffb640 1 -- 172.21.15.120:0/4065843523 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0700ba070 con 0x7fa0680d67b0 2023-12-19T05:39:03.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7fa07576c640 1 --2- 172.21.15.120:0/4065843523 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa05406a430 0x7fa05406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7fa065ffb640 1 --2- 172.21.15.120:0/4065843523 >> [v2:172.21.15.155:6800/89853,v1:172.21.15.155:6801/89853] conn(0x7fa0540725d0 0x7fa0540749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7fa065ffb640 1 -- 172.21.15.120:0/4065843523 --> [v2:172.21.15.155:6800/89853,v1:172.21.15.155:6801/89853] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0540750a0 con 0x7fa0540725d0 2023-12-19T05:39:03.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7fa065ffb640 1 -- 172.21.15.120:0/4065843523 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa070126970 con 0x7fa0680d67b0 2023-12-19T05:39:03.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f30c2ffd640 1 -- 172.21.15.120:0/28224554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30c41490e0 msgr2=0x7f30c41e4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f30c2ffd640 1 --2- 172.21.15.120:0/28224554 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f30c41490e0 0x7f30c41e4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7fad6a9e8640 1 --2- 172.21.15.120:0/639299186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad6406c3e0 0x7fad64159540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009e50 tx=0x7fad5c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b19c99b079ef541 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f30c2ffd640 1 -- 172.21.15.120:0/28224554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30c406c3e0 msgr2=0x7f30c414b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f30c2ffd640 1 --2- 172.21.15.120:0/28224554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f30c406c3e0 0x7f30c414b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f95d9068640 1 -- 172.21.15.120:0/360205201 shutdown_connections 2023-12-19T05:39:03.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7fad691e5640 1 -- 172.21.15.120:0/639299186 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c02cb00 con 0x7fad6406c3e0 2023-12-19T05:39:03.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f30c2ffd640 1 -- 172.21.15.120:0/28224554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc009a70 con 0x7f30c40b21f0 2023-12-19T05:39:03.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f30c2ffd640 1 --2- 172.21.15.120:0/28224554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30c40b21f0 0x7f30c4149fc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f30b800b450 tx=0x7f30b800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f30abfff640 1 -- 172.21.15.120:0/28224554 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8011890 con 0x7f30c40b21f0 2023-12-19T05:39:03.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f30abfff640 1 -- 172.21.15.120:0/28224554 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b8011a10 con 0x7f30c40b21f0 2023-12-19T05:39:03.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f30abfff640 1 -- 172.21.15.120:0/28224554 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b8011dc0 con 0x7f30c40b21f0 2023-12-19T05:39:03.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f95d9068640 1 -- 172.21.15.120:0/360205201 wait complete. 2023-12-19T05:39:03.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7face1468640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facdc06b650 0x7facdc1df6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f8070870640 1 -- 172.21.15.120:0/3317057953 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f806c152820 msgr2=0x7f806c1e6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f8070870640 1 --2- 172.21.15.120:0/3317057953 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f806c152820 0x7f806c1e6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f8070870640 1 -- 172.21.15.120:0/3317057953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f806c0bc6e0 msgr2=0x7f806c0be6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f8070870640 1 --2- 172.21.15.120:0/3317057953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f806c0bc6e0 0x7f806c0be6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f8070870640 1 -- 172.21.15.120:0/3317057953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8064009a70 con 0x7f806c0b9400 2023-12-19T05:39:03.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f8070870640 1 --2- 172.21.15.120:0/3317057953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806c0b9400 0x7f806c1ec500 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f805c00c410 tx=0x7f805c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7fa07576c640 1 --2- 172.21.15.120:0/4065843523 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa05406a430 0x7fa05406c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa060009b80 tx=0x7fa060009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7fa074f6b640 1 --2- 172.21.15.120:0/4065843523 >> [v2:172.21.15.155:6800/89853,v1:172.21.15.155:6801/89853] conn(0x7fa0540725d0 0x7fa0540749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7ff1741f0640 1 -- 172.21.15.120:0/1391733226 shutdown_connections 2023-12-19T05:39:03.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7ff1741f0640 1 -- 172.21.15.120:0/1391733226 wait complete. 2023-12-19T05:39:03.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7f8284a37640 1 -- start start 2023-12-19T05:39:03.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.140+0000 7fad691e5640 1 -- 172.21.15.120:0/639299186 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c02cc60 con 0x7fad6406c3e0 2023-12-19T05:39:03.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7face1468640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facdc0b51e0 0x7facdc14a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f8284a37640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82800b9360 0x7f82800b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7facdbfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facdc06b650 0x7facdc1df6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7facdbfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facdc06b650 0x7facdc1df6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59542/0 (socket says 172.21.15.120:59542) 2023-12-19T05:39:03.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7facdbfff640 1 -- 172.21.15.120:0/1737759635 learned_addr learned my addr 172.21.15.120:0/1737759635 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7face1468640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facdc14ac10 0x7facdc13d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7facdb7fe640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facdc0b51e0 0x7facdc14a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f806bfff640 1 --2- 172.21.15.120:0/3317057953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f806c0bc6e0 0x7f806c0be6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:03.190 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7fa074f6b640 1 --2- 172.21.15.120:0/4065843523 >> [v2:172.21.15.155:6800/89853,v1:172.21.15.155:6801/89853] conn(0x7fa0540725d0 0x7fa0540749f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.190 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f8284a37640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8280140e50 0x7f828006f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.190 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f8284a37640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8280149eb0 0x7f82800b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.190 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7f827ed9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82800b9360 0x7f82800b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.190 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f827ed9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82800b9360 0x7f82800b4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:44068/0 (socket says 172.21.15.120:44068) 2023-12-19T05:39:03.190 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f827ed9d640 1 -- 172.21.15.120:0/3063187044 learned_addr learned my addr 172.21.15.120:0/3063187044 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.191 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7fad6b1e9640 1 -- 172.21.15.120:0/639299186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad6406c3e0 msgr2=0x7fad64159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.191 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7fad6b1e9640 1 --2- 172.21.15.120:0/639299186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad6406c3e0 0x7fad64159540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009e50 tx=0x7fad5c02bf60 comp rx=0 tx=0).stop 2023-12-19T05:39:03.191 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7fad6b1e9640 1 -- 172.21.15.120:0/639299186 shutdown_connections 2023-12-19T05:39:03.191 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7fad6b1e9640 1 --2- 172.21.15.120:0/639299186 >> v2:172.21.15.120:3300/0 conn(0x7fad640b21f0 0x7fad640b7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.191 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.141+0000 7fad6b1e9640 1 --2- 172.21.15.120:0/639299186 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad6406c3e0 0x7fad64159540 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.191 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7fad6b1e9640 1 -- 172.21.15.120:0/639299186 >> 172.21.15.120:0/639299186 conn(0x7fad640b8840 msgr2=0x7fad640b8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.191 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7face1468640 1 -- 172.21.15.120:0/1737759635 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc149cf0 con 0x7facdc14ac10 2023-12-19T05:39:03.191 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7face1468640 1 -- 172.21.15.120:0/1737759635 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc0b8040 con 0x7facdc06b650 2023-12-19T05:39:03.191 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7face1468640 1 -- 172.21.15.120:0/1737759635 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facdc1dfce0 con 0x7facdc0b51e0 2023-12-19T05:39:03.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f8284a37640 1 -- 172.21.15.120:0/3063187044 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280141630 con 0x7f8280140e50 2023-12-19T05:39:03.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f8284a37640 1 -- 172.21.15.120:0/3063187044 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280139470 con 0x7f8280149eb0 2023-12-19T05:39:03.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f8284a37640 1 -- 172.21.15.120:0/3063187044 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8280139750 con 0x7f82800b9360 2023-12-19T05:39:03.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f30c8fcf640 1 -- 172.21.15.120:0/28224554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c40b5960 con 0x7f30c40b21f0 2023-12-19T05:39:03.192 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f30c8fcf640 1 -- 172.21.15.120:0/28224554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c414e670 con 0x7f30c40b21f0 2023-12-19T05:39:03.193 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f827f59e640 1 --2- 172.21.15.120:0/3063187044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8280149eb0 0x7f82800b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.193 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7ff1741f0640 1 Processor -- start 2023-12-19T05:39:03.193 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f80697fa640 1 -- 172.21.15.120:0/3317057953 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c0074e0 con 0x7f806c0b9400 2023-12-19T05:39:03.193 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f80697fa640 1 -- 172.21.15.120:0/3317057953 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805c007640 con 0x7f806c0b9400 2023-12-19T05:39:03.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f80697fa640 1 -- 172.21.15.120:0/3317057953 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c004a00 con 0x7f806c0b9400 2023-12-19T05:39:03.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f827659c640 1 --2- 172.21.15.120:0/3063187044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8280140e50 0x7f828006f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.194 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7ff1741f0640 1 -- start start 2023-12-19T05:39:03.195 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f827ed9d640 1 -- 172.21.15.120:0/3063187044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8280149eb0 msgr2=0x7f82800b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.195 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f827ed9d640 1 --2- 172.21.15.120:0/3063187044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8280149eb0 0x7f82800b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.195 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f827ed9d640 1 -- 172.21.15.120:0/3063187044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8280140e50 msgr2=0x7f828006f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.195 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f827ed9d640 1 --2- 172.21.15.120:0/3063187044 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8280140e50 0x7f828006f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.195 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f827ed9d640 1 -- 172.21.15.120:0/3063187044 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8278009a70 con 0x7f82800b9360 2023-12-19T05:39:03.195 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f827ed9d640 1 --2- 172.21.15.120:0/3063187044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82800b9360 0x7f82800b4c10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f826800c4a0 tx=0x7f826800c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.195 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7fa065ffb640 1 -- 172.21.15.120:0/4065843523 <== osd.4 v2:172.21.15.155:6800/89853 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa0540750a0 con 0x7fa0540725d0 2023-12-19T05:39:03.196 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f8072ad4640 1 -- 172.21.15.120:0/3317057953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806c14d100 con 0x7f806c0b9400 2023-12-19T05:39:03.196 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.142+0000 7f8072ad4640 1 -- 172.21.15.120:0/3317057953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806c151070 con 0x7f806c0b9400 2023-12-19T05:39:03.196 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7f95d9068640 1 Processor -- start 2023-12-19T05:39:03.196 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7f30c8fcf640 1 -- 172.21.15.120:0/28224554 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30c40b9360 con 0x7f30c40b21f0 2023-12-19T05:39:03.197 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7ff1741f0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16403b9b0 0x7ff1640c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.197 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7ff1741f0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1640418d0 0x7ff1640cb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.197 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7ff1741f0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1640c7b50 0x7ff1640ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.197 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7ff1741f0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1640c9440 con 0x7ff1640c7b50 2023-12-19T05:39:03.197 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7ff1741f0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1640d3500 con 0x7ff16403b9b0 2023-12-19T05:39:03.197 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7ff1741f0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1640ca300 con 0x7ff1640418d0 2023-12-19T05:39:03.197 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7f95d9068640 1 -- start start 2023-12-19T05:39:03.198 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7f8277fff640 1 -- 172.21.15.120:0/3063187044 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268005ce0 con 0x7f82800b9360 2023-12-19T05:39:03.198 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7f8277fff640 1 -- 172.21.15.120:0/3063187044 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8268005e40 con 0x7f82800b9360 2023-12-19T05:39:03.198 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7f8284a37640 1 -- 172.21.15.120:0/3063187044 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8280139a30 con 0x7f82800b9360 2023-12-19T05:39:03.198 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7f8277fff640 1 -- 172.21.15.120:0/3063187044 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268007270 con 0x7f82800b9360 2023-12-19T05:39:03.198 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7f8284a37640 1 -- 172.21.15.120:0/3063187044 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828013a230 con 0x7f82800b9360 2023-12-19T05:39:03.198 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7f8072ad4640 1 -- 172.21.15.120:0/3317057953 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f806c0b7740 con 0x7f806c0b9400 2023-12-19T05:39:03.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7ff171f8c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16403b9b0 0x7ff1640c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7ff171f8c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16403b9b0 0x7ff1640c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59550/0 (socket says 172.21.15.120:59550) 2023-12-19T05:39:03.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7ff171f8c640 1 -- 172.21.15.120:0/2903453180 learned_addr learned my addr 172.21.15.120:0/2903453180 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7ff171f8c640 1 -- 172.21.15.120:0/2903453180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1640418d0 msgr2=0x7ff1640cb820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T05:39:03.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7ff171f8c640 1 --2- 172.21.15.120:0/2903453180 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff1640418d0 0x7ff1640cb820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7ff171f8c640 1 -- 172.21.15.120:0/2903453180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1640c7b50 msgr2=0x7ff1640ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7ff171f8c640 1 --2- 172.21.15.120:0/2903453180 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff1640c7b50 0x7ff1640ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.199 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7ff171f8c640 1 -- 172.21.15.120:0/2903453180 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff168009400 con 0x7ff16403b9b0 2023-12-19T05:39:03.200 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7face0c67640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facdc14ac10 0x7facdc13d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.200 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7facdbfff640 1 -- 172.21.15.120:0/1737759635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facdc0b51e0 msgr2=0x7facdc14a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.200 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7facdbfff640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facdc0b51e0 0x7facdc14a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.200 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7facdbfff640 1 -- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facdc14ac10 msgr2=0x7facdc13d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.201 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7ff171f8c640 1 --2- 172.21.15.120:0/2903453180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16403b9b0 0x7ff1640c8f00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00c390 tx=0x7ff15c00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.201 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7facdbfff640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facdc14ac10 0x7facdc13d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.201 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7facdbfff640 1 -- 172.21.15.120:0/1737759635 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd4009a70 con 0x7facdc06b650 2023-12-19T05:39:03.201 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7f95d9068640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c4003970 0x7f95cc16dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.202 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7f95d9068640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95cc0ca1c0 0x7f95cc035430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.202 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7f95d9068640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95cc16a060 0x7f95cc026d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.202 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7f95d9068640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0cab50 con 0x7f95cc0ca1c0 2023-12-19T05:39:03.202 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7f95d9068640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0cbe20 con 0x7f95cc16a060 2023-12-19T05:39:03.202 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7f95d9068640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc0cb010 con 0x7f95c4003970 2023-12-19T05:39:03.202 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7face0c67640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facdc14ac10 0x7facdc13d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:03.203 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7ff1627fc640 1 -- 172.21.15.120:0/2903453180 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c005ce0 con 0x7ff16403b9b0 2023-12-19T05:39:03.203 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7ff1627fc640 1 -- 172.21.15.120:0/2903453180 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c005e40 con 0x7ff16403b9b0 2023-12-19T05:39:03.203 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7ff1741f0640 1 -- 172.21.15.120:0/2903453180 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1640cc610 con 0x7ff16403b9b0 2023-12-19T05:39:03.203 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7f95d3fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c4003970 0x7f95cc16dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7f95d3fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c4003970 0x7f95cc16dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:44098/0 (socket says 172.21.15.120:44098) 2023-12-19T05:39:03.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7f95d3fff640 1 -- 172.21.15.120:0/911176834 learned_addr learned my addr 172.21.15.120:0/911176834 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.144+0000 7f95d8867640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95cc16a060 0x7f95cc026d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7f95d37fe640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95cc0ca1c0 0x7f95cc035430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7f8277fff640 1 -- 172.21.15.120:0/3063187044 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8268007470 con 0x7f82800b9360 2023-12-19T05:39:03.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7f30abfff640 1 -- 172.21.15.120:0/28224554 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f30b801a400 con 0x7f30c40b21f0 2023-12-19T05:39:03.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7f30abfff640 1 --2- 172.21.15.120:0/28224554 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f30b006a430 0x7f30b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7f30abfff640 1 -- 172.21.15.120:0/28224554 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30b8088bd0 con 0x7f30c40b21f0 2023-12-19T05:39:03.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7f30abfff640 1 --2- 172.21.15.120:0/28224554 >> [v2:172.21.15.120:6816/89800,v1:172.21.15.120:6818/89800] conn(0x7f30b00725d0 0x7f30b00749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7f30abfff640 1 -- 172.21.15.120:0/28224554 --> [v2:172.21.15.120:6816/89800,v1:172.21.15.120:6818/89800] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30b00750a0 con 0x7f30b00725d0 2023-12-19T05:39:03.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7f30abfff640 1 -- 172.21.15.120:0/28224554 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30b808b290 con 0x7f30c40b21f0 2023-12-19T05:39:03.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7ff1741f0640 1 -- 172.21.15.120:0/2903453180 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1640c9c60 con 0x7ff16403b9b0 2023-12-19T05:39:03.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7ff1627fc640 1 -- 172.21.15.120:0/2903453180 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0072f0 con 0x7ff16403b9b0 2023-12-19T05:39:03.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7f8277fff640 1 --2- 172.21.15.120:0/3063187044 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8260072d10 0x7f82600751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.206 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7f30c3fff640 1 --2- 172.21.15.120:0/28224554 >> [v2:172.21.15.120:6816/89800,v1:172.21.15.120:6818/89800] conn(0x7f30b00725d0 0x7f30b00749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.206 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.143+0000 7fad6b1e9640 1 -- 172.21.15.120:0/639299186 shutdown_connections 2023-12-19T05:39:03.206 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7f8277fff640 1 -- 172.21.15.120:0/3063187044 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8268087d60 con 0x7f82800b9360 2023-12-19T05:39:03.206 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7f827659c640 1 --2- 172.21.15.120:0/3063187044 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8260072d10 0x7f82600751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7facdbfff640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facdc06b650 0x7facdc1df6c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faccc00c3c0 tx=0x7faccc00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7fad6b1e9640 1 -- 172.21.15.120:0/639299186 wait complete. 2023-12-19T05:39:03.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7f8284a37640 1 --2- 172.21.15.120:0/3063187044 >> [v2:172.21.15.155:6802/89855,v1:172.21.15.155:6804/89855] conn(0x7f82800b5cb0 0x7f82800b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7f8284a37640 1 -- 172.21.15.120:0/3063187044 --> [v2:172.21.15.155:6802/89855,v1:172.21.15.155:6804/89855] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f828014a820 con 0x7f82800b5cb0 2023-12-19T05:39:03.208 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7f30c37fe640 1 --2- 172.21.15.120:0/28224554 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f30b006a430 0x7f30b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.208 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7f30c3fff640 1 --2- 172.21.15.120:0/28224554 >> [v2:172.21.15.120:6816/89800,v1:172.21.15.120:6818/89800] conn(0x7f30b00725d0 0x7f30b00749f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.208 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7f827659c640 1 --2- 172.21.15.120:0/3063187044 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8260072d10 0x7f82600751d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82800a1d20 tx=0x7f8270009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.208 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7facd8ff9640 1 -- 172.21.15.120:0/1737759635 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc005ce0 con 0x7facdc06b650 2023-12-19T05:39:03.208 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7facd8ff9640 1 -- 172.21.15.120:0/1737759635 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc005e40 con 0x7facdc06b650 2023-12-19T05:39:03.209 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7ff1741f0640 1 -- 172.21.15.120:0/2903453180 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1640d14a0 con 0x7ff16403b9b0 2023-12-19T05:39:03.209 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7f95d3fff640 1 -- 172.21.15.120:0/911176834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95cc16a060 msgr2=0x7f95cc026d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.209 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7f95d3fff640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95cc16a060 0x7f95cc026d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.209 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.145+0000 7f95d3fff640 1 -- 172.21.15.120:0/911176834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95cc0ca1c0 msgr2=0x7f95cc035430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.209 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7f95d3fff640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95cc0ca1c0 0x7f95cc035430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.210 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7f95d3fff640 1 -- 172.21.15.120:0/911176834 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc16e4f0 con 0x7f95c4003970 2023-12-19T05:39:03.210 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7f95d37fe640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f95cc0ca1c0 0x7f95cc035430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:03.210 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7ff1627fc640 1 -- 172.21.15.120:0/2903453180 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff15c007470 con 0x7ff16403b9b0 2023-12-19T05:39:03.210 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.147+0000 7f95d3fff640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c4003970 0x7f95cc16dfb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f95c80050e0 tx=0x7f95c8004980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.210 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.146+0000 7f827f59e640 1 --2- 172.21.15.120:0/3063187044 >> [v2:172.21.15.155:6802/89855,v1:172.21.15.155:6804/89855] conn(0x7f82800b5cb0 0x7f82800b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.147+0000 7facd8ff9640 1 -- 172.21.15.120:0/1737759635 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc0072d0 con 0x7facdc06b650 2023-12-19T05:39:03.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.147+0000 7face1468640 1 -- 172.21.15.120:0/1737759635 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc1dffc0 con 0x7facdc06b650 2023-12-19T05:39:03.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.147+0000 7face1468640 1 -- 172.21.15.120:0/1737759635 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc0b9f10 con 0x7facdc06b650 2023-12-19T05:39:03.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.147+0000 7ff1627fc640 1 --2- 172.21.15.120:0/2903453180 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff15006a480 0x7ff15006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.147+0000 7f80697fa640 1 -- 172.21.15.120:0/3317057953 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f805c004b60 con 0x7f806c0b9400 2023-12-19T05:39:03.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.147+0000 7ff1627fc640 1 -- 172.21.15.120:0/2903453180 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff15c087fb0 con 0x7ff16403b9b0 2023-12-19T05:39:03.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.147+0000 7ff1627fc640 1 --2- 172.21.15.120:0/2903453180 >> [v2:172.21.15.155:6812/89854,v1:172.21.15.155:6814/89854] conn(0x7ff1500726a0 0x7ff150074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.147+0000 7ff1627fc640 1 -- 172.21.15.120:0/2903453180 --> [v2:172.21.15.155:6812/89854,v1:172.21.15.155:6814/89854] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff150075170 con 0x7ff1500726a0 2023-12-19T05:39:03.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.147+0000 7ff1627fc640 1 -- 172.21.15.120:0/2903453180 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff15c08a6c0 con 0x7ff16403b9b0 2023-12-19T05:39:03.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.147+0000 7f30abfff640 1 -- 172.21.15.120:0/28224554 <== osd.0 v2:172.21.15.120:6816/89800 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f30b00750a0 con 0x7f30b00725d0 2023-12-19T05:39:03.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.147+0000 7f80697fa640 1 --2- 172.21.15.120:0/3317057953 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f805806a480 0x7f805806c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.147+0000 7f827f59e640 1 --2- 172.21.15.120:0/3063187044 >> [v2:172.21.15.155:6802/89855,v1:172.21.15.155:6804/89855] conn(0x7f82800b5cb0 0x7f82800b3b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.147+0000 7fad6b1e9640 1 Processor -- start 2023-12-19T05:39:03.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7f80697fa640 1 -- 172.21.15.120:0/3317057953 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f805c088dc0 con 0x7f806c0b9400 2023-12-19T05:39:03.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7f80697fa640 1 --2- 172.21.15.120:0/3317057953 >> [v2:172.21.15.120:6817/89801,v1:172.21.15.120:6820/89801] conn(0x7f80580726a0 0x7f8058074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7f80697fa640 1 -- 172.21.15.120:0/3317057953 --> [v2:172.21.15.120:6817/89801,v1:172.21.15.120:6820/89801] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8058075170 con 0x7f80580726a0 2023-12-19T05:39:03.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7f80697fa640 1 -- 172.21.15.120:0/3317057953 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f805c089260 con 0x7f806c0b9400 2023-12-19T05:39:03.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7ff17278d640 1 --2- 172.21.15.120:0/2903453180 >> [v2:172.21.15.155:6812/89854,v1:172.21.15.155:6814/89854] conn(0x7ff1500726a0 0x7ff150074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7f8277fff640 1 -- 172.21.15.120:0/3063187044 <== osd.6 v2:172.21.15.155:6802/89855 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f82780344e0 con 0x7f82800b5cb0 2023-12-19T05:39:03.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7f95d0ff9640 1 -- 172.21.15.120:0/911176834 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c8005ac0 con 0x7f95c4003970 2023-12-19T05:39:03.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7f95d0ff9640 1 -- 172.21.15.120:0/911176834 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c8005c20 con 0x7f95c4003970 2023-12-19T05:39:03.216 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7f95d0ff9640 1 -- 172.21.15.120:0/911176834 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c80080f0 con 0x7f95c4003970 2023-12-19T05:39:03.216 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7f95d9068640 1 -- 172.21.15.120:0/911176834 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95cc0cad30 con 0x7f95c4003970 2023-12-19T05:39:03.216 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7face1468640 1 -- 172.21.15.120:0/1737759635 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7facdc0b64b0 con 0x7facdc06b650 2023-12-19T05:39:03.216 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7f806bfff640 1 --2- 172.21.15.120:0/3317057953 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f805806a480 0x7f805806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.216 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7ff17178b640 1 --2- 172.21.15.120:0/2903453180 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff15006a480 0x7ff15006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.217 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7f95d9068640 1 -- 172.21.15.120:0/911176834 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95cc16da90 con 0x7f95c4003970 2023-12-19T05:39:03.217 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.149+0000 7f806bfff640 1 --2- 172.21.15.120:0/3317057953 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f805806a480 0x7f805806c940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f806c1ea0f0 tx=0x7f8060009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.217 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7ff17278d640 1 --2- 172.21.15.120:0/2903453180 >> [v2:172.21.15.155:6812/89854,v1:172.21.15.155:6814/89854] conn(0x7ff1500726a0 0x7ff150074ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.217 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.149+0000 7ff17178b640 1 --2- 172.21.15.120:0/2903453180 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff15006a480 0x7ff15006c940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff16c069560 tx=0x7ff16c067f30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.218 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.149+0000 7f8071071640 1 --2- 172.21.15.120:0/3317057953 >> [v2:172.21.15.120:6817/89801,v1:172.21.15.120:6820/89801] conn(0x7f80580726a0 0x7f8058074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.218 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7fad6b1e9640 1 -- start start 2023-12-19T05:39:03.218 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.148+0000 7f30c37fe640 1 --2- 172.21.15.120:0/28224554 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f30b006a430 0x7f30b006c8f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f30b4001d50 tx=0x7f30b4001ce0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.218 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.149+0000 7ff1627fc640 1 -- 172.21.15.120:0/2903453180 <== osd.5 v2:172.21.15.155:6812/89854 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff150075170 con 0x7ff1500726a0 2023-12-19T05:39:03.219 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.149+0000 7f8071071640 1 --2- 172.21.15.120:0/3317057953 >> [v2:172.21.15.120:6817/89801,v1:172.21.15.120:6820/89801] conn(0x7f80580726a0 0x7f8058074ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.219 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.150+0000 7f95d9068640 1 -- 172.21.15.120:0/911176834 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95cc16d630 con 0x7f95c4003970 2023-12-19T05:39:03.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.149+0000 7fad6b1e9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad6406c3e0 0x7fad64151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.149+0000 7fad6b1e9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad640b21f0 0x7fad640b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.149+0000 7fad6b1e9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad641490e0 0x7fad641422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.149+0000 7fad6b1e9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad64151eb0 con 0x7fad640b21f0 2023-12-19T05:39:03.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.149+0000 7fad6b1e9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad64150300 con 0x7fad641490e0 2023-12-19T05:39:03.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.149+0000 7fad6b1e9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad641505e0 con 0x7fad6406c3e0 2023-12-19T05:39:03.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.150+0000 7fad699e6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad640b21f0 0x7fad640b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.150+0000 7fad6a1e7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad6406c3e0 0x7fad64151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.150+0000 7fad699e6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad640b21f0 0x7fad640b4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45214/0 (socket says 172.21.15.120:45214) 2023-12-19T05:39:03.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.150+0000 7fad699e6640 1 -- 172.21.15.120:0/1419373206 learned_addr learned my addr 172.21.15.120:0/1419373206 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.150+0000 7fad6a9e8640 1 --2- 172.21.15.120:0/1419373206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad641490e0 0x7fad641422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.220 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.150+0000 7fad699e6640 1 -- 172.21.15.120:0/1419373206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad6406c3e0 msgr2=0x7fad64151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.150+0000 7fad699e6640 1 --2- 172.21.15.120:0/1419373206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad6406c3e0 0x7fad64151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.150+0000 7fad699e6640 1 -- 172.21.15.120:0/1419373206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad641490e0 msgr2=0x7fad641422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.150+0000 7fad699e6640 1 --2- 172.21.15.120:0/1419373206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad641490e0 0x7fad641422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.150+0000 7fad699e6640 1 -- 172.21.15.120:0/1419373206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c009b30 con 0x7fad640b21f0 2023-12-19T05:39:03.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.150+0000 7fad6a1e7640 1 --2- 172.21.15.120:0/1419373206 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad6406c3e0 0x7fad64151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:03.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.151+0000 7f95d0ff9640 1 -- 172.21.15.120:0/911176834 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f95c802cd50 con 0x7f95c4003970 2023-12-19T05:39:03.221 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.151+0000 7f80697fa640 1 -- 172.21.15.120:0/3317057953 <== osd.3 v2:172.21.15.120:6817/89801 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8058075170 con 0x7f80580726a0 2023-12-19T05:39:03.222 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.151+0000 7fad699e6640 1 --2- 172.21.15.120:0/1419373206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad640b21f0 0x7fad640b4130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fad6000d800 tx=0x7fad6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.222 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.151+0000 7f95d0ff9640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f95b806a500 0x7f95b806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.223 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.152+0000 7f95d37fe640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f95b806a500 0x7f95b806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.223 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.152+0000 7f95d37fe640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f95b806a500 0x7f95b806c9c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f95cc16b1d0 tx=0x7f95c0007cc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.223 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.153+0000 7f95d0ff9640 1 -- 172.21.15.120:0/911176834 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95c80a9f70 con 0x7f95c4003970 2023-12-19T05:39:03.223 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.153+0000 7f95d0ff9640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.120:6808/89795,v1:172.21.15.120:6809/89795] conn(0x7f95b80726a0 0x7f95b8074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.223 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.151+0000 7fad5affd640 1 -- 172.21.15.120:0/1419373206 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad600096a0 con 0x7fad640b21f0 2023-12-19T05:39:03.223 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.151+0000 7fad6b1e9640 1 -- 172.21.15.120:0/1419373206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad641508c0 con 0x7fad640b21f0 2023-12-19T05:39:03.223 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.151+0000 7fad6b1e9640 1 -- 172.21.15.120:0/1419373206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad640b4670 con 0x7fad640b21f0 2023-12-19T05:39:03.223 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.151+0000 7fad5affd640 1 -- 172.21.15.120:0/1419373206 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad60009800 con 0x7fad640b21f0 2023-12-19T05:39:03.223 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.152+0000 7fad5affd640 1 -- 172.21.15.120:0/1419373206 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60009b90 con 0x7fad640b21f0 2023-12-19T05:39:03.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.153+0000 7f95d8867640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.120:6808/89795,v1:172.21.15.120:6809/89795] conn(0x7f95b80726a0 0x7f95b8074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.152+0000 7facd8ff9640 1 -- 172.21.15.120:0/1737759635 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faccc007430 con 0x7facdc06b650 2023-12-19T05:39:03.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.153+0000 7facd8ff9640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7facc806a530 0x7facc806c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.153+0000 7facd8ff9640 1 -- 172.21.15.120:0/1737759635 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faccc0885b0 con 0x7facdc06b650 2023-12-19T05:39:03.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.153+0000 7facd8ff9640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:6800/89798,v1:172.21.15.120:6801/89798] conn(0x7facc8072750 0x7facc8074b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.153+0000 7fad6b1e9640 1 -- 172.21.15.120:0/1419373206 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad4c000fc0 con 0x7fad640b21f0 2023-12-19T05:39:03.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.154+0000 7facdb7fe640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7facc806a530 0x7facc806c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.154+0000 7facd8ff9640 1 -- 172.21.15.120:0/1737759635 --> [v2:172.21.15.120:6800/89798,v1:172.21.15.120:6801/89798] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7facc8075220 con 0x7facc8072750 2023-12-19T05:39:03.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.154+0000 7face0c67640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:6800/89798,v1:172.21.15.120:6801/89798] conn(0x7facc8072750 0x7facc8074b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.154+0000 7facd8ff9640 1 -- 172.21.15.120:0/1737759635 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7faccc088960 con 0x7facdc06b650 2023-12-19T05:39:03.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.154+0000 7face0c67640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:6800/89798,v1:172.21.15.120:6801/89798] conn(0x7facc8072750 0x7facc8074b70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.155+0000 7facdb7fe640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7facc806a530 0x7facc806c9f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7facdc13a430 tx=0x7facd0009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.154+0000 7f95d0ff9640 1 -- 172.21.15.120:0/911176834 --> [v2:172.21.15.120:6808/89795,v1:172.21.15.120:6809/89795] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95b8075170 con 0x7f95b80726a0 2023-12-19T05:39:03.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.154+0000 7f95d0ff9640 1 -- 172.21.15.120:0/911176834 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95c80ac590 con 0x7f95c4003970 2023-12-19T05:39:03.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.155+0000 7f95d8867640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.120:6808/89795,v1:172.21.15.120:6809/89795] conn(0x7f95b80726a0 0x7f95b8074ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.155+0000 7fad5affd640 1 -- 172.21.15.120:0/1419373206 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fad60009cf0 con 0x7fad640b21f0 2023-12-19T05:39:03.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.155+0000 7f95d0ff9640 1 -- 172.21.15.120:0/911176834 <== osd.1 v2:172.21.15.120:6808/89795 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f95b8075170 con 0x7f95b80726a0 2023-12-19T05:39:03.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.156+0000 7facd8ff9640 1 -- 172.21.15.120:0/1737759635 <== osd.2 v2:172.21.15.120:6800/89798 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7facc8075220 con 0x7facc8072750 2023-12-19T05:39:03.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.156+0000 7fad5affd640 1 --2- 172.21.15.120:0/1419373206 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fad4806a430 0x7fad4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.156+0000 7fad5affd640 1 -- 172.21.15.120:0/1419373206 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad60058300 con 0x7fad640b21f0 2023-12-19T05:39:03.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.156+0000 7fad6a1e7640 1 --2- 172.21.15.120:0/1419373206 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fad4806a430 0x7fad4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.156+0000 7fad5affd640 1 --2- 172.21.15.120:0/1419373206 >> [v2:172.21.15.155:6823/89856,v1:172.21.15.155:6825/89856] conn(0x7fad48073070 0x7fad48075510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.156+0000 7fad5affd640 1 -- 172.21.15.120:0/1419373206 --> [v2:172.21.15.155:6823/89856,v1:172.21.15.155:6825/89856] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad48075be0 con 0x7fad48073070 2023-12-19T05:39:03.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.156+0000 7fad5affd640 1 -- 172.21.15.120:0/1419373206 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad600580d0 con 0x7fad640b21f0 2023-12-19T05:39:03.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.157+0000 7fad6a1e7640 1 --2- 172.21.15.120:0/1419373206 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fad4806a430 0x7fad4806c8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad54000f60 tx=0x7fad54009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.159+0000 7fad6a9e8640 1 --2- 172.21.15.120:0/1419373206 >> [v2:172.21.15.155:6823/89856,v1:172.21.15.155:6825/89856] conn(0x7fad48073070 0x7fad48075510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.161+0000 7fad6a9e8640 1 --2- 172.21.15.120:0/1419373206 >> [v2:172.21.15.155:6823/89856,v1:172.21.15.155:6825/89856] conn(0x7fad48073070 0x7fad48075510 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.162+0000 7fad5affd640 1 -- 172.21.15.120:0/1419373206 <== osd.7 v2:172.21.15.155:6823/89856 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fad48075be0 con 0x7fad48073070 2023-12-19T05:39:03.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.172+0000 7fa07676e640 1 -- 172.21.15.120:0/4065843523 --> [v2:172.21.15.155:6800/89853,v1:172.21.15.155:6801/89853] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa0680d54d0 con 0x7fa0540725d0 2023-12-19T05:39:03.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.173+0000 7fa065ffb640 1 -- 172.21.15.120:0/4065843523 <== osd.4 v2:172.21.15.155:6800/89853 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa0540750a0 con 0x7fa0540725d0 2023-12-19T05:39:03.230 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.173+0000 7fa05b7fe640 1 -- 172.21.15.120:0/4065843523 >> [v2:172.21.15.155:6800/89853,v1:172.21.15.155:6801/89853] conn(0x7fa0540725d0 msgr2=0x7fa0540749f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.230 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.173+0000 7fa05b7fe640 1 --2- 172.21.15.120:0/4065843523 >> [v2:172.21.15.155:6800/89853,v1:172.21.15.155:6801/89853] conn(0x7fa0540725d0 0x7fa0540749f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.230 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.174+0000 7fa05b7fe640 1 -- 172.21.15.120:0/4065843523 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa05406a430 msgr2=0x7fa05406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.230 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.174+0000 7fa05b7fe640 1 --2- 172.21.15.120:0/4065843523 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa05406a430 0x7fa05406c8f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa060009b80 tx=0x7fa060009190 comp rx=0 tx=0).stop 2023-12-19T05:39:03.230 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.174+0000 7fa05b7fe640 1 -- 172.21.15.120:0/4065843523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680d67b0 msgr2=0x7fa068037fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.230 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.174+0000 7fa05b7fe640 1 --2- 172.21.15.120:0/4065843523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0680d67b0 0x7fa068037fe0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa0700638d0 tx=0x7fa070061ab0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.174+0000 7fa075f6d640 1 -- 172.21.15.120:0/4065843523 reap_dead start 2023-12-19T05:39:03.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.174+0000 7fa05b7fe640 1 -- 172.21.15.120:0/4065843523 shutdown_connections 2023-12-19T05:39:03.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.174+0000 7fa05b7fe640 1 -- 172.21.15.120:0/4065843523 >> 172.21.15.120:0/4065843523 conn(0x7fa06803f2a0 msgr2=0x7fa068041670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.174+0000 7fa05b7fe640 1 -- 172.21.15.120:0/4065843523 shutdown_connections 2023-12-19T05:39:03.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.174+0000 7fa05b7fe640 1 -- 172.21.15.120:0/4065843523 wait complete. 2023-12-19T05:39:03.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.177+0000 7f8284a37640 1 -- 172.21.15.120:0/3063187044 --> [v2:172.21.15.155:6802/89855,v1:172.21.15.155:6804/89855] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8280139f50 con 0x7f82800b5cb0 2023-12-19T05:39:03.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.177+0000 7f8277fff640 1 -- 172.21.15.120:0/3063187044 <== osd.6 v2:172.21.15.155:6802/89855 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8280139f50 con 0x7f82800b5cb0 2023-12-19T05:39:03.233 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.178+0000 7f827559a640 1 -- 172.21.15.120:0/3063187044 >> [v2:172.21.15.155:6802/89855,v1:172.21.15.155:6804/89855] conn(0x7f82800b5cb0 msgr2=0x7f82800b3b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.233 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.178+0000 7f827559a640 1 --2- 172.21.15.120:0/3063187044 >> [v2:172.21.15.155:6802/89855,v1:172.21.15.155:6804/89855] conn(0x7f82800b5cb0 0x7f82800b3b20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.233 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.178+0000 7f827559a640 1 -- 172.21.15.120:0/3063187044 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8260072d10 msgr2=0x7f82600751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.233 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.178+0000 7f827559a640 1 --2- 172.21.15.120:0/3063187044 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8260072d10 0x7f82600751d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f82800a1d20 tx=0x7f8270009040 comp rx=0 tx=0).stop 2023-12-19T05:39:03.233 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.178+0000 7f827559a640 1 -- 172.21.15.120:0/3063187044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82800b9360 msgr2=0x7f82800b4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.233 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.178+0000 7f827559a640 1 --2- 172.21.15.120:0/3063187044 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f82800b9360 0x7f82800b4c10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f826800c4a0 tx=0x7f826800c960 comp rx=0 tx=0).stop 2023-12-19T05:39:03.233 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.179+0000 7f827f59e640 1 -- 172.21.15.120:0/3063187044 reap_dead start 2023-12-19T05:39:03.233 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.179+0000 7f827559a640 1 -- 172.21.15.120:0/3063187044 shutdown_connections 2023-12-19T05:39:03.234 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.179+0000 7f827559a640 1 -- 172.21.15.120:0/3063187044 >> 172.21.15.120:0/3063187044 conn(0x7f82800b8840 msgr2=0x7f828013f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.234 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.179+0000 7f827559a640 1 -- 172.21.15.120:0/3063187044 shutdown_connections 2023-12-19T05:39:03.234 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.179+0000 7f827559a640 1 -- 172.21.15.120:0/3063187044 wait complete. 2023-12-19T05:39:03.236 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.179+0000 7ff1741f0640 1 -- 172.21.15.120:0/2903453180 --> [v2:172.21.15.155:6812/89854,v1:172.21.15.155:6814/89854] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff1640d11c0 con 0x7ff1500726a0 2023-12-19T05:39:03.237 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.180+0000 7f95d9068640 1 -- 172.21.15.120:0/911176834 --> [v2:172.21.15.120:6808/89795,v1:172.21.15.120:6809/89795] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f95cc007640 con 0x7f95b80726a0 2023-12-19T05:39:03.237 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.181+0000 7f95d0ff9640 1 -- 172.21.15.120:0/911176834 <== osd.1 v2:172.21.15.120:6808/89795 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f95d404e5f0 con 0x7f95b80726a0 2023-12-19T05:39:03.238 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.181+0000 7ff1627fc640 1 -- 172.21.15.120:0/2903453180 <== osd.5 v2:172.21.15.155:6812/89854 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff168004040 con 0x7ff1500726a0 2023-12-19T05:39:03.238 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.181+0000 7f30c8fcf640 1 -- 172.21.15.120:0/28224554 --> [v2:172.21.15.120:6816/89800,v1:172.21.15.120:6818/89800] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f30c40b5220 con 0x7f30b00725d0 2023-12-19T05:39:03.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.181+0000 7f95d9068640 1 -- 172.21.15.120:0/911176834 >> [v2:172.21.15.120:6808/89795,v1:172.21.15.120:6809/89795] conn(0x7f95b80726a0 msgr2=0x7f95b8074ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.181+0000 7f95d9068640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.120:6808/89795,v1:172.21.15.120:6809/89795] conn(0x7f95b80726a0 0x7f95b8074ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7f95d9068640 1 -- 172.21.15.120:0/911176834 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f95b806a500 msgr2=0x7f95b806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7f95d9068640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f95b806a500 0x7f95b806c9c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f95cc16b1d0 tx=0x7f95c0007cc0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7f95d9068640 1 -- 172.21.15.120:0/911176834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c4003970 msgr2=0x7f95cc16dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7f95d9068640 1 --2- 172.21.15.120:0/911176834 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f95c4003970 0x7f95cc16dfb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f95c80050e0 tx=0x7f95c8004980 comp rx=0 tx=0).stop 2023-12-19T05:39:03.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7f95d8867640 1 -- 172.21.15.120:0/911176834 reap_dead start 2023-12-19T05:39:03.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7ff1741f0640 1 -- 172.21.15.120:0/2903453180 >> [v2:172.21.15.155:6812/89854,v1:172.21.15.155:6814/89854] conn(0x7ff1500726a0 msgr2=0x7ff150074ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7ff1741f0640 1 --2- 172.21.15.120:0/2903453180 >> [v2:172.21.15.155:6812/89854,v1:172.21.15.155:6814/89854] conn(0x7ff1500726a0 0x7ff150074ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.240 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7f95d9068640 1 -- 172.21.15.120:0/911176834 shutdown_connections 2023-12-19T05:39:03.240 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7f95d9068640 1 -- 172.21.15.120:0/911176834 >> 172.21.15.120:0/911176834 conn(0x7f95cc03ef70 msgr2=0x7f95cc03f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.240 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7f30abfff640 1 -- 172.21.15.120:0/28224554 <== osd.0 v2:172.21.15.120:6816/89800 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f30c40b5220 con 0x7f30b00725d0 2023-12-19T05:39:03.240 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7ff1741f0640 1 -- 172.21.15.120:0/2903453180 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff15006a480 msgr2=0x7ff15006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.240 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7ff1741f0640 1 --2- 172.21.15.120:0/2903453180 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff15006a480 0x7ff15006c940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff16c069560 tx=0x7ff16c067f30 comp rx=0 tx=0).stop 2023-12-19T05:39:03.241 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7ff1741f0640 1 -- 172.21.15.120:0/2903453180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16403b9b0 msgr2=0x7ff1640c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.241 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7ff1741f0640 1 --2- 172.21.15.120:0/2903453180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff16403b9b0 0x7ff1640c8f00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00c390 tx=0x7ff15c00c850 comp rx=0 tx=0).stop 2023-12-19T05:39:03.241 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7ff17278d640 1 -- 172.21.15.120:0/2903453180 reap_dead start 2023-12-19T05:39:03.241 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7ff1741f0640 1 -- 172.21.15.120:0/2903453180 shutdown_connections 2023-12-19T05:39:03.241 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7ff1741f0640 1 -- 172.21.15.120:0/2903453180 >> 172.21.15.120:0/2903453180 conn(0x7ff16400f620 msgr2=0x7ff1640070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.242 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.182+0000 7f95d9068640 1 -- 172.21.15.120:0/911176834 shutdown_connections 2023-12-19T05:39:03.242 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.183+0000 7ff1741f0640 1 -- 172.21.15.120:0/2903453180 shutdown_connections 2023-12-19T05:39:03.242 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.183+0000 7f95d9068640 1 -- 172.21.15.120:0/911176834 wait complete. 2023-12-19T05:39:03.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.183+0000 7ff1741f0640 1 -- 172.21.15.120:0/2903453180 wait complete. 2023-12-19T05:39:03.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.183+0000 7f30a9ffb640 1 -- 172.21.15.120:0/28224554 >> [v2:172.21.15.120:6816/89800,v1:172.21.15.120:6818/89800] conn(0x7f30b00725d0 msgr2=0x7f30b00749f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.183+0000 7f30a9ffb640 1 --2- 172.21.15.120:0/28224554 >> [v2:172.21.15.120:6816/89800,v1:172.21.15.120:6818/89800] conn(0x7f30b00725d0 0x7f30b00749f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.183+0000 7f30a9ffb640 1 -- 172.21.15.120:0/28224554 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f30b006a430 msgr2=0x7f30b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.183+0000 7f30a9ffb640 1 --2- 172.21.15.120:0/28224554 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f30b006a430 0x7f30b006c8f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f30b4001d50 tx=0x7f30b4001ce0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.183+0000 7f30a9ffb640 1 -- 172.21.15.120:0/28224554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30c40b21f0 msgr2=0x7f30c4149fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.183+0000 7f30a9ffb640 1 --2- 172.21.15.120:0/28224554 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f30c40b21f0 0x7f30c4149fc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f30b800b450 tx=0x7f30b800b910 comp rx=0 tx=0).stop 2023-12-19T05:39:03.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.183+0000 7f30c3fff640 1 -- 172.21.15.120:0/28224554 reap_dead start 2023-12-19T05:39:03.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.183+0000 7f8072ad4640 1 -- 172.21.15.120:0/3317057953 --> [v2:172.21.15.120:6817/89801,v1:172.21.15.120:6820/89801] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f806c0b6db0 con 0x7f80580726a0 2023-12-19T05:39:03.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.183+0000 7face1468640 1 -- 172.21.15.120:0/1737759635 --> [v2:172.21.15.120:6800/89798,v1:172.21.15.120:6801/89798] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7facdc0b61d0 con 0x7facc8072750 2023-12-19T05:39:03.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.184+0000 7f30a9ffb640 1 -- 172.21.15.120:0/28224554 shutdown_connections 2023-12-19T05:39:03.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.184+0000 7f30a9ffb640 1 -- 172.21.15.120:0/28224554 >> 172.21.15.120:0/28224554 conn(0x7f30c40b8840 msgr2=0x7f30c41daf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.184+0000 7f80697fa640 1 -- 172.21.15.120:0/3317057953 <== osd.3 v2:172.21.15.120:6817/89801 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8064034520 con 0x7f80580726a0 2023-12-19T05:39:03.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.184+0000 7f30a9ffb640 1 -- 172.21.15.120:0/28224554 shutdown_connections 2023-12-19T05:39:03.246 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.185+0000 7f30a9ffb640 1 -- 172.21.15.120:0/28224554 wait complete. 2023-12-19T05:39:03.247 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.184+0000 7f8072ad4640 1 -- 172.21.15.120:0/3317057953 >> [v2:172.21.15.120:6817/89801,v1:172.21.15.120:6820/89801] conn(0x7f80580726a0 msgr2=0x7f8058074ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.247 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.185+0000 7f8072ad4640 1 --2- 172.21.15.120:0/3317057953 >> [v2:172.21.15.120:6817/89801,v1:172.21.15.120:6820/89801] conn(0x7f80580726a0 0x7f8058074ac0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.247 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.185+0000 7f8072ad4640 1 -- 172.21.15.120:0/3317057953 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f805806a480 msgr2=0x7f805806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.247 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.185+0000 7f8072ad4640 1 --2- 172.21.15.120:0/3317057953 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f805806a480 0x7f805806c940 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f806c1ea0f0 tx=0x7f8060009040 comp rx=0 tx=0).stop 2023-12-19T05:39:03.247 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.185+0000 7f8072ad4640 1 -- 172.21.15.120:0/3317057953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806c0b9400 msgr2=0x7f806c1ec500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.247 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.185+0000 7f8072ad4640 1 --2- 172.21.15.120:0/3317057953 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f806c0b9400 0x7f806c1ec500 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f805c00c410 tx=0x7f805c00c8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.247 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.185+0000 7f8071071640 1 -- 172.21.15.120:0/3317057953 reap_dead start 2023-12-19T05:39:03.247 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.185+0000 7f8072ad4640 1 -- 172.21.15.120:0/3317057953 shutdown_connections 2023-12-19T05:39:03.247 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.185+0000 7f8072ad4640 1 -- 172.21.15.120:0/3317057953 >> 172.21.15.120:0/3317057953 conn(0x7f806c0c0340 msgr2=0x7f806c0bf460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.247 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.185+0000 7f8072ad4640 1 -- 172.21.15.120:0/3317057953 shutdown_connections 2023-12-19T05:39:03.248 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.185+0000 7f8072ad4640 1 -- 172.21.15.120:0/3317057953 wait complete. 2023-12-19T05:39:03.248 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.186+0000 7facd8ff9640 1 -- 172.21.15.120:0/1737759635 <== osd.2 v2:172.21.15.120:6800/89798 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7facd4007660 con 0x7facc8072750 2023-12-19T05:39:03.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.187+0000 7face1468640 1 -- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:6800/89798,v1:172.21.15.120:6801/89798] conn(0x7facc8072750 msgr2=0x7facc8074b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.187+0000 7face1468640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:6800/89798,v1:172.21.15.120:6801/89798] conn(0x7facc8072750 0x7facc8074b70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.187+0000 7face1468640 1 -- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7facc806a530 msgr2=0x7facc806c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.187+0000 7face1468640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7facc806a530 0x7facc806c9f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7facdc13a430 tx=0x7facd0009190 comp rx=0 tx=0).stop 2023-12-19T05:39:03.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.187+0000 7face1468640 1 -- 172.21.15.120:0/1737759635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facdc06b650 msgr2=0x7facdc1df6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.187+0000 7face1468640 1 --2- 172.21.15.120:0/1737759635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facdc06b650 0x7facdc1df6c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7faccc00c3c0 tx=0x7faccc00c880 comp rx=0 tx=0).stop 2023-12-19T05:39:03.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.187+0000 7face0c67640 1 -- 172.21.15.120:0/1737759635 reap_dead start 2023-12-19T05:39:03.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.187+0000 7face1468640 1 -- 172.21.15.120:0/1737759635 shutdown_connections 2023-12-19T05:39:03.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.187+0000 7face1468640 1 -- 172.21.15.120:0/1737759635 >> 172.21.15.120:0/1737759635 conn(0x7facdc0c0110 msgr2=0x7facdc13e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.187+0000 7face1468640 1 -- 172.21.15.120:0/1737759635 shutdown_connections 2023-12-19T05:39:03.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.187+0000 7face1468640 1 -- 172.21.15.120:0/1737759635 wait complete. 2023-12-19T05:39:03.250 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2023-12-19T05:39:03.251 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T05:39:03.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.191+0000 7fad6b1e9640 1 -- 172.21.15.120:0/1419373206 --> [v2:172.21.15.155:6823/89856,v1:172.21.15.155:6825/89856] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fad4c002cb0 con 0x7fad48073070 2023-12-19T05:39:03.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.192+0000 7fad5affd640 1 -- 172.21.15.120:0/1419373206 <== osd.7 v2:172.21.15.155:6823/89856 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fad4c002cb0 con 0x7fad48073070 2023-12-19T05:39:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.192+0000 7fad6b1e9640 1 -- 172.21.15.120:0/1419373206 >> [v2:172.21.15.155:6823/89856,v1:172.21.15.155:6825/89856] conn(0x7fad48073070 msgr2=0x7fad48075510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.193+0000 7fad6b1e9640 1 --2- 172.21.15.120:0/1419373206 >> [v2:172.21.15.155:6823/89856,v1:172.21.15.155:6825/89856] conn(0x7fad48073070 0x7fad48075510 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.193+0000 7fad6b1e9640 1 -- 172.21.15.120:0/1419373206 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fad4806a430 msgr2=0x7fad4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.193+0000 7fad6b1e9640 1 --2- 172.21.15.120:0/1419373206 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fad4806a430 0x7fad4806c8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad54000f60 tx=0x7fad54009040 comp rx=0 tx=0).stop 2023-12-19T05:39:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.193+0000 7fad6b1e9640 1 -- 172.21.15.120:0/1419373206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad640b21f0 msgr2=0x7fad640b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.193+0000 7fad6b1e9640 1 --2- 172.21.15.120:0/1419373206 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad640b21f0 0x7fad640b4130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fad6000d800 tx=0x7fad6000dcc0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.193+0000 7fad6a9e8640 1 -- 172.21.15.120:0/1419373206 reap_dead start 2023-12-19T05:39:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.193+0000 7fad6b1e9640 1 -- 172.21.15.120:0/1419373206 shutdown_connections 2023-12-19T05:39:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.193+0000 7fad6b1e9640 1 -- 172.21.15.120:0/1419373206 >> 172.21.15.120:0/1419373206 conn(0x7fad640b8840 msgr2=0x7fad64143f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.193+0000 7fad6b1e9640 1 -- 172.21.15.120:0/1419373206 shutdown_connections 2023-12-19T05:39:03.253 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.193+0000 7fad6b1e9640 1 -- 172.21.15.120:0/1419373206 wait complete. 2023-12-19T05:39:03.254 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2023-12-19T05:39:03.254 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T05:39:03.255 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2023-12-19T05:39:03.255 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T05:39:03.256 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2023-12-19T05:39:03.256 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T05:39:03.257 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2023-12-19T05:39:03.258 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T05:39:03.258 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2023-12-19T05:39:03.259 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T05:39:03.259 INFO:teuthology.orchestra.run.smithi120.stdout:55834574856 2023-12-19T05:39:03.260 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T05:39:03.261 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2023-12-19T05:39:03.262 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T05:39:03.461 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.460+0000 7febd9147640 1 Processor -- start 2023-12-19T05:39:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.460+0000 7febd9147640 1 -- start start 2023-12-19T05:39:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.461+0000 7febd9147640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7febd40b8460 0x7febd4070790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.461+0000 7febd9147640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febd414a150 0x7febd414a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.461+0000 7febd9147640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd406fbc0 con 0x7febd40b5e50 2023-12-19T05:39:03.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.461+0000 7febd9147640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd406f0b0 con 0x7febd40b8460 2023-12-19T05:39:03.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.461+0000 7febd9147640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd414ab20 con 0x7febd414a150 2023-12-19T05:39:03.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7febd2d9d640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7febd40b5e50 0x7febd406a150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:39856/0 (socket says 172.21.15.120:39856) 2023-12-19T05:39:03.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7febd2d9d640 1 -- 172.21.15.120:0/913001589 learned_addr learned my addr 172.21.15.120:0/913001589 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:03.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7febd259c640 1 --2- 172.21.15.120:0/913001589 >> v2:172.21.15.155:3300/0 conn(0x7febd40b8460 0x7febd4070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.465 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.460+0000 7fbbbbb18640 1 Processor -- start 2023-12-19T05:39:03.465 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.460+0000 7fbbbbb18640 1 -- start start 2023-12-19T05:39:03.465 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.461+0000 7fbbbbb18640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbbb406eaf0 0x7fbbb415a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.465 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.461+0000 7fbbbbb18640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb40b7e40 con 0x7fbbb40b2bb0 2023-12-19T05:39:03.465 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.461+0000 7fbbbbb18640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb406c9f0 con 0x7fbbb4149150 2023-12-19T05:39:03.465 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.461+0000 7fbbbbb18640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb40b85b0 con 0x7fbbb406eaf0 2023-12-19T05:39:03.466 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7fbbb90b3640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fbbb40b2bb0 0x7fbbb406f820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49630/0 (socket says 172.21.15.120:49630) 2023-12-19T05:39:03.466 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7fbbb90b3640 1 -- 172.21.15.120:0/3652547140 learned_addr learned my addr 172.21.15.120:0/3652547140 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:03.466 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7fbbba0b5640 1 --2- 172.21.15.120:0/3652547140 >> v2:172.21.15.120:3300/0 conn(0x7fbbb406eaf0 0x7fbbb415a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.467 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7febd1d9b640 1 -- 172.21.15.120:0/913001589 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234304194 0 0) 0x7febd406fbc0 con 0x7febd40b5e50 2023-12-19T05:39:03.467 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7febd1d9b640 1 -- 172.21.15.120:0/913001589 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febbc003520 con 0x7febd40b5e50 2023-12-19T05:39:03.467 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.461+0000 7f8690823640 1 Processor -- start 2023-12-19T05:39:03.467 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.461+0000 7f8690823640 1 -- start start 2023-12-19T05:39:03.467 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7febd259c640 1 -- 172.21.15.120:0/913001589 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febd414a150 msgr2=0x7febd414a5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T05:39:03.467 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7febd259c640 1 --2- 172.21.15.120:0/913001589 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febd414a150 0x7febd414a5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.467 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7febd259c640 1 -- 172.21.15.120:0/913001589 >> v1:172.21.15.155:6789/0 conn(0x7febd40b5e50 legacy=0x7febd406a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.468 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7febd259c640 1 -- 172.21.15.120:0/913001589 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd406a860 con 0x7febd40b8460 2023-12-19T05:39:03.468 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7fbbb88b2640 1 -- 172.21.15.120:0/3652547140 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867489706 0 0) 0x7fbbb406c9f0 con 0x7fbbb4149150 2023-12-19T05:39:03.468 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7fbbb88b2640 1 -- 172.21.15.120:0/3652547140 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb9c003520 con 0x7fbbb4149150 2023-12-19T05:39:03.468 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7fbbb88b2640 1 -- 172.21.15.120:0/3652547140 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878313609 0 0) 0x7fbbb40b7e40 con 0x7fbbb40b2bb0 2023-12-19T05:39:03.468 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7fbbb88b2640 1 -- 172.21.15.120:0/3652547140 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb406c9f0 con 0x7fbbb40b2bb0 2023-12-19T05:39:03.468 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7fbbba0b5640 1 -- 172.21.15.120:0/3652547140 >> v1:172.21.15.155:6789/0 conn(0x7fbbb4149150 legacy=0x7fbbb406c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.468 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7fbbba0b5640 1 -- 172.21.15.120:0/3652547140 >> v1:172.21.15.120:6789/0 conn(0x7fbbb40b2bb0 legacy=0x7fbbb406f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.468 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.462+0000 7fbbba0b5640 1 -- 172.21.15.120:0/3652547140 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb40b5d10 con 0x7fbbb406eaf0 2023-12-19T05:39:03.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.463+0000 7f8690823640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f86840eeb10 0x7f8684038890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.463+0000 7f8690823640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8684006ed0 0x7f86840f3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.463+0000 7f8690823640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868403c710 con 0x7f86840f2c60 2023-12-19T05:39:03.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.463+0000 7f8690823640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86840f2840 con 0x7f8684006ed0 2023-12-19T05:39:03.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.463+0000 7f8690823640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8684038dd0 con 0x7f86840eeb10 2023-12-19T05:39:03.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.463+0000 7f868ad9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8684006ed0 0x7f86840f3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.463+0000 7f868ad9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8684006ed0 0x7f86840f3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45224/0 (socket says 172.21.15.120:45224) 2023-12-19T05:39:03.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.463+0000 7f279807d640 1 Processor -- start 2023-12-19T05:39:03.470 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.464+0000 7fbbba0b5640 1 --2- 172.21.15.120:0/3652547140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb406eaf0 0x7fbbb415a610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009d90 tx=0x7fbbac02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6884803004228e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.470 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.464+0000 7f279807d640 1 -- start start 2023-12-19T05:39:03.470 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.464+0000 7febd259c640 1 --2- 172.21.15.120:0/913001589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd40b8460 0x7febd4070790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7febcc00aea0 tx=0x7febcc02e150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac40955b571bbcd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.471 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.464+0000 7febd1d9b640 1 -- 172.21.15.120:0/913001589 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc02ecf0 con 0x7febd40b8460 2023-12-19T05:39:03.471 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.464+0000 7fbbb88b2640 1 -- 172.21.15.120:0/3652547140 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac02cd10 con 0x7fbbb406eaf0 2023-12-19T05:39:03.471 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.464+0000 7febd1d9b640 1 -- 172.21.15.120:0/913001589 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febcc02ee50 con 0x7febd40b8460 2023-12-19T05:39:03.471 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.464+0000 7febd1d9b640 1 -- 172.21.15.120:0/913001589 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc008660 con 0x7febd40b8460 2023-12-19T05:39:03.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.464+0000 7fbbb88b2640 1 -- 172.21.15.120:0/3652547140 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac02ce70 con 0x7fbbb406eaf0 2023-12-19T05:39:03.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.464+0000 7fbbb88b2640 1 -- 172.21.15.120:0/3652547140 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac034640 con 0x7fbbb406eaf0 2023-12-19T05:39:03.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.463+0000 7f868ad9d640 1 -- 172.21.15.120:0/2160918348 learned_addr learned my addr 172.21.15.120:0/2160918348 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.463+0000 7f8689d9b640 1 --2- 172.21.15.120:0/2160918348 >> v2:172.21.15.155:3300/0 conn(0x7f86840eeb10 0x7f8684038890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.463+0000 7f868ad9d640 1 -- 172.21.15.120:0/2160918348 >> v2:172.21.15.155:3300/0 conn(0x7f86840eeb10 msgr2=0x7f8684038890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.463+0000 7f868ad9d640 1 --2- 172.21.15.120:0/2160918348 >> v2:172.21.15.155:3300/0 conn(0x7f86840eeb10 0x7f8684038890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.463+0000 7f868ad9d640 1 -- 172.21.15.120:0/2160918348 >> v1:172.21.15.155:6789/0 conn(0x7f86840f2c60 legacy=0x7f86840397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.463+0000 7f868ad9d640 1 -- 172.21.15.120:0/2160918348 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840eefa0 con 0x7f8684006ed0 2023-12-19T05:39:03.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.464+0000 7f868ad9d640 1 --2- 172.21.15.120:0/2160918348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8684006ed0 0x7f86840f3440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f868c069710 tx=0x7f868c0948a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b25541632d39891 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7f868959a640 1 -- 172.21.15.120:0/2160918348 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c06cea0 con 0x7f8684006ed0 2023-12-19T05:39:03.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7febd9147640 1 -- 172.21.15.120:0/913001589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd40b8460 msgr2=0x7febd4070790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7febd9147640 1 --2- 172.21.15.120:0/913001589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd40b8460 0x7febd4070790 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7febcc00aea0 tx=0x7febcc02e150 comp rx=0 tx=0).stop 2023-12-19T05:39:03.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7f93f5e96640 1 Processor -- start 2023-12-19T05:39:03.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7f93f5e96640 1 -- start start 2023-12-19T05:39:03.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.464+0000 7f8a630fa640 1 Processor -- start 2023-12-19T05:39:03.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.464+0000 7f8a630fa640 1 -- start start 2023-12-19T05:39:03.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7f2795e19640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f27900b5d90 0x7f2790070540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49640/0 (socket says 172.21.15.120:49640) 2023-12-19T05:39:03.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3652547140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb406eaf0 msgr2=0x7fbbb415a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7fbbbbb18640 1 --2- 172.21.15.120:0/3652547140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb406eaf0 0x7fbbb415a610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009d90 tx=0x7fbbac02bf60 comp rx=0 tx=0).stop 2023-12-19T05:39:03.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3652547140 shutdown_connections 2023-12-19T05:39:03.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7fbbbbb18640 1 --2- 172.21.15.120:0/3652547140 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb406eaf0 0x7fbbb415a610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3652547140 >> 172.21.15.120:0/3652547140 conn(0x7fbbb40bbf70 msgr2=0x7fbbb40bc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.476 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7f8a630fa640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8a54007260 0x7f8a5403b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.476 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7f8a630fa640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8a540cd2f0 0x7f8a540cd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.476 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7f8a630fa640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a5403db80 con 0x7f8a5400b0b0 2023-12-19T05:39:03.476 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7f8a630fa640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5403c210 con 0x7f8a540cd2f0 2023-12-19T05:39:03.476 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7f8a630fa640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5403bb70 con 0x7f8a54007260 2023-12-19T05:39:03.477 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3652547140 shutdown_connections 2023-12-19T05:39:03.477 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f22c2631640 1 Processor -- start 2023-12-19T05:39:03.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f8a628f9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8a540cd2f0 0x7f8a540cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f8a628f9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8a540cd2f0 0x7f8a540cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45228/0 (socket says 172.21.15.120:45228) 2023-12-19T05:39:03.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f8a628f9640 1 -- 172.21.15.120:0/1896919454 learned_addr learned my addr 172.21.15.120:0/1896919454 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f22c2631640 1 -- start start 2023-12-19T05:39:03.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7febd9147640 1 -- 172.21.15.120:0/913001589 shutdown_connections 2023-12-19T05:39:03.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7febd9147640 1 --2- 172.21.15.120:0/913001589 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febd414a150 0x7febd414a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7febd9147640 1 --2- 172.21.15.120:0/913001589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd40b8460 0x7febd4070790 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7febd9147640 1 -- 172.21.15.120:0/913001589 >> 172.21.15.120:0/913001589 conn(0x7febd40b8b90 msgr2=0x7febd40b8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f8a618f7640 1 --2- 172.21.15.120:0/1896919454 >> v2:172.21.15.155:3300/0 conn(0x7f8a54007260 0x7f8a5403b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f93f5e96640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f93f006da70 0x7f93f01429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f93f5e96640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93f00b37a0 0x7f93f01532a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f93f5e96640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f006e690 con 0x7f93f0142ee0 2023-12-19T05:39:03.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f93f5e96640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f006ebc0 con 0x7f93f006da70 2023-12-19T05:39:03.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f93f5e96640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f00b3db0 con 0x7f93f00b37a0 2023-12-19T05:39:03.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3652547140 wait complete. 2023-12-19T05:39:03.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7f2795e19640 1 -- 172.21.15.120:0/190193278 learned_addr learned my addr 172.21.15.120:0/190193278 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:03.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f279807d640 1 --2- 172.21.15.120:0/190193278 >> v2:172.21.15.155:3300/0 conn(0x7f27900b6170 0x7f27900b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f279807d640 1 --2- 172.21.15.120:0/190193278 >> v2:172.21.15.120:3300/0 conn(0x7f279006d0b0 0x7f279006a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f279807d640 1 -- 172.21.15.120:0/190193278 --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f279006fc80 con 0x7f27900b5d90 2023-12-19T05:39:03.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f279807d640 1 -- 172.21.15.120:0/190193278 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2790070c50 con 0x7f279006d0b0 2023-12-19T05:39:03.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f279807d640 1 -- 172.21.15.120:0/190193278 --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f279006f650 con 0x7f27900b6170 2023-12-19T05:39:03.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f2795618640 1 --2- 172.21.15.120:0/190193278 >> v2:172.21.15.155:3300/0 conn(0x7f27900b6170 0x7f27900b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7f868959a640 1 -- 172.21.15.120:0/2160918348 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c09a8c0 con 0x7f8684006ed0 2023-12-19T05:39:03.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.465+0000 7f868959a640 1 -- 172.21.15.120:0/2160918348 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c09acf0 con 0x7f8684006ed0 2023-12-19T05:39:03.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f8690823640 1 -- 172.21.15.120:0/2160918348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8684006ed0 msgr2=0x7f86840f3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f279661a640 1 --2- 172.21.15.120:0/190193278 >> v2:172.21.15.120:3300/0 conn(0x7f279006d0b0 0x7f279006a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.483 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f8a610f6640 1 -- 172.21.15.120:0/1896919454 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425921284 0 0) 0x7f8a5403db80 con 0x7f8a5400b0b0 2023-12-19T05:39:03.483 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f8a610f6640 1 -- 172.21.15.120:0/1896919454 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a48003520 con 0x7f8a5400b0b0 2023-12-19T05:39:03.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f8690823640 1 --2- 172.21.15.120:0/2160918348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8684006ed0 0x7f86840f3440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f868c069710 tx=0x7f868c0948a0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f8690823640 1 -- 172.21.15.120:0/2160918348 shutdown_connections 2023-12-19T05:39:03.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f8690823640 1 --2- 172.21.15.120:0/2160918348 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8684006ed0 0x7f86840f3440 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f8690823640 1 --2- 172.21.15.120:0/2160918348 >> v2:172.21.15.155:3300/0 conn(0x7f86840eeb10 0x7f8684038890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f8690823640 1 -- 172.21.15.120:0/2160918348 >> 172.21.15.120:0/2160918348 conn(0x7f868403ee50 msgr2=0x7f868403f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f8a618f7640 1 -- 172.21.15.120:0/1896919454 >> v2:172.21.15.120:3300/0 conn(0x7f8a540cd2f0 msgr2=0x7f8a540cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.485 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f8a618f7640 1 --2- 172.21.15.120:0/1896919454 >> v2:172.21.15.120:3300/0 conn(0x7f8a540cd2f0 0x7f8a540cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.485 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f8a618f7640 1 -- 172.21.15.120:0/1896919454 >> v1:172.21.15.155:6789/0 conn(0x7f8a5400b0b0 legacy=0x7f8a540c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.485 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f8a618f7640 1 -- 172.21.15.120:0/1896919454 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a540076c0 con 0x7f8a54007260 2023-12-19T05:39:03.485 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f22c2631640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22bc0b7d90 0x7f22bc144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.485 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7febd9147640 1 -- 172.21.15.120:0/913001589 shutdown_connections 2023-12-19T05:39:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f2795618640 1 -- 172.21.15.120:0/190193278 >> v2:172.21.15.120:3300/0 conn(0x7f279006d0b0 msgr2=0x7f279006a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f2795618640 1 --2- 172.21.15.120:0/190193278 >> v2:172.21.15.120:3300/0 conn(0x7f279006d0b0 0x7f279006a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f2795618640 1 -- 172.21.15.120:0/190193278 >> v1:172.21.15.120:6789/0 conn(0x7f27900b5d90 legacy=0x7f2790070540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f2795618640 1 -- 172.21.15.120:0/190193278 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f279006f090 con 0x7f27900b6170 2023-12-19T05:39:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.468+0000 7f2795618640 1 --2- 172.21.15.120:0/190193278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27900b6170 0x7f27900b2d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f27900b9a40 tx=0x7f278002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87b101234cc193d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7fbbbbb18640 1 Processor -- start 2023-12-19T05:39:03.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.468+0000 7fbbbbb18640 1 -- start start 2023-12-19T05:39:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f8690823640 1 -- 172.21.15.120:0/2160918348 shutdown_connections 2023-12-19T05:39:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f8690823640 1 -- 172.21.15.120:0/2160918348 wait complete. 2023-12-19T05:39:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f22c2631640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f22bc145010 0x7f22bc14b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f22c2631640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc0b96b0 con 0x7f22bc0b79b0 2023-12-19T05:39:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f22c2631640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc14ae10 con 0x7f22bc145010 2023-12-19T05:39:03.487 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f22c2631640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0bacc0 con 0x7f22bc0b7d90 2023-12-19T05:39:03.488 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f22bbfff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f22bc0b79b0 0x7f22bc0b8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:39904/0 (socket says 172.21.15.120:39904) 2023-12-19T05:39:03.488 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f22bbfff640 1 -- 172.21.15.120:0/2623784290 learned_addr learned my addr 172.21.15.120:0/2623784290 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:03.488 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f22bb7fe640 1 --2- 172.21.15.120:0/2623784290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22bc0b7d90 0x7f22bc144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.488 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f22bb7fe640 1 -- 172.21.15.120:0/2623784290 >> v2:172.21.15.120:3300/0 conn(0x7f22bc145010 msgr2=0x7f22bc14b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.488 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f22bb7fe640 1 --2- 172.21.15.120:0/2623784290 >> v2:172.21.15.120:3300/0 conn(0x7f22bc145010 0x7f22bc14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.488 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f22bb7fe640 1 -- 172.21.15.120:0/2623784290 >> v1:172.21.15.155:6789/0 conn(0x7f22bc0b79b0 legacy=0x7f22bc0b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.488 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f22bb7fe640 1 -- 172.21.15.120:0/2623784290 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0b81d0 con 0x7f22bc0b7d90 2023-12-19T05:39:03.488 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7fd3649e0640 1 Processor -- start 2023-12-19T05:39:03.488 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7fd3649e0640 1 -- start start 2023-12-19T05:39:03.489 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f93effff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93f00b37a0 0x7f93f01532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.489 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f93ef7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f93f006da70 0x7f93f01429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.489 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f93effff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93f00b37a0 0x7f93f01532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:44122/0 (socket says 172.21.15.120:44122) 2023-12-19T05:39:03.489 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f93effff640 1 -- 172.21.15.120:0/3167227205 learned_addr learned my addr 172.21.15.120:0/3167227205 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.489 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.466+0000 7f93effff640 1 -- 172.21.15.120:0/3167227205 >> v2:172.21.15.120:3300/0 conn(0x7f93f006da70 msgr2=0x7f93f01429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.489 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f93effff640 1 --2- 172.21.15.120:0/3167227205 >> v2:172.21.15.120:3300/0 conn(0x7f93f006da70 0x7f93f01429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.489 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f93effff640 1 -- 172.21.15.120:0/3167227205 >> v1:172.21.15.155:6789/0 conn(0x7f93f0142ee0 legacy=0x7f93f00b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f93effff640 1 -- 172.21.15.120:0/3167227205 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00b9f60 con 0x7f93f00b37a0 2023-12-19T05:39:03.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f93ef7fe640 1 --2- 172.21.15.120:0/3167227205 >> v2:172.21.15.120:3300/0 conn(0x7f93f006da70 0x7f93f01429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:03.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.468+0000 7f93effff640 1 --2- 172.21.15.120:0/3167227205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93f00b37a0 0x7f93f01532a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009e50 tx=0x7f93e802be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a48edba6abd9136 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7febd9147640 1 -- 172.21.15.120:0/913001589 wait complete. 2023-12-19T05:39:03.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.468+0000 7f2794e17640 1 -- 172.21.15.120:0/190193278 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780031640 con 0x7f27900b6170 2023-12-19T05:39:03.490 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.468+0000 7f2794e17640 1 -- 172.21.15.120:0/190193278 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27800317a0 con 0x7f27900b6170 2023-12-19T05:39:03.491 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.468+0000 7fd3649e0640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd358039dd0 0x7fd3580f2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.491 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.468+0000 7fd3649e0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd358007020 0x7fd3580e8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.491 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.468+0000 7f2794e17640 1 -- 172.21.15.120:0/190193278 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780031b70 con 0x7f27900b6170 2023-12-19T05:39:03.491 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.467+0000 7f22baffd640 1 -- 172.21.15.120:0/2623784290 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623799976 0 0) 0x7f22bc0b96b0 con 0x7f22bc0b79b0 2023-12-19T05:39:03.492 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.468+0000 7f93eeffd640 1 -- 172.21.15.120:0/3167227205 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e802ca10 con 0x7f93f00b37a0 2023-12-19T05:39:03.492 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.468+0000 7f93eeffd640 1 -- 172.21.15.120:0/3167227205 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e802cb70 con 0x7f93f00b37a0 2023-12-19T05:39:03.492 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbbbb18640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbb406eaf0 0x7fbbb414da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.493 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbbbb18640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb40b2bb0 0x7fbbb40b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.493 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbbbb18640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbb4149150 0x7fbbb4142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.493 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbbbb18640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb414df40 con 0x7fbbb40b2bb0 2023-12-19T05:39:03.493 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbbbb18640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb414d570 con 0x7fbbb406eaf0 2023-12-19T05:39:03.493 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbbbb18640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb414f430 con 0x7fbbb4149150 2023-12-19T05:39:03.493 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbb98b4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbb406eaf0 0x7fbbb414da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.494 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.468+0000 7f8a618f7640 1 --2- 172.21.15.120:0/1896919454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a54007260 0x7f8a5403b630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a5403caf0 tx=0x7f8a5802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac8273231ea2ef42 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.494 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f8a610f6640 1 -- 172.21.15.120:0/1896919454 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5802e070 con 0x7f8a54007260 2023-12-19T05:39:03.494 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f8a610f6640 1 -- 172.21.15.120:0/1896919454 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a580315a0 con 0x7f8a54007260 2023-12-19T05:39:03.494 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f8a610f6640 1 -- 172.21.15.120:0/1896919454 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5802e070 con 0x7f8a54007260 2023-12-19T05:39:03.495 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbb90b3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb40b2bb0 0x7fbbb40b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.495 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f22bb7fe640 1 --2- 172.21.15.120:0/2623784290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22bc0b7d90 0x7f22bc144ad0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0097a0 tx=0x7f22ac0340c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e453ab65d0e8382e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbb90b3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb40b2bb0 0x7fbbb40b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45254/0 (socket says 172.21.15.120:45254) 2023-12-19T05:39:03.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbb90b3640 1 -- 172.21.15.120:0/3188977303 learned_addr learned my addr 172.21.15.120:0/3188977303 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.496 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbba0b5640 1 --2- 172.21.15.120:0/3188977303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbb4149150 0x7fbbb4142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f22baffd640 1 -- 172.21.15.120:0/2623784290 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac034e70 con 0x7f22bc0b7d90 2023-12-19T05:39:03.497 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f93eeffd640 1 -- 172.21.15.120:0/3167227205 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e80343f0 con 0x7f93f00b37a0 2023-12-19T05:39:03.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7febd9147640 1 Processor -- start 2023-12-19T05:39:03.498 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f8690823640 1 Processor -- start 2023-12-19T05:39:03.499 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f279807d640 1 -- 172.21.15.120:0/190193278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27900b6170 msgr2=0x7f27900b2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.499 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f279807d640 1 --2- 172.21.15.120:0/190193278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27900b6170 0x7f27900b2d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f27900b9a40 tx=0x7f278002b8f0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.499 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f22baffd640 1 -- 172.21.15.120:0/2623784290 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac03c440 con 0x7f22bc0b7d90 2023-12-19T05:39:03.499 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f22baffd640 1 -- 172.21.15.120:0/2623784290 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac03c7d0 con 0x7f22bc0b7d90 2023-12-19T05:39:03.500 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f279807d640 1 -- 172.21.15.120:0/190193278 shutdown_connections 2023-12-19T05:39:03.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f279807d640 1 --2- 172.21.15.120:0/190193278 >> v2:172.21.15.120:3300/0 conn(0x7f279006d0b0 0x7f279006a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f279807d640 1 --2- 172.21.15.120:0/190193278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27900b6170 0x7f27900b2d40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f279807d640 1 -- 172.21.15.120:0/190193278 >> 172.21.15.120:0/190193278 conn(0x7f27900b8dd0 msgr2=0x7f27900b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f93f5e96640 1 -- 172.21.15.120:0/3167227205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93f00b37a0 msgr2=0x7f93f01532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.502 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f93f5e96640 1 --2- 172.21.15.120:0/3167227205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93f00b37a0 0x7f93f01532a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f93e8009e50 tx=0x7f93e802be70 comp rx=0 tx=0).stop 2023-12-19T05:39:03.502 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f8690823640 1 -- start start 2023-12-19T05:39:03.502 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbb98b4640 1 -- 172.21.15.120:0/3188977303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbb4149150 msgr2=0x7fbbb4142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.502 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbb98b4640 1 --2- 172.21.15.120:0/3188977303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbb4149150 0x7fbbb4142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.502 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbb98b4640 1 -- 172.21.15.120:0/3188977303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb40b2bb0 msgr2=0x7fbbb40b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbb98b4640 1 --2- 172.21.15.120:0/3188977303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb40b2bb0 0x7fbbb40b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fbbb98b4640 1 -- 172.21.15.120:0/3188977303 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac009a70 con 0x7fbbb406eaf0 2023-12-19T05:39:03.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f93f5e96640 1 -- 172.21.15.120:0/3167227205 shutdown_connections 2023-12-19T05:39:03.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f93f5e96640 1 --2- 172.21.15.120:0/3167227205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93f00b37a0 0x7f93f01532a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f93f5e96640 1 --2- 172.21.15.120:0/3167227205 >> v2:172.21.15.120:3300/0 conn(0x7f93f006da70 0x7f93f01429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7f93f5e96640 1 -- 172.21.15.120:0/3167227205 >> 172.21.15.120:0/3167227205 conn(0x7f93f00bac10 msgr2=0x7f93f00bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7f93f5e96640 1 -- 172.21.15.120:0/3167227205 shutdown_connections 2023-12-19T05:39:03.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7f93f5e96640 1 -- 172.21.15.120:0/3167227205 wait complete. 2023-12-19T05:39:03.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7fbbb90b3640 1 --2- 172.21.15.120:0/3188977303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb40b2bb0 0x7fbbb40b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:03.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.468+0000 7fd35ed9d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fd3580e9200 0x7fd35803cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49642/0 (socket says 172.21.15.120:49642) 2023-12-19T05:39:03.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.468+0000 7fd35ed9d640 1 -- 172.21.15.120:0/1904661066 learned_addr learned my addr 172.21.15.120:0/1904661066 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:03.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fd3649e0640 1 -- 172.21.15.120:0/1904661066 --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580ef1e0 con 0x7fd3580e9200 2023-12-19T05:39:03.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fd3649e0640 1 -- 172.21.15.120:0/1904661066 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35803c840 con 0x7fd358039dd0 2023-12-19T05:39:03.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7fd3649e0640 1 -- 172.21.15.120:0/1904661066 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35803bb70 con 0x7fd358007020 2023-12-19T05:39:03.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7fbbb98b4640 1 --2- 172.21.15.120:0/3188977303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbb406eaf0 0x7fbbb414da00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbba4001eb0 tx=0x7fbba400c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7fbbb27fc640 1 -- 172.21.15.120:0/3188977303 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba40052d0 con 0x7fbbb406eaf0 2023-12-19T05:39:03.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7fbbb27fc640 1 -- 172.21.15.120:0/3188977303 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba4005430 con 0x7fbbb406eaf0 2023-12-19T05:39:03.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7fbbb27fc640 1 -- 172.21.15.120:0/3188977303 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4003830 con 0x7fbbb406eaf0 2023-12-19T05:39:03.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7f8690823640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8684006ed0 0x7f8684031d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7f8690823640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86840eeb10 0x7f86840fec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7f8690823640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86840f2c60 0x7f86840fdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7f8690823640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840358c0 con 0x7f86840f2c60 2023-12-19T05:39:03.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.469+0000 7febd9147640 1 -- start start 2023-12-19T05:39:03.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7febd9147640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febd40b5e50 0x7febd40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7febd9147640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febd40b8460 0x7febd40ba490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7febd9147640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd414a150 0x7febd41e4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7febd9147640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd41422f0 con 0x7febd40b8460 2023-12-19T05:39:03.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7febd9147640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd40b3e80 con 0x7febd414a150 2023-12-19T05:39:03.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7febd9147640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd40ba000 con 0x7febd40b5e50 2023-12-19T05:39:03.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7f8690823640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840fd470 con 0x7f8684006ed0 2023-12-19T05:39:03.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7f8690823640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8684041750 con 0x7f86840eeb10 2023-12-19T05:39:03.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7febd2d9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febd40b5e50 0x7febd40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7f868a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8684006ed0 0x7f8684031d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7f868a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8684006ed0 0x7f8684031d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59618/0 (socket says 172.21.15.120:59618) 2023-12-19T05:39:03.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7f868a59c640 1 -- 172.21.15.120:0/4163813597 learned_addr learned my addr 172.21.15.120:0/4163813597 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7f868ad9d640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86840f2c60 0x7f86840fdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f8a630fa640 1 -- 172.21.15.120:0/1896919454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a54007260 msgr2=0x7f8a5403b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f8a630fa640 1 --2- 172.21.15.120:0/1896919454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a54007260 0x7f8a5403b630 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a5403caf0 tx=0x7f8a5802b840 comp rx=0 tx=0).stop 2023-12-19T05:39:03.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f8689d9b640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86840eeb10 0x7f86840fec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f868a59c640 1 -- 172.21.15.120:0/4163813597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86840eeb10 msgr2=0x7f86840fec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7fd35dd9b640 1 --2- 172.21.15.120:0/1904661066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd358007020 0x7fd3580e8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7fd35d59a640 1 -- 172.21.15.120:0/1904661066 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539228114 0 0) 0x7fd3580ef1e0 con 0x7fd3580e9200 2023-12-19T05:39:03.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7fd35d59a640 1 -- 172.21.15.120:0/1904661066 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd348003520 con 0x7fd3580e9200 2023-12-19T05:39:03.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7fd35e59c640 1 --2- 172.21.15.120:0/1904661066 >> v2:172.21.15.120:3300/0 conn(0x7fd358039dd0 0x7fd3580f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7fd35dd9b640 1 -- 172.21.15.120:0/1904661066 >> v2:172.21.15.120:3300/0 conn(0x7fd358039dd0 msgr2=0x7fd3580f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:03.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7fd35dd9b640 1 --2- 172.21.15.120:0/1904661066 >> v2:172.21.15.120:3300/0 conn(0x7fd358039dd0 0x7fd3580f2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.470+0000 7fd35dd9b640 1 -- 172.21.15.120:0/1904661066 >> v1:172.21.15.120:6789/0 conn(0x7fd3580e9200 legacy=0x7fd35803cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7fd35dd9b640 1 -- 172.21.15.120:0/1904661066 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580ef4c0 con 0x7fd358007020 2023-12-19T05:39:03.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3188977303 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb414f6b0 con 0x7fbbb406eaf0 2023-12-19T05:39:03.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3188977303 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb414f010 con 0x7fbbb406eaf0 2023-12-19T05:39:03.511 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f868a59c640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86840eeb10 0x7f86840fec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.511 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f868a59c640 1 -- 172.21.15.120:0/4163813597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86840f2c60 msgr2=0x7f86840fdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.511 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f868a59c640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86840f2c60 0x7f86840fdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.511 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f8a630fa640 1 -- 172.21.15.120:0/1896919454 shutdown_connections 2023-12-19T05:39:03.511 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f8a630fa640 1 --2- 172.21.15.120:0/1896919454 >> v2:172.21.15.120:3300/0 conn(0x7f8a540cd2f0 0x7f8a540cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.511 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f8a630fa640 1 --2- 172.21.15.120:0/1896919454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a54007260 0x7f8a5403b630 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.511 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f8a630fa640 1 -- 172.21.15.120:0/1896919454 >> 172.21.15.120:0/1896919454 conn(0x7f8a5403ef70 msgr2=0x7f8a5403f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.511 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f868a59c640 1 -- 172.21.15.120:0/4163813597 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840fe830 con 0x7f8684006ed0 2023-12-19T05:39:03.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f8a630fa640 1 -- 172.21.15.120:0/1896919454 shutdown_connections 2023-12-19T05:39:03.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f8689d9b640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86840eeb10 0x7f86840fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:03.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f868ad9d640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86840f2c60 0x7f86840fdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:03.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f8a630fa640 1 -- 172.21.15.120:0/1896919454 wait complete. 2023-12-19T05:39:03.513 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f279807d640 1 -- 172.21.15.120:0/190193278 shutdown_connections 2023-12-19T05:39:03.513 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f93f5e96640 1 Processor -- start 2023-12-19T05:39:03.513 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f93f5e96640 1 -- start start 2023-12-19T05:39:03.513 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7febd2d9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febd40b5e50 0x7febd40b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:44156/0 (socket says 172.21.15.120:44156) 2023-12-19T05:39:03.513 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7febd2d9d640 1 -- 172.21.15.120:0/520652674 learned_addr learned my addr 172.21.15.120:0/520652674 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7febd259c640 1 --2- 172.21.15.120:0/520652674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febd40b8460 0x7febd40ba490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7febd359e640 1 --2- 172.21.15.120:0/520652674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd414a150 0x7febd41e4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f279807d640 1 -- 172.21.15.120:0/190193278 wait complete. 2023-12-19T05:39:03.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.471+0000 7f868a59c640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8684006ed0 0x7f8684031d70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f867c00b3f0 tx=0x7f867c00b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f867affd640 1 -- 172.21.15.120:0/4163813597 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c011830 con 0x7f8684006ed0 2023-12-19T05:39:03.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f867affd640 1 -- 172.21.15.120:0/4163813597 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c011990 con 0x7f8684006ed0 2023-12-19T05:39:03.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f867affd640 1 -- 172.21.15.120:0/4163813597 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c011d40 con 0x7f8684006ed0 2023-12-19T05:39:03.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7fd35e59c640 1 --2- 172.21.15.120:0/1904661066 >> v2:172.21.15.120:3300/0 conn(0x7fd358039dd0 0x7fd3580f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:03.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7fd35dd9b640 1 --2- 172.21.15.120:0/1904661066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd358007020 0x7fd3580e8cc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd3600697d0 tx=0x7fd3600944c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a2d7aa256e7fd92 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f22c2631640 1 -- 172.21.15.120:0/2623784290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22bc0b7d90 msgr2=0x7f22bc144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f22c2631640 1 --2- 172.21.15.120:0/2623784290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22bc0b7d90 0x7f22bc144ad0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0097a0 tx=0x7f22ac0340c0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7febd359e640 1 -- 172.21.15.120:0/520652674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febd40b5e50 msgr2=0x7febd40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7febd359e640 1 --2- 172.21.15.120:0/520652674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febd40b5e50 0x7febd40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7febd359e640 1 -- 172.21.15.120:0/520652674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febd40b8460 msgr2=0x7febd40ba490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7febd359e640 1 --2- 172.21.15.120:0/520652674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febd40b8460 0x7febd40ba490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7febd359e640 1 -- 172.21.15.120:0/520652674 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc00ab80 con 0x7febd414a150 2023-12-19T05:39:03.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f22c2631640 1 -- 172.21.15.120:0/2623784290 shutdown_connections 2023-12-19T05:39:03.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f22c2631640 1 --2- 172.21.15.120:0/2623784290 >> v2:172.21.15.120:3300/0 conn(0x7f22bc145010 0x7f22bc14b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f22c2631640 1 --2- 172.21.15.120:0/2623784290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22bc0b7d90 0x7f22bc144ad0 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0097a0 tx=0x7f22ac0340c0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f22c2631640 1 -- 172.21.15.120:0/2623784290 >> 172.21.15.120:0/2623784290 conn(0x7f22bc0c0340 msgr2=0x7f22bc0c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f93f5e96640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93f006da70 0x7f93f006b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f93f5e96640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93f00b37a0 0x7f93f01dc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f93f5e96640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93f0142ee0 0x7f93f01dc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f93f5e96640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f006b5c0 con 0x7f93f00b37a0 2023-12-19T05:39:03.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f93f5e96640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f006ba70 con 0x7f93f006da70 2023-12-19T05:39:03.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f93f5e96640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0147600 con 0x7f93f0142ee0 2023-12-19T05:39:03.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f93ef7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93f006da70 0x7f93f006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f8a630fa640 1 Processor -- start 2023-12-19T05:39:03.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7fd35d59a640 1 -- 172.21.15.120:0/1904661066 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd354004f20 con 0x7fd358007020 2023-12-19T05:39:03.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7fd35d59a640 1 -- 172.21.15.120:0/1904661066 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd360097050 con 0x7fd358007020 2023-12-19T05:39:03.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7f22c2631640 1 -- 172.21.15.120:0/2623784290 shutdown_connections 2023-12-19T05:39:03.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7fbbb27fc640 1 -- 172.21.15.120:0/3188977303 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbba4003990 con 0x7fbbb406eaf0 2023-12-19T05:39:03.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7f279807d640 1 Processor -- start 2023-12-19T05:39:03.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f8690823640 1 -- 172.21.15.120:0/4163813597 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8684006720 con 0x7f8684006ed0 2023-12-19T05:39:03.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f8690823640 1 -- 172.21.15.120:0/4163813597 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86840ff190 con 0x7f8684006ed0 2023-12-19T05:39:03.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f93effff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93f0142ee0 0x7f93f01dc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f93e7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93f00b37a0 0x7f93f01dc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f93e7fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93f00b37a0 0x7f93f01dc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45296/0 (socket says 172.21.15.120:45296) 2023-12-19T05:39:03.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.472+0000 7f93e7fff640 1 -- 172.21.15.120:0/783444394 learned_addr learned my addr 172.21.15.120:0/783444394 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7f93ef7fe640 1 -- 172.21.15.120:0/783444394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93f0142ee0 msgr2=0x7f93f01dc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7f93ef7fe640 1 --2- 172.21.15.120:0/783444394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93f0142ee0 0x7f93f01dc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7f93ef7fe640 1 -- 172.21.15.120:0/783444394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93f00b37a0 msgr2=0x7f93f01dc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7f93ef7fe640 1 --2- 172.21.15.120:0/783444394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93f00b37a0 0x7f93f01dc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7f93ef7fe640 1 -- 172.21.15.120:0/783444394 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e000d8a0 con 0x7f93f006da70 2023-12-19T05:39:03.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7f93effff640 1 --2- 172.21.15.120:0/783444394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93f0142ee0 0x7f93f01dc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:03.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7f93e7fff640 1 --2- 172.21.15.120:0/783444394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93f00b37a0 0x7f93f01dc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:03.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7f93ef7fe640 1 --2- 172.21.15.120:0/783444394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93f006da70 0x7f93f006b080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f93e000b390 tx=0x7f93e000b850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7fbbb27fc640 1 --2- 172.21.15.120:0/3188977303 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbba006a460 0x7fbba006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7fbbb27fc640 1 -- 172.21.15.120:0/3188977303 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbba4087ed0 con 0x7fbbb406eaf0 2023-12-19T05:39:03.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3188977303 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb4074010 con 0x7fbbb406eaf0 2023-12-19T05:39:03.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7f8a630fa640 1 -- start start 2023-12-19T05:39:03.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7febd359e640 1 --2- 172.21.15.120:0/520652674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd414a150 0x7febd41e4830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7febc800b410 tx=0x7febc800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7f8690823640 1 -- 172.21.15.120:0/4163813597 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8684005330 con 0x7f8684006ed0 2023-12-19T05:39:03.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7fd35d59a640 1 -- 172.21.15.120:0/1904661066 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36006cea0 con 0x7fd358007020 2023-12-19T05:39:03.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7fbbb90b3640 1 --2- 172.21.15.120:0/3188977303 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbba006a460 0x7fbba006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.524 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7f93ecff9640 1 -- 172.21.15.120:0/783444394 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e001b6a0 con 0x7f93f006da70 2023-12-19T05:39:03.524 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7f93f5e96640 1 -- 172.21.15.120:0/783444394 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e8009b30 con 0x7f93f006da70 2023-12-19T05:39:03.524 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7febbb7fe640 1 -- 172.21.15.120:0/520652674 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8011830 con 0x7febd414a150 2023-12-19T05:39:03.524 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7febbb7fe640 1 -- 172.21.15.120:0/520652674 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc8011990 con 0x7febd414a150 2023-12-19T05:39:03.524 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7febbb7fe640 1 -- 172.21.15.120:0/520652674 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8011830 con 0x7febd414a150 2023-12-19T05:39:03.524 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7f93f5e96640 1 -- 172.21.15.120:0/783444394 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f0147290 con 0x7f93f006da70 2023-12-19T05:39:03.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7f867affd640 1 -- 172.21.15.120:0/4163813597 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f867c01a400 con 0x7f8684006ed0 2023-12-19T05:39:03.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7f22c2631640 1 -- 172.21.15.120:0/2623784290 wait complete. 2023-12-19T05:39:03.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7fbbb90b3640 1 --2- 172.21.15.120:0/3188977303 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbba006a460 0x7fbba006c920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4131c60 tx=0x7fbba8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.473+0000 7f279807d640 1 -- start start 2023-12-19T05:39:03.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7fd3649e0640 1 -- 172.21.15.120:0/1904661066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd358007020 msgr2=0x7fd3580e8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.474+0000 7fd3649e0640 1 --2- 172.21.15.120:0/1904661066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd358007020 0x7fd3580e8cc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd3600697d0 tx=0x7fd3600944c0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a630fa640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a54007260 0x7f8a540ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a630fa640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a5400b0b0 0x7f8a540de830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.527 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a630fa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a540cd2f0 0x7f8a5416a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.527 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a630fa640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540da300 con 0x7f8a5400b0b0 2023-12-19T05:39:03.527 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a630fa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540defc0 con 0x7f8a540cd2f0 2023-12-19T05:39:03.527 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a630fa640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a540ca9a0 con 0x7f8a54007260 2023-12-19T05:39:03.527 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f867affd640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f866c06a4b0 0x7f866c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.527 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f867affd640 1 -- 172.21.15.120:0/4163813597 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f867c088540 con 0x7f8684006ed0 2023-12-19T05:39:03.528 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a618f7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a5400b0b0 0x7f8a540de830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.528 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a618f7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a5400b0b0 0x7f8a540de830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45306/0 (socket says 172.21.15.120:45306) 2023-12-19T05:39:03.528 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f93ecff9640 1 -- 172.21.15.120:0/783444394 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e001b800 con 0x7f93f006da70 2023-12-19T05:39:03.528 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f93ecff9640 1 -- 172.21.15.120:0/783444394 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e001bb70 con 0x7f93f006da70 2023-12-19T05:39:03.528 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a618f7640 1 -- 172.21.15.120:0/2523306873 learned_addr learned my addr 172.21.15.120:0/2523306873 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.528 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a620f8640 1 --2- 172.21.15.120:0/2523306873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a54007260 0x7f8a540ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.529 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a628f9640 1 --2- 172.21.15.120:0/2523306873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a540cd2f0 0x7f8a5416a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.529 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8689d9b640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f866c06a4b0 0x7f866c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.529 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7febd9147640 1 -- 172.21.15.120:0/520652674 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd40b9cb0 con 0x7febd414a150 2023-12-19T05:39:03.529 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7febd9147640 1 -- 172.21.15.120:0/520652674 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd40b45a0 con 0x7febd414a150 2023-12-19T05:39:03.529 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f22c2631640 1 Processor -- start 2023-12-19T05:39:03.530 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a618f7640 1 -- 172.21.15.120:0/2523306873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a54007260 msgr2=0x7f8a540ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.530 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a618f7640 1 --2- 172.21.15.120:0/2523306873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a54007260 0x7f8a540ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.530 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a618f7640 1 -- 172.21.15.120:0/2523306873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a540cd2f0 msgr2=0x7f8a5416a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.530 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.475+0000 7f8a618f7640 1 --2- 172.21.15.120:0/2523306873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a540cd2f0 0x7f8a5416a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.530 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f8a618f7640 1 -- 172.21.15.120:0/2523306873 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a58009400 con 0x7f8a5400b0b0 2023-12-19T05:39:03.530 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f279807d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f279006d0b0 0x7f279013a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.531 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f22c2631640 1 -- start start 2023-12-19T05:39:03.531 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f279807d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27900b5d90 0x7f27900b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f279807d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27900b6170 0x7f27901dfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f2795e19640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f279006d0b0 0x7f279013a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f2795e19640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f279006d0b0 0x7f279013a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45320/0 (socket says 172.21.15.120:45320) 2023-12-19T05:39:03.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f2795e19640 1 -- 172.21.15.120:0/3417309805 learned_addr learned my addr 172.21.15.120:0/3417309805 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f279807d640 1 -- 172.21.15.120:0/3417309805 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27900b7210 con 0x7f279006d0b0 2023-12-19T05:39:03.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f279807d640 1 -- 172.21.15.120:0/3417309805 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27901dff90 con 0x7f27900b5d90 2023-12-19T05:39:03.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f279807d640 1 -- 172.21.15.120:0/3417309805 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2790143ec0 con 0x7f27900b6170 2023-12-19T05:39:03.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f8689d9b640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f866c06a4b0 0x7f866c06c970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8684100620 tx=0x7f8680008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f8a618f7640 1 --2- 172.21.15.120:0/2523306873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a5400b0b0 0x7f8a540de830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8a58000c00 tx=0x7f8a580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f279661a640 1 --2- 172.21.15.120:0/3417309805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27900b6170 0x7f27901dfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f2795618640 1 --2- 172.21.15.120:0/3417309805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27900b5d90 0x7f27900b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f93f5e96640 1 -- 172.21.15.120:0/783444394 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d4005250 con 0x7f93f006da70 2023-12-19T05:39:03.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f8a52ffd640 1 -- 172.21.15.120:0/2523306873 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5802e070 con 0x7f8a5400b0b0 2023-12-19T05:39:03.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7febb97fa640 1 -- 172.21.15.120:0/520652674 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac005250 con 0x7febd414a150 2023-12-19T05:39:03.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f2795e19640 1 -- 172.21.15.120:0/3417309805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27900b6170 msgr2=0x7f27901dfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f2795e19640 1 --2- 172.21.15.120:0/3417309805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27900b6170 0x7f27901dfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f2795e19640 1 -- 172.21.15.120:0/3417309805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27900b5d90 msgr2=0x7f27900b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f2795e19640 1 --2- 172.21.15.120:0/3417309805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27900b5d90 0x7f27900b6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f2795e19640 1 -- 172.21.15.120:0/3417309805 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2780009400 con 0x7f279006d0b0 2023-12-19T05:39:03.535 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7fd3649e0640 1 -- 172.21.15.120:0/1904661066 shutdown_connections 2023-12-19T05:39:03.535 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7fd3649e0640 1 --2- 172.21.15.120:0/1904661066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd358007020 0x7fd3580e8cc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.535 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7fd3649e0640 1 --2- 172.21.15.120:0/1904661066 >> v2:172.21.15.120:3300/0 conn(0x7fd358039dd0 0x7fd3580f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.535 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7fd3649e0640 1 -- 172.21.15.120:0/1904661066 >> 172.21.15.120:0/1904661066 conn(0x7fd35803efa0 msgr2=0x7fd35803f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.535 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f8a630fa640 1 -- 172.21.15.120:0/2523306873 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a540ded70 con 0x7f8a5400b0b0 2023-12-19T05:39:03.535 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f8a52ffd640 1 -- 172.21.15.120:0/2523306873 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a58032430 con 0x7f8a5400b0b0 2023-12-19T05:39:03.535 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f8a630fa640 1 -- 172.21.15.120:0/2523306873 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a540066f0 con 0x7f8a5400b0b0 2023-12-19T05:39:03.536 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7fd3649e0640 1 -- 172.21.15.120:0/1904661066 shutdown_connections 2023-12-19T05:39:03.536 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7fd3649e0640 1 -- 172.21.15.120:0/1904661066 wait complete. 2023-12-19T05:39:03.536 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.476+0000 7f2795e19640 1 --2- 172.21.15.120:0/3417309805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f279006d0b0 0x7f279013a900 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f278c00c4d0 tx=0x7f278c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.537 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.477+0000 7f27867fc640 1 -- 172.21.15.120:0/3417309805 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c005ce0 con 0x7f279006d0b0 2023-12-19T05:39:03.537 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.477+0000 7f27867fc640 1 -- 172.21.15.120:0/3417309805 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278c005e40 con 0x7f279006d0b0 2023-12-19T05:39:03.537 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.477+0000 7f279807d640 1 -- 172.21.15.120:0/3417309805 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2790143b90 con 0x7f279006d0b0 2023-12-19T05:39:03.537 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.477+0000 7f279807d640 1 -- 172.21.15.120:0/3417309805 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2790142540 con 0x7f279006d0b0 2023-12-19T05:39:03.537 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.477+0000 7f27867fc640 1 -- 172.21.15.120:0/3417309805 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c007270 con 0x7f279006d0b0 2023-12-19T05:39:03.537 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.477+0000 7f8a52ffd640 1 -- 172.21.15.120:0/2523306873 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5802e070 con 0x7f8a5400b0b0 2023-12-19T05:39:03.537 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.477+0000 7f22c2631640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22bc0b79b0 0x7f22bc1470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.477+0000 7f8a630fa640 1 -- 172.21.15.120:0/2523306873 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a54005490 con 0x7f8a5400b0b0 2023-12-19T05:39:03.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.477+0000 7f22c2631640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22bc145010 0x7f22bc145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.477+0000 7f22c2631640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22bc1459b0 0x7f22bc0b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.477+0000 7f22c2631640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc147630 con 0x7f22bc0b79b0 2023-12-19T05:39:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.477+0000 7f22c2631640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc1deb30 con 0x7f22bc1459b0 2023-12-19T05:39:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.477+0000 7f22c2631640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc1df6b0 con 0x7f22bc145010 2023-12-19T05:39:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.478+0000 7f22bbfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22bc0b79b0 0x7f22bc1470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.478+0000 7f22bb7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22bc145010 0x7f22bc145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.478+0000 7f22bbfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22bc0b79b0 0x7f22bc1470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45336/0 (socket says 172.21.15.120:45336) 2023-12-19T05:39:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.478+0000 7f22bbfff640 1 -- 172.21.15.120:0/3326238575 learned_addr learned my addr 172.21.15.120:0/3326238575 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.478+0000 7f22c0bce640 1 --2- 172.21.15.120:0/3326238575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22bc1459b0 0x7f22bc0b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.478+0000 7f22bbfff640 1 -- 172.21.15.120:0/3326238575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22bc145010 msgr2=0x7f22bc145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.478+0000 7f22bbfff640 1 --2- 172.21.15.120:0/3326238575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22bc145010 0x7f22bc145470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.478+0000 7f22bbfff640 1 -- 172.21.15.120:0/3326238575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22bc1459b0 msgr2=0x7f22bc0b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.478+0000 7f22bbfff640 1 --2- 172.21.15.120:0/3326238575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22bc1459b0 0x7f22bc0b2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.478+0000 7f22bbfff640 1 -- 172.21.15.120:0/3326238575 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac009400 con 0x7f22bc0b79b0 2023-12-19T05:39:03.539 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.478+0000 7f22c0bce640 1 --2- 172.21.15.120:0/3326238575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22bc1459b0 0x7f22bc0b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:03.540 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.478+0000 7f22bbfff640 1 --2- 172.21.15.120:0/3326238575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22bc0b79b0 0x7f22bc1470f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f22b000c500 tx=0x7f22b000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.540 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.479+0000 7f8a52ffd640 1 -- 172.21.15.120:0/2523306873 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a580325a0 con 0x7f8a5400b0b0 2023-12-19T05:39:03.540 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.479+0000 7fd3649e0640 1 Processor -- start 2023-12-19T05:39:03.540 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.479+0000 7fd3649e0640 1 -- start start 2023-12-19T05:39:03.540 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.479+0000 7f279807d640 1 -- 172.21.15.120:0/3417309805 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2790066630 con 0x7f279006d0b0 2023-12-19T05:39:03.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.479+0000 7f8a52ffd640 1 --2- 172.21.15.120:0/2523306873 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8a4006a460 0x7f8a4006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.479+0000 7f8a52ffd640 1 -- 172.21.15.120:0/2523306873 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a580aa070 con 0x7f8a5400b0b0 2023-12-19T05:39:03.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.479+0000 7f8a620f8640 1 --2- 172.21.15.120:0/2523306873 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8a4006a460 0x7f8a4006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.479+0000 7fbbb27fc640 1 -- 172.21.15.120:0/3188977303 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbba4017080 con 0x7fbbb406eaf0 2023-12-19T05:39:03.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7f27867fc640 1 -- 172.21.15.120:0/3417309805 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f278c0073d0 con 0x7f279006d0b0 2023-12-19T05:39:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.479+0000 7fd3649e0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd358007020 0x7fd3580ff370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.479+0000 7fd3649e0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd358039dd0 0x7fd35802c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd3649e0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3580f14c0 0x7fd3580f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd3649e0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35802c5b0 con 0x7fd358007020 2023-12-19T05:39:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd3649e0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd358100320 con 0x7fd3580f14c0 2023-12-19T05:39:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd3649e0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580f2970 con 0x7fd358039dd0 2023-12-19T05:39:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd35e59c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd358007020 0x7fd3580ff370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd35dd9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd358039dd0 0x7fd35802c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd35ed9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3580f14c0 0x7fd3580f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd35dd9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd358039dd0 0x7fd35802c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:44214/0 (socket says 172.21.15.120:44214) 2023-12-19T05:39:03.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd35dd9b640 1 -- 172.21.15.120:0/2438697262 learned_addr learned my addr 172.21.15.120:0/2438697262 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:03.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7f8a620f8640 1 --2- 172.21.15.120:0/2523306873 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8a4006a460 0x7f8a4006c920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c068ba0 tx=0x7f8a5c072dc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7f27867fc640 1 --2- 172.21.15.120:0/3417309805 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f277406a480 0x7f277406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7f2795618640 1 --2- 172.21.15.120:0/3417309805 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f277406a480 0x7f277406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd35e59c640 1 -- 172.21.15.120:0/2438697262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd358039dd0 msgr2=0x7fd35802c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd35e59c640 1 --2- 172.21.15.120:0/2438697262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd358039dd0 0x7fd35802c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd35e59c640 1 -- 172.21.15.120:0/2438697262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3580f14c0 msgr2=0x7fd3580f04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd35e59c640 1 --2- 172.21.15.120:0/2438697262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3580f14c0 0x7fd3580f04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd35e59c640 1 -- 172.21.15.120:0/2438697262 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd350009400 con 0x7fd358007020 2023-12-19T05:39:03.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.480+0000 7fd35ed9d640 1 --2- 172.21.15.120:0/2438697262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3580f14c0 0x7fd3580f04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:03.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.481+0000 7f2795618640 1 --2- 172.21.15.120:0/3417309805 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f277406a480 0x7f277406c940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2780036000 tx=0x7f278003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.547 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.481+0000 7fd35e59c640 1 --2- 172.21.15.120:0/2438697262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd358007020 0x7fd3580ff370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd35000eb60 tx=0x7fd35000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.547 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.483+0000 7f27867fc640 1 -- 172.21.15.120:0/3417309805 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f278c0570f0 con 0x7f279006d0b0 2023-12-19T05:39:03.548 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.483+0000 7f22b8ff9640 1 -- 172.21.15.120:0/3326238575 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b0007560 con 0x7f22bc0b79b0 2023-12-19T05:39:03.548 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.483+0000 7fd34effd640 1 -- 172.21.15.120:0/2438697262 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35000ed70 con 0x7fd358007020 2023-12-19T05:39:03.548 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.483+0000 7fd3649e0640 1 -- 172.21.15.120:0/2438697262 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36004ef70 con 0x7fd358007020 2023-12-19T05:39:03.549 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.484+0000 7f22c2631640 1 -- 172.21.15.120:0/3326238575 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc148470 con 0x7f22bc0b79b0 2023-12-19T05:39:03.549 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.484+0000 7fd3649e0640 1 -- 172.21.15.120:0/2438697262 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3580efb60 con 0x7fd358007020 2023-12-19T05:39:03.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.484+0000 7f22c2631640 1 -- 172.21.15.120:0/3326238575 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc1df060 con 0x7f22bc0b79b0 2023-12-19T05:39:03.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.484+0000 7f867affd640 1 -- 172.21.15.120:0/4163813597 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f867c053ca0 con 0x7f8684006ed0 2023-12-19T05:39:03.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.484+0000 7f8a52ffd640 1 -- 172.21.15.120:0/2523306873 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8a58075530 con 0x7f8a5400b0b0 2023-12-19T05:39:03.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.485+0000 7fd3649e0640 1 -- 172.21.15.120:0/2438697262 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3580054c0 con 0x7fd358007020 2023-12-19T05:39:03.552 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.485+0000 7f22c2631640 1 -- 172.21.15.120:0/3326238575 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22bc04e080 con 0x7f22bc0b79b0 2023-12-19T05:39:03.552 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.485+0000 7f93ecff9640 1 -- 172.21.15.120:0/783444394 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f93e001bcd0 con 0x7f93f006da70 2023-12-19T05:39:03.553 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.485+0000 7febbb7fe640 1 -- 172.21.15.120:0/520652674 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7febc8011b00 con 0x7febd414a150 2023-12-19T05:39:03.553 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.486+0000 7f93ecff9640 1 --2- 172.21.15.120:0/783444394 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f93d006a500 0x7f93d006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.554 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.486+0000 7febbb7fe640 1 --2- 172.21.15.120:0/520652674 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7febc006a520 0x7febc006c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.554 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.486+0000 7febbb7fe640 1 -- 172.21.15.120:0/520652674 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febc80889c0 con 0x7febd414a150 2023-12-19T05:39:03.554 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.486+0000 7febd2d9d640 1 --2- 172.21.15.120:0/520652674 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7febc006a520 0x7febc006c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.555 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.486+0000 7f93ecff9640 1 -- 172.21.15.120:0/783444394 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93e0091040 con 0x7f93f006da70 2023-12-19T05:39:03.555 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.486+0000 7f93e7fff640 1 --2- 172.21.15.120:0/783444394 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f93d006a500 0x7f93d006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.555 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.487+0000 7febd2d9d640 1 --2- 172.21.15.120:0/520652674 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7febc006a520 0x7febc006c9e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7febc40049d0 tx=0x7febc40060d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.556 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.487+0000 7f93e7fff640 1 --2- 172.21.15.120:0/783444394 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f93d006a500 0x7f93d006c9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93f00733e0 tx=0x7f93d8009110 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.556 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.489+0000 7febbb7fe640 1 -- 172.21.15.120:0/520652674 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7febc8054050 con 0x7febd414a150 2023-12-19T05:39:03.557 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.490+0000 7f22b8ff9640 1 -- 172.21.15.120:0/3326238575 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b00047e0 con 0x7f22bc0b79b0 2023-12-19T05:39:03.557 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.490+0000 7f22b8ff9640 1 -- 172.21.15.120:0/3326238575 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b0004b50 con 0x7f22bc0b79b0 2023-12-19T05:39:03.558 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.491+0000 7f27867fc640 1 -- 172.21.15.120:0/3417309805 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f278c053430 con 0x7f279006d0b0 2023-12-19T05:39:03.558 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.491+0000 7fd34effd640 1 -- 172.21.15.120:0/2438697262 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35000eed0 con 0x7fd358007020 2023-12-19T05:39:03.558 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.491+0000 7fd34effd640 1 -- 172.21.15.120:0/2438697262 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35000cdf0 con 0x7fd358007020 2023-12-19T05:39:03.559 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.492+0000 7f22b8ff9640 1 -- 172.21.15.120:0/3326238575 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f22b0004cb0 con 0x7f22bc0b79b0 2023-12-19T05:39:03.559 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.493+0000 7f22b8ff9640 1 --2- 172.21.15.120:0/3326238575 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f22a806a430 0x7f22a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.560 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.494+0000 7f93ecff9640 1 -- 172.21.15.120:0/783444394 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f93e005c6c0 con 0x7f93f006da70 2023-12-19T05:39:03.560 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.493+0000 7f22b8ff9640 1 -- 172.21.15.120:0/3326238575 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22b0088660 con 0x7f22bc0b79b0 2023-12-19T05:39:03.561 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.493+0000 7fd34effd640 1 -- 172.21.15.120:0/2438697262 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd350004020 con 0x7fd358007020 2023-12-19T05:39:03.561 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.494+0000 7fd34effd640 1 --2- 172.21.15.120:0/2438697262 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd34006a430 0x7fd34006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:03.561 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.494+0000 7fd34effd640 1 -- 172.21.15.120:0/2438697262 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd350088ac0 con 0x7fd358007020 2023-12-19T05:39:03.562 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.494+0000 7f22bb7fe640 1 --2- 172.21.15.120:0/3326238575 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f22a806a430 0x7f22a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.562 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.494+0000 7fd35dd9b640 1 --2- 172.21.15.120:0/2438697262 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd34006a430 0x7fd34006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:03.562 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.495+0000 7fd35dd9b640 1 --2- 172.21.15.120:0/2438697262 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd34006a430 0x7fd34006c8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd360069560 tx=0x7fd36006e030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.563 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.495+0000 7f22bb7fe640 1 --2- 172.21.15.120:0/3326238575 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f22a806a430 0x7f22a806c8f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22ac03e000 tx=0x7f22ac038000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:03.563 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.500+0000 7f22b8ff9640 1 -- 172.21.15.120:0/3326238575 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f22b0053cf0 con 0x7f22bc0b79b0 2023-12-19T05:39:03.564 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.510+0000 7fd34effd640 1 -- 172.21.15.120:0/2438697262 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd350054140 con 0x7fd358007020 2023-12-19T05:39:03.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.874+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3188977303 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbbb4146fa0 con 0x7fbbb406eaf0 2023-12-19T05:39:03.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.875+0000 7fbbb27fc640 1 -- 172.21.15.120:0/3188977303 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbba4053440 con 0x7fbbb406eaf0 2023-12-19T05:39:03.877 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2023-12-19T05:39:03.879 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.878+0000 7f8690823640 1 -- 172.21.15.120:0/4163813597 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f86840008d0 con 0x7f8684006ed0 2023-12-19T05:39:03.879 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.878+0000 7f867affd640 1 -- 172.21.15.120:0/4163813597 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f867c0572c0 con 0x7f8684006ed0 2023-12-19T05:39:03.879 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2023-12-19T05:39:03.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.879+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3188977303 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbba006a460 msgr2=0x7fbba006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.879+0000 7fbbbbb18640 1 --2- 172.21.15.120:0/3188977303 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbba006a460 0x7fbba006c920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4131c60 tx=0x7fbba8009040 comp rx=0 tx=0).stop 2023-12-19T05:39:03.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.879+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3188977303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbb406eaf0 msgr2=0x7fbbb414da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.880+0000 7fbbbbb18640 1 --2- 172.21.15.120:0/3188977303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbb406eaf0 0x7fbbb414da00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbba4001eb0 tx=0x7fbba400c820 comp rx=0 tx=0).stop 2023-12-19T05:39:03.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.880+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3188977303 shutdown_connections 2023-12-19T05:39:03.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.880+0000 7fbbbbb18640 1 --2- 172.21.15.120:0/3188977303 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbba006a460 0x7fbba006c920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.880+0000 7fbbbbb18640 1 --2- 172.21.15.120:0/3188977303 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbbb4149150 0x7fbbb4142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.880+0000 7fbbbbb18640 1 --2- 172.21.15.120:0/3188977303 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbbb40b2bb0 0x7fbbb40b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.880+0000 7fbbbbb18640 1 --2- 172.21.15.120:0/3188977303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbbb406eaf0 0x7fbbb414da00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.880+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3188977303 >> 172.21.15.120:0/3188977303 conn(0x7fbbb40bbf70 msgr2=0x7fbbb40b86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.880+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3188977303 shutdown_connections 2023-12-19T05:39:03.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.880+0000 7fbbbbb18640 1 -- 172.21.15.120:0/3188977303 wait complete. 2023-12-19T05:39:03.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.881+0000 7f8678ff9640 1 -- 172.21.15.120:0/4163813597 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f866c06a4b0 msgr2=0x7f866c06c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.881+0000 7f8678ff9640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f866c06a4b0 0x7f866c06c970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8684100620 tx=0x7f8680008040 comp rx=0 tx=0).stop 2023-12-19T05:39:03.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.881+0000 7f8678ff9640 1 -- 172.21.15.120:0/4163813597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8684006ed0 msgr2=0x7f8684031d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.881+0000 7f8678ff9640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8684006ed0 0x7f8684031d70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f867c00b3f0 tx=0x7f867c00b8b0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.882+0000 7f8678ff9640 1 -- 172.21.15.120:0/4163813597 shutdown_connections 2023-12-19T05:39:03.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.882+0000 7f8678ff9640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f866c06a4b0 0x7f866c06c970 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.882+0000 7f8678ff9640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f86840f2c60 0x7f86840fdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.882+0000 7f8678ff9640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f86840eeb10 0x7f86840fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.882+0000 7f8678ff9640 1 --2- 172.21.15.120:0/4163813597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8684006ed0 0x7f8684031d70 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f867c00b3f0 tx=0x7f867c00b8b0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.882+0000 7f8678ff9640 1 -- 172.21.15.120:0/4163813597 >> 172.21.15.120:0/4163813597 conn(0x7f868403ee50 msgr2=0x7f868403cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.882+0000 7f8678ff9640 1 -- 172.21.15.120:0/4163813597 shutdown_connections 2023-12-19T05:39:03.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.882+0000 7f8678ff9640 1 -- 172.21.15.120:0/4163813597 wait complete. 2023-12-19T05:39:03.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.882+0000 7febb97fa640 1 -- 172.21.15.120:0/520652674 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7febac0057d0 con 0x7febd414a150 2023-12-19T05:39:03.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.882+0000 7febbb7fe640 1 -- 172.21.15.120:0/520652674 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7febc8015090 con 0x7febd414a150 2023-12-19T05:39:03.884 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2023-12-19T05:39:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.886+0000 7febb97fa640 1 -- 172.21.15.120:0/520652674 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7febc006a520 msgr2=0x7febc006c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.886+0000 7febb97fa640 1 --2- 172.21.15.120:0/520652674 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7febc006a520 0x7febc006c9e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7febc40049d0 tx=0x7febc40060d0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.886+0000 7febb97fa640 1 -- 172.21.15.120:0/520652674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd414a150 msgr2=0x7febd41e4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.886+0000 7febb97fa640 1 --2- 172.21.15.120:0/520652674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd414a150 0x7febd41e4830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7febc800b410 tx=0x7febc800b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.886+0000 7febb97fa640 1 -- 172.21.15.120:0/520652674 shutdown_connections 2023-12-19T05:39:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.886+0000 7febb97fa640 1 --2- 172.21.15.120:0/520652674 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7febc006a520 0x7febc006c9e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.886+0000 7febb97fa640 1 --2- 172.21.15.120:0/520652674 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7febd414a150 0x7febd41e4830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.886+0000 7febb97fa640 1 --2- 172.21.15.120:0/520652674 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7febd40b8460 0x7febd40ba490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.886+0000 7febb97fa640 1 --2- 172.21.15.120:0/520652674 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7febd40b5e50 0x7febd40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.886+0000 7febb97fa640 1 -- 172.21.15.120:0/520652674 >> 172.21.15.120:0/520652674 conn(0x7febd40b8b90 msgr2=0x7febd40b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.888 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.886+0000 7febb97fa640 1 -- 172.21.15.120:0/520652674 shutdown_connections 2023-12-19T05:39:03.888 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.886+0000 7febb97fa640 1 -- 172.21.15.120:0/520652674 wait complete. 2023-12-19T05:39:03.889 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.888+0000 7f8a630fa640 1 -- 172.21.15.120:0/2523306873 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8a540416c0 con 0x7f8a5400b0b0 2023-12-19T05:39:03.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.888+0000 7f8a52ffd640 1 -- 172.21.15.120:0/2523306873 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a58075530 con 0x7f8a5400b0b0 2023-12-19T05:39:03.890 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2023-12-19T05:39:03.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.892+0000 7f8a50ff9640 1 -- 172.21.15.120:0/2523306873 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8a4006a460 msgr2=0x7f8a4006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.892+0000 7f8a50ff9640 1 --2- 172.21.15.120:0/2523306873 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8a4006a460 0x7f8a4006c920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c068ba0 tx=0x7f8a5c072dc0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.892+0000 7f8a50ff9640 1 -- 172.21.15.120:0/2523306873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a5400b0b0 msgr2=0x7f8a540de830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.892+0000 7f8a50ff9640 1 --2- 172.21.15.120:0/2523306873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a5400b0b0 0x7f8a540de830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8a58000c00 tx=0x7f8a580046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.894 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.893+0000 7f8a50ff9640 1 -- 172.21.15.120:0/2523306873 shutdown_connections 2023-12-19T05:39:03.894 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.893+0000 7f8a50ff9640 1 --2- 172.21.15.120:0/2523306873 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8a4006a460 0x7f8a4006c920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.894 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.893+0000 7f8a50ff9640 1 --2- 172.21.15.120:0/2523306873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a540cd2f0 0x7f8a5416a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.893+0000 7f8a50ff9640 1 --2- 172.21.15.120:0/2523306873 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8a5400b0b0 0x7f8a540de830 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.893+0000 7f8a50ff9640 1 --2- 172.21.15.120:0/2523306873 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8a54007260 0x7f8a540ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.893+0000 7f8a50ff9640 1 -- 172.21.15.120:0/2523306873 >> 172.21.15.120:0/2523306873 conn(0x7f8a5403ef70 msgr2=0x7f8a54005f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.893+0000 7f8a50ff9640 1 -- 172.21.15.120:0/2523306873 shutdown_connections 2023-12-19T05:39:03.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.893+0000 7f8a50ff9640 1 -- 172.21.15.120:0/2523306873 wait complete. 2023-12-19T05:39:03.897 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.896+0000 7f279807d640 1 -- 172.21.15.120:0/3417309805 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f279004e080 con 0x7f279006d0b0 2023-12-19T05:39:03.897 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.896+0000 7f27867fc640 1 -- 172.21.15.120:0/3417309805 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f278c056a50 con 0x7f279006d0b0 2023-12-19T05:39:03.897 INFO:teuthology.orchestra.run.smithi120.stdout:55834574853 2023-12-19T05:39:03.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.899+0000 7f279807d640 1 -- 172.21.15.120:0/3417309805 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f277406a480 msgr2=0x7f277406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.900+0000 7f279807d640 1 --2- 172.21.15.120:0/3417309805 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f277406a480 0x7f277406c940 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2780036000 tx=0x7f278003c040 comp rx=0 tx=0).stop 2023-12-19T05:39:03.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.900+0000 7f279807d640 1 -- 172.21.15.120:0/3417309805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f279006d0b0 msgr2=0x7f279013a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.900+0000 7f279807d640 1 --2- 172.21.15.120:0/3417309805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f279006d0b0 0x7f279013a900 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f278c00c4d0 tx=0x7f278c00c990 comp rx=0 tx=0).stop 2023-12-19T05:39:03.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-12-19T05:39:03.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-12-19T05:39:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.900+0000 7f279807d640 1 -- 172.21.15.120:0/3417309805 shutdown_connections 2023-12-19T05:39:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.900+0000 7f279807d640 1 --2- 172.21.15.120:0/3417309805 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f277406a480 0x7f277406c940 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.900+0000 7f279807d640 1 --2- 172.21.15.120:0/3417309805 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f27900b6170 0x7f27901dfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.900+0000 7f279807d640 1 --2- 172.21.15.120:0/3417309805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f27900b5d90 0x7f27900b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.900+0000 7f279807d640 1 --2- 172.21.15.120:0/3417309805 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f279006d0b0 0x7f279013a900 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.900+0000 7f279807d640 1 -- 172.21.15.120:0/3417309805 >> 172.21.15.120:0/3417309805 conn(0x7f27900b8dd0 msgr2=0x7f27900b9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.901+0000 7f279807d640 1 -- 172.21.15.120:0/3417309805 shutdown_connections 2023-12-19T05:39:03.904 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.901+0000 7f93f5e96640 1 -- 172.21.15.120:0/783444394 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f93d40057d0 con 0x7f93f006da70 2023-12-19T05:39:03.905 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.901+0000 7f279807d640 1 -- 172.21.15.120:0/3417309805 wait complete. 2023-12-19T05:39:03.905 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.901+0000 7f93ecff9640 1 -- 172.21.15.120:0/783444394 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93e005fce0 con 0x7f93f006da70 2023-12-19T05:39:03.905 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2023-12-19T05:39:03.905 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.902+0000 7f22c2631640 1 -- 172.21.15.120:0/3326238575 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f22bc071210 con 0x7f22bc0b79b0 2023-12-19T05:39:03.906 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.902+0000 7f22b8ff9640 1 -- 172.21.15.120:0/3326238575 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22b0018020 con 0x7f22bc0b79b0 2023-12-19T05:39:03.906 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2023-12-19T05:39:03.906 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.902+0000 7fd3649e0640 1 -- 172.21.15.120:0/2438697262 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd3580f1a10 con 0x7fd358007020 2023-12-19T05:39:03.906 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.903+0000 7fd34effd640 1 -- 172.21.15.120:0/2438697262 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd350017090 con 0x7fd358007020 2023-12-19T05:39:03.907 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2023-12-19T05:39:03.907 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.904+0000 7f22c2631640 1 -- 172.21.15.120:0/3326238575 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f22a806a430 msgr2=0x7f22a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.907 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f22c2631640 1 --2- 172.21.15.120:0/3326238575 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f22a806a430 0x7f22a806c8f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f22ac03e000 tx=0x7f22ac038000 comp rx=0 tx=0).stop 2023-12-19T05:39:03.907 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f22c2631640 1 -- 172.21.15.120:0/3326238575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22bc0b79b0 msgr2=0x7f22bc1470f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.907 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f22c2631640 1 --2- 172.21.15.120:0/3326238575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22bc0b79b0 0x7f22bc1470f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f22b000c500 tx=0x7f22b000c9c0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.908 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f93f5e96640 1 -- 172.21.15.120:0/783444394 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f93d006a500 msgr2=0x7f93d006c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.908 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f93f5e96640 1 --2- 172.21.15.120:0/783444394 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f93d006a500 0x7f93d006c9c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f93f00733e0 tx=0x7f93d8009110 comp rx=0 tx=0).stop 2023-12-19T05:39:03.908 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f93f5e96640 1 -- 172.21.15.120:0/783444394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93f006da70 msgr2=0x7f93f006b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.908 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f93f5e96640 1 --2- 172.21.15.120:0/783444394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93f006da70 0x7f93f006b080 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f93e000b390 tx=0x7f93e000b850 comp rx=0 tx=0).stop 2023-12-19T05:39:03.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f22c2631640 1 -- 172.21.15.120:0/3326238575 shutdown_connections 2023-12-19T05:39:03.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f22c2631640 1 --2- 172.21.15.120:0/3326238575 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f22a806a430 0x7f22a806c8f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f22c2631640 1 --2- 172.21.15.120:0/3326238575 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f22bc1459b0 0x7f22bc0b2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f22c2631640 1 --2- 172.21.15.120:0/3326238575 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f22bc145010 0x7f22bc145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f22c2631640 1 --2- 172.21.15.120:0/3326238575 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f22bc0b79b0 0x7f22bc1470f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f22c2631640 1 -- 172.21.15.120:0/3326238575 >> 172.21.15.120:0/3326238575 conn(0x7f22bc0c0340 msgr2=0x7f22bc0bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f93f5e96640 1 -- 172.21.15.120:0/783444394 shutdown_connections 2023-12-19T05:39:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f93f5e96640 1 --2- 172.21.15.120:0/783444394 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f93d006a500 0x7f93d006c9c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f93f5e96640 1 --2- 172.21.15.120:0/783444394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f93f0142ee0 0x7f93f01dc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f93f5e96640 1 --2- 172.21.15.120:0/783444394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f93f00b37a0 0x7f93f01dc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f93f5e96640 1 --2- 172.21.15.120:0/783444394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93f006da70 0x7f93f006b080 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f93f5e96640 1 -- 172.21.15.120:0/783444394 >> 172.21.15.120:0/783444394 conn(0x7f93f00bac10 msgr2=0x7f93f0070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f93f5e96640 1 -- 172.21.15.120:0/783444394 shutdown_connections 2023-12-19T05:39:03.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f22c2631640 1 -- 172.21.15.120:0/3326238575 shutdown_connections 2023-12-19T05:39:03.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f93f5e96640 1 -- 172.21.15.120:0/783444394 wait complete. 2023-12-19T05:39:03.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7f22c2631640 1 -- 172.21.15.120:0/3326238575 wait complete. 2023-12-19T05:39:03.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7fd3649e0640 1 -- 172.21.15.120:0/2438697262 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd34006a430 msgr2=0x7fd34006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7fd3649e0640 1 --2- 172.21.15.120:0/2438697262 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd34006a430 0x7fd34006c8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd360069560 tx=0x7fd36006e030 comp rx=0 tx=0).stop 2023-12-19T05:39:03.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7fd3649e0640 1 -- 172.21.15.120:0/2438697262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd358007020 msgr2=0x7fd3580ff370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:03.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7fd3649e0640 1 --2- 172.21.15.120:0/2438697262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd358007020 0x7fd3580ff370 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd35000eb60 tx=0x7fd35000c520 comp rx=0 tx=0).stop 2023-12-19T05:39:03.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7fd3649e0640 1 -- 172.21.15.120:0/2438697262 shutdown_connections 2023-12-19T05:39:03.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7fd3649e0640 1 --2- 172.21.15.120:0/2438697262 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd34006a430 0x7fd34006c8f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7fd3649e0640 1 --2- 172.21.15.120:0/2438697262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd3580f14c0 0x7fd3580f04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.913 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.905+0000 7fd3649e0640 1 --2- 172.21.15.120:0/2438697262 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd358039dd0 0x7fd35802c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.913 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.906+0000 7fd3649e0640 1 --2- 172.21.15.120:0/2438697262 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd358007020 0x7fd3580ff370 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:03.913 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.906+0000 7fd3649e0640 1 -- 172.21.15.120:0/2438697262 >> 172.21.15.120:0/2438697262 conn(0x7fd35803efa0 msgr2=0x7fd358041280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:03.913 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.906+0000 7fd3649e0640 1 -- 172.21.15.120:0/2438697262 shutdown_connections 2023-12-19T05:39:03.913 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:03.906+0000 7fd3649e0640 1 -- 172.21.15.120:0/2438697262 wait complete. 2023-12-19T05:39:03.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-12-19T05:39:03.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-12-19T05:39:03.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-12-19T05:39:03.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-12-19T05:39:03.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-12-19T05:39:03.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-12-19T05:39:04.903 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T05:39:04.903 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T05:39:04.914 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T05:39:04.915 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T05:39:04.921 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T05:39:04.921 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T05:39:04.923 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T05:39:04.924 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T05:39:05.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.062+0000 7fa7a7fe0640 1 Processor -- start 2023-12-19T05:39:05.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.062+0000 7fa7a7fe0640 1 -- start start 2023-12-19T05:39:05.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.063+0000 7fa7a7fe0640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa7a00712e0 0x7fa7a0069ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.064+0000 7f8160e04640 1 Processor -- start 2023-12-19T05:39:05.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.063+0000 7fa7a7fe0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a006efd0 0x7fa7a00b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.063+0000 7fa7a7fe0640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a0070830 con 0x7fa7a006f3f0 2023-12-19T05:39:05.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.063+0000 7fa7a7fe0640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a00716c0 con 0x7fa7a00712e0 2023-12-19T05:39:05.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.063+0000 7fa7a7fe0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a006a420 con 0x7fa7a006efd0 2023-12-19T05:39:05.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.064+0000 7fa7a5d7c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa7a00712e0 0x7fa7a0069ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.064+0000 7fa7a657d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa7a006f3f0 0x7fa7a00b6df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49644/0 (socket says 172.21.15.120:49644) 2023-12-19T05:39:05.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.064+0000 7fa7a5d7c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa7a00712e0 0x7fa7a0069ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45354/0 (socket says 172.21.15.120:45354) 2023-12-19T05:39:05.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.064+0000 7fa7a657d640 1 -- 172.21.15.120:0/719114739 learned_addr learned my addr 172.21.15.120:0/719114739 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:05.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.064+0000 7fa7a557b640 1 --2- 172.21.15.120:0/719114739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a006efd0 0x7fa7a00b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.068 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.064+0000 7f8160e04640 1 -- start start 2023-12-19T05:39:05.068 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.065+0000 7f8160e04640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f815403c9b0 0x7f81540d5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.068 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.065+0000 7f8160e04640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f815403bd80 con 0x7f8154007590 2023-12-19T05:39:05.068 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.065+0000 7f8160e04640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81540d5840 con 0x7f81540d67b0 2023-12-19T05:39:05.068 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.065+0000 7f8160e04640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815403ac50 con 0x7f815403c9b0 2023-12-19T05:39:05.068 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.066+0000 7f815affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f815403c9b0 0x7f81540d5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.066+0000 7f815affd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f815403c9b0 0x7f81540d5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:44228/0 (socket says 172.21.15.120:44228) 2023-12-19T05:39:05.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.066+0000 7f815affd640 1 -- 172.21.15.120:0/526777998 learned_addr learned my addr 172.21.15.120:0/526777998 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.065+0000 7fa7a4d7a640 1 -- 172.21.15.120:0/719114739 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4009579958 0 0) 0x7fa7a0070830 con 0x7fa7a006f3f0 2023-12-19T05:39:05.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.066+0000 7f815affd640 1 -- 172.21.15.120:0/526777998 >> v1:172.21.15.155:6789/0 conn(0x7f81540d67b0 legacy=0x7f81540cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.065+0000 7fa7a4d7a640 1 -- 172.21.15.120:0/719114739 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa78c003520 con 0x7fa7a006f3f0 2023-12-19T05:39:05.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.065+0000 7fa7a557b640 1 -- 172.21.15.120:0/719114739 >> v2:172.21.15.120:3300/0 conn(0x7fa7a00712e0 msgr2=0x7fa7a0069ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:05.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.065+0000 7fa7a557b640 1 --2- 172.21.15.120:0/719114739 >> v2:172.21.15.120:3300/0 conn(0x7fa7a00712e0 0x7fa7a0069ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.066+0000 7f815affd640 1 -- 172.21.15.120:0/526777998 >> v1:172.21.15.120:6789/0 conn(0x7f8154007590 legacy=0x7f815403a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:05.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.066+0000 7f815affd640 1 -- 172.21.15.120:0/526777998 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815403af30 con 0x7f815403c9b0 2023-12-19T05:39:05.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.065+0000 7fa7a557b640 1 -- 172.21.15.120:0/719114739 >> v1:172.21.15.120:6789/0 conn(0x7fa7a006f3f0 legacy=0x7fa7a00b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.065+0000 7fa7a557b640 1 -- 172.21.15.120:0/719114739 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a006ff00 con 0x7fa7a006efd0 2023-12-19T05:39:05.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.067+0000 7fa7a557b640 1 --2- 172.21.15.120:0/719114739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a006efd0 0x7fa7a00b68b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0097a0 tx=0x7fa79c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dec5bb1e13ec2751 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.067+0000 7fa7a4d7a640 1 -- 172.21.15.120:0/719114739 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c031640 con 0x7fa7a006efd0 2023-12-19T05:39:05.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.067+0000 7fa7a4d7a640 1 -- 172.21.15.120:0/719114739 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c0317a0 con 0x7fa7a006efd0 2023-12-19T05:39:05.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.067+0000 7f815affd640 1 --2- 172.21.15.120:0/526777998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f815403c9b0 0x7f81540d5cd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f815c068ba0 tx=0x7f815c0a57c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43ac33de2e52e42f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.068+0000 7fa7a4d7a640 1 -- 172.21.15.120:0/719114739 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c031640 con 0x7fa7a006efd0 2023-12-19T05:39:05.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.068+0000 7f815a7fc640 1 -- 172.21.15.120:0/526777998 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c06cea0 con 0x7f815403c9b0 2023-12-19T05:39:05.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.068+0000 7f815a7fc640 1 -- 172.21.15.120:0/526777998 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c0ab5e0 con 0x7f815403c9b0 2023-12-19T05:39:05.073 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.068+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/719114739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a006efd0 msgr2=0x7fa7a00b68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.073 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.068+0000 7fa7a7fe0640 1 --2- 172.21.15.120:0/719114739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a006efd0 0x7fa7a00b68b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0097a0 tx=0x7fa79c02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.073 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.068+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/719114739 shutdown_connections 2023-12-19T05:39:05.073 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.068+0000 7fa7a7fe0640 1 --2- 172.21.15.120:0/719114739 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a006efd0 0x7fa7a00b68b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.073 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.068+0000 7fa7a7fe0640 1 --2- 172.21.15.120:0/719114739 >> v2:172.21.15.120:3300/0 conn(0x7fa7a00712e0 0x7fa7a0069ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.073 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.068+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/719114739 >> 172.21.15.120:0/719114739 conn(0x7fa7a00b8b90 msgr2=0x7fa7a00b8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.073 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.068+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/719114739 shutdown_connections 2023-12-19T05:39:05.074 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.069+0000 7f8160e04640 1 -- 172.21.15.120:0/526777998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f815403c9b0 msgr2=0x7f81540d5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.074 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.069+0000 7f8160e04640 1 --2- 172.21.15.120:0/526777998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f815403c9b0 0x7f81540d5cd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f815c068ba0 tx=0x7f815c0a57c0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.074 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.069+0000 7f8160e04640 1 -- 172.21.15.120:0/526777998 shutdown_connections 2023-12-19T05:39:05.074 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.069+0000 7f8160e04640 1 --2- 172.21.15.120:0/526777998 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f815403c9b0 0x7f81540d5cd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.074 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.069+0000 7f8160e04640 1 -- 172.21.15.120:0/526777998 >> 172.21.15.120:0/526777998 conn(0x7f815403f2a0 msgr2=0x7f815403f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.074 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.069+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/719114739 wait complete. 2023-12-19T05:39:05.075 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.070+0000 7f8160e04640 1 -- 172.21.15.120:0/526777998 shutdown_connections 2023-12-19T05:39:05.076 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.071+0000 7fa7a7fe0640 1 Processor -- start 2023-12-19T05:39:05.076 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.070+0000 7f8160e04640 1 -- 172.21.15.120:0/526777998 wait complete. 2023-12-19T05:39:05.076 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.071+0000 7f8160e04640 1 Processor -- start 2023-12-19T05:39:05.077 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.071+0000 7fa7a7fe0640 1 -- start start 2023-12-19T05:39:05.078 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.072+0000 7fa7a7fe0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7a006efd0 0x7fa7a014fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.078 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.072+0000 7fa7a7fe0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a006f3f0 0x7fa7a014c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.078 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.072+0000 7fa7a7fe0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a00712e0 0x7fa7a0146670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.078 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.072+0000 7fa7a7fe0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a0150420 con 0x7fa7a006efd0 2023-12-19T05:39:05.078 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.072+0000 7fa7a7fe0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a014c290 con 0x7fa7a00712e0 2023-12-19T05:39:05.078 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.072+0000 7fa7a7fe0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a0146200 con 0x7fa7a006f3f0 2023-12-19T05:39:05.078 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.072+0000 7fa7a657d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a00712e0 0x7fa7a0146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.078 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.072+0000 7fa7a657d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a00712e0 0x7fa7a0146670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59672/0 (socket says 172.21.15.120:59672) 2023-12-19T05:39:05.078 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.072+0000 7fa7a657d640 1 -- 172.21.15.120:0/3320184928 learned_addr learned my addr 172.21.15.120:0/3320184928 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.079 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.072+0000 7f8160e04640 1 -- start start 2023-12-19T05:39:05.079 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7f8160e04640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8154007590 0x7f8154037090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.079 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7f8160e04640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81540d67b0 0x7f81540d2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.079 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7f8160e04640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8154176020 0x7f81541764b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.079 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7f8160e04640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815403e720 con 0x7f8154007590 2023-12-19T05:39:05.079 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7f8160e04640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81540d2b70 con 0x7f8154176020 2023-12-19T05:39:05.079 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7f8160e04640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815403e0f0 con 0x7f81540d67b0 2023-12-19T05:39:05.079 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7fa7a657d640 1 -- 172.21.15.120:0/3320184928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a006f3f0 msgr2=0x7fa7a014c8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T05:39:05.080 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7f815b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8154007590 0x7f8154037090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.080 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7f815bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8154176020 0x7f81541764b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.080 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7fa7a657d640 1 --2- 172.21.15.120:0/3320184928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a006f3f0 0x7fa7a014c8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.080 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7fa7a657d640 1 -- 172.21.15.120:0/3320184928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7a006efd0 msgr2=0x7fa7a014fee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T05:39:05.080 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7fa7a657d640 1 --2- 172.21.15.120:0/3320184928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7a006efd0 0x7fa7a014fee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.081 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7fa7a657d640 1 -- 172.21.15.120:0/3320184928 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c009400 con 0x7fa7a00712e0 2023-12-19T05:39:05.081 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7f815bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8154176020 0x7f81541764b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59680/0 (socket says 172.21.15.120:59680) 2023-12-19T05:39:05.081 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7f815bfff640 1 -- 172.21.15.120:0/222472155 learned_addr learned my addr 172.21.15.120:0/222472155 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.081 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.073+0000 7fa7a657d640 1 --2- 172.21.15.120:0/3320184928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a00712e0 0x7fa7a0146670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa79800cb10 tx=0x7fa79800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.082 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.074+0000 7f815b7fe640 1 -- 172.21.15.120:0/222472155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81540d67b0 msgr2=0x7f81540d2630 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T05:39:05.082 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.074+0000 7f815b7fe640 1 --2- 172.21.15.120:0/222472155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81540d67b0 0x7f81540d2630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.082 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.074+0000 7f815b7fe640 1 -- 172.21.15.120:0/222472155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8154176020 msgr2=0x7f81541764b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.082 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.074+0000 7f815b7fe640 1 --2- 172.21.15.120:0/222472155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8154176020 0x7f81541764b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.082 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.074+0000 7f815b7fe640 1 -- 172.21.15.120:0/222472155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81541769f0 con 0x7f8154007590 2023-12-19T05:39:05.082 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.074+0000 7fa7967fc640 1 -- 172.21.15.120:0/3320184928 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79800ac70 con 0x7fa7a00712e0 2023-12-19T05:39:05.083 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.074+0000 7f815b7fe640 1 --2- 172.21.15.120:0/222472155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8154007590 0x7f8154037090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f815000c410 tx=0x7f815000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.083 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.075+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/3320184928 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a014ebe0 con 0x7fa7a00712e0 2023-12-19T05:39:05.083 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.075+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/3320184928 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a014beb0 con 0x7fa7a00712e0 2023-12-19T05:39:05.083 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.075+0000 7f8147fff640 1 -- 172.21.15.120:0/222472155 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81500035f0 con 0x7f8154007590 2023-12-19T05:39:05.084 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.075+0000 7fa7967fc640 1 -- 172.21.15.120:0/3320184928 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79800add0 con 0x7fa7a00712e0 2023-12-19T05:39:05.084 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.075+0000 7fa7967fc640 1 -- 172.21.15.120:0/3320184928 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798012600 con 0x7fa7a00712e0 2023-12-19T05:39:05.085 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.075+0000 7f8160e04640 1 -- 172.21.15.120:0/222472155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8154037780 con 0x7f8154007590 2023-12-19T05:39:05.085 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.075+0000 7f8160e04640 1 -- 172.21.15.120:0/222472155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815403e340 con 0x7f8154007590 2023-12-19T05:39:05.085 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.077+0000 7f8160e04640 1 -- 172.21.15.120:0/222472155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815403e860 con 0x7f8154007590 2023-12-19T05:39:05.085 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.077+0000 7f8147fff640 1 -- 172.21.15.120:0/222472155 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8150003770 con 0x7f8154007590 2023-12-19T05:39:05.085 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.078+0000 7f8147fff640 1 -- 172.21.15.120:0/222472155 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8150003b20 con 0x7f8154007590 2023-12-19T05:39:05.085 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.078+0000 7f8147fff640 1 -- 172.21.15.120:0/222472155 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8150003d40 con 0x7f8154007590 2023-12-19T05:39:05.085 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.079+0000 7f8147fff640 1 --2- 172.21.15.120:0/222472155 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f814c06a6f0 0x7f814c06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.085 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.079+0000 7f8147fff640 1 -- 172.21.15.120:0/222472155 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8150087f90 con 0x7f8154007590 2023-12-19T05:39:05.086 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.081+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/3320184928 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa788005250 con 0x7fa7a00712e0 2023-12-19T05:39:05.086 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.081+0000 7f815affd640 1 --2- 172.21.15.120:0/222472155 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f814c06a6f0 0x7f814c06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.086 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.082+0000 7f815affd640 1 --2- 172.21.15.120:0/222472155 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f814c06a6f0 0x7f814c06cbb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8154004dc0 tx=0x7f815c0aa000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.087 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.083+0000 7fa7967fc640 1 -- 172.21.15.120:0/3320184928 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa798012760 con 0x7fa7a00712e0 2023-12-19T05:39:05.087 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.083+0000 7fa7967fc640 1 --2- 172.21.15.120:0/3320184928 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa78c06a960 0x7fa78c06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.087 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.083+0000 7fa7967fc640 1 -- 172.21.15.120:0/3320184928 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7980889c0 con 0x7fa7a00712e0 2023-12-19T05:39:05.087 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.084+0000 7fa7a5d7c640 1 --2- 172.21.15.120:0/3320184928 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa78c06a960 0x7fa78c06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.087 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.084+0000 7fa7a5d7c640 1 --2- 172.21.15.120:0/3320184928 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa78c06a960 0x7fa78c06ce20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa790009930 tx=0x7fa790009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.087 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.086+0000 7fa7967fc640 1 -- 172.21.15.120:0/3320184928 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa7980540d0 con 0x7fa7a00712e0 2023-12-19T05:39:05.088 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.087+0000 7f8147fff640 1 -- 172.21.15.120:0/222472155 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f815403e860 con 0x7f8154007590 2023-12-19T05:39:05.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.118+0000 7f8f03626640 1 Processor -- start 2023-12-19T05:39:05.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.118+0000 7f8f03626640 1 -- start start 2023-12-19T05:39:05.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.119+0000 7f8f03626640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8efc069f70 0x7f8efc14ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.119+0000 7f8f03626640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8efc06fa50 0x7f8efc070390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.119+0000 7f8f03626640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc06f6b0 con 0x7f8efc148dd0 2023-12-19T05:39:05.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.119+0000 7f8f03626640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8efc06ff00 con 0x7f8efc069f70 2023-12-19T05:39:05.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.119+0000 7f8f03626640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc06ee90 con 0x7f8efc06fa50 2023-12-19T05:39:05.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.120+0000 7f8f013c2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8efc069f70 0x7f8efc14ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.120+0000 7f8f013c2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8efc069f70 0x7f8efc14ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59694/0 (socket says 172.21.15.120:59694) 2023-12-19T05:39:05.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.120+0000 7f8f013c2640 1 -- 172.21.15.120:0/3155824181 learned_addr learned my addr 172.21.15.120:0/3155824181 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.120+0000 7f8f00bc1640 1 --2- 172.21.15.120:0/3155824181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8efc06fa50 0x7f8efc070390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.123 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.119+0000 7f8197a96640 1 Processor -- start 2023-12-19T05:39:05.123 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.119+0000 7f8197a96640 1 -- start start 2023-12-19T05:39:05.123 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.120+0000 7f8197a96640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8190149180 0x7f819015a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.123 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.120+0000 7f8197a96640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81900b79a0 con 0x7f819006ca80 2023-12-19T05:39:05.123 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.120+0000 7f8197a96640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819006f100 con 0x7f81900b2a10 2023-12-19T05:39:05.123 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.120+0000 7f8197a96640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81900b7d40 con 0x7f8190149180 2023-12-19T05:39:05.124 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.120+0000 7f4260b4e640 1 Processor -- start 2023-12-19T05:39:05.125 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.120+0000 7f8f013c2640 1 -- 172.21.15.120:0/3155824181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8efc06fa50 msgr2=0x7f8efc070390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:05.125 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.120+0000 7f8f013c2640 1 --2- 172.21.15.120:0/3155824181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8efc06fa50 0x7f8efc070390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.125 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.120+0000 7f8f013c2640 1 -- 172.21.15.120:0/3155824181 >> v1:172.21.15.120:6789/0 conn(0x7f8efc148dd0 legacy=0x7f8efc0b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:05.125 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.120+0000 7f8f013c2640 1 -- 172.21.15.120:0/3155824181 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc06f170 con 0x7f8efc069f70 2023-12-19T05:39:05.126 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.121+0000 7f8196033640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8190149180 0x7f819015a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.126 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.121+0000 7f8196033640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8190149180 0x7f819015a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45366/0 (socket says 172.21.15.120:45366) 2023-12-19T05:39:05.126 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.121+0000 7f8196033640 1 -- 172.21.15.120:0/3491991311 learned_addr learned my addr 172.21.15.120:0/3491991311 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.126 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.121+0000 7f8196033640 1 -- 172.21.15.120:0/3491991311 >> v1:172.21.15.155:6789/0 conn(0x7f81900b2a10 legacy=0x7f8190148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:05.126 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.121+0000 7f8196033640 1 -- 172.21.15.120:0/3491991311 >> v1:172.21.15.120:6789/0 conn(0x7f819006ca80 legacy=0x7f819006f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:05.126 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.121+0000 7f8196033640 1 -- 172.21.15.120:0/3491991311 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819006ce60 con 0x7f8190149180 2023-12-19T05:39:05.126 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.121+0000 7fdb0c8b4640 1 Processor -- start 2023-12-19T05:39:05.127 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.121+0000 7f74e3314640 1 Processor -- start 2023-12-19T05:39:05.127 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.121+0000 7f4260b4e640 1 -- start start 2023-12-19T05:39:05.127 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f8f013c2640 1 --2- 172.21.15.120:0/3155824181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8efc069f70 0x7f8efc14ef30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009870 tx=0x7f8eec02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c98cb21941e93d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.128 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f74e3314640 1 -- start start 2023-12-19T05:39:05.128 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f4260b4e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4254007430 0x7f425403d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.128 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f8ef3fff640 1 -- 172.21.15.120:0/3155824181 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec030840 con 0x7f8efc069f70 2023-12-19T05:39:05.128 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f8ef3fff640 1 -- 172.21.15.120:0/3155824181 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec0309a0 con 0x7f8efc069f70 2023-12-19T05:39:05.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f4260b4e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540cedb0 0x7f42540407d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f4260b4e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425403b9e0 con 0x7f425403c890 2023-12-19T05:39:05.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f4260b4e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f425403ce40 con 0x7f4254007430 2023-12-19T05:39:05.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f4260b4e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4254040d10 con 0x7f42540cedb0 2023-12-19T05:39:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f4259d9b640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f425403c890 0x7f42540c8d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:39926/0 (socket says 172.21.15.120:39926) 2023-12-19T05:39:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f8196033640 1 --2- 172.21.15.120:0/3491991311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8190149180 0x7f819015a570 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f818c009870 tx=0x7f818c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef677d03291d960 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f74e3314640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f74dc0b2d90 0x7f74dc0b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f74e3314640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f74dc14c490 0x7f74dc153110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f74e3314640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74dc148b20 con 0x7f74dc06a120 2023-12-19T05:39:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f74e3314640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74dc0b3170 con 0x7f74dc14c490 2023-12-19T05:39:05.130 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f74e3314640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74dc0b4650 con 0x7f74dc0b2d90 2023-12-19T05:39:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7fdb0c8b4640 1 -- start start 2023-12-19T05:39:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f74e18b1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f74dc14c490 0x7f74dc153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f8194830640 1 -- 172.21.15.120:0/3491991311 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c0317e0 con 0x7f8190149180 2023-12-19T05:39:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f8194830640 1 -- 172.21.15.120:0/3491991311 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c031940 con 0x7f8190149180 2023-12-19T05:39:05.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f8194830640 1 -- 172.21.15.120:0/3491991311 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c031cd0 con 0x7f8190149180 2023-12-19T05:39:05.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f74e18b1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f74dc14c490 0x7f74dc153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45376/0 (socket says 172.21.15.120:45376) 2023-12-19T05:39:05.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f74e18b1640 1 -- 172.21.15.120:0/2858865409 learned_addr learned my addr 172.21.15.120:0/2858865409 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f74e08af640 1 --1- 172.21.15.120:0/2858865409 >> v1:172.21.15.120:6789/0 conn(0x7f74dc06a120 0x7f74dc14bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49700/0 (socket says 172.21.15.120:49700) 2023-12-19T05:39:05.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f8ef3fff640 1 -- 172.21.15.120:0/3155824181 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec030d30 con 0x7f8efc069f70 2023-12-19T05:39:05.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f8f03626640 1 -- 172.21.15.120:0/3155824181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8efc069f70 msgr2=0x7f8efc14ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f8f03626640 1 --2- 172.21.15.120:0/3155824181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8efc069f70 0x7f8efc14ef30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009870 tx=0x7f8eec02b980 comp rx=0 tx=0).stop 2023-12-19T05:39:05.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f425ad9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540cedb0 0x7f42540407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f4259d9b640 1 -- 172.21.15.120:0/324037148 learned_addr learned my addr 172.21.15.120:0/324037148 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:05.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f425a59c640 1 --2- 172.21.15.120:0/324037148 >> v2:172.21.15.120:3300/0 conn(0x7f4254007430 0x7f425403d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.133 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f425959a640 1 -- 172.21.15.120:0/324037148 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877661388 0 0) 0x7f425403b9e0 con 0x7f425403c890 2023-12-19T05:39:05.134 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f425959a640 1 -- 172.21.15.120:0/324037148 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4244003520 con 0x7f425403c890 2023-12-19T05:39:05.134 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f425ad9d640 1 -- 172.21.15.120:0/324037148 >> v2:172.21.15.120:3300/0 conn(0x7f4254007430 msgr2=0x7f425403d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:05.134 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f425ad9d640 1 --2- 172.21.15.120:0/324037148 >> v2:172.21.15.120:3300/0 conn(0x7f4254007430 0x7f425403d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.134 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f425ad9d640 1 -- 172.21.15.120:0/324037148 >> v1:172.21.15.155:6789/0 conn(0x7f425403c890 legacy=0x7f42540c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.134 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.122+0000 7f425ad9d640 1 -- 172.21.15.120:0/324037148 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425403c1f0 con 0x7f42540cedb0 2023-12-19T05:39:05.134 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7f74e18b1640 1 -- 172.21.15.120:0/2858865409 >> v2:172.21.15.155:3300/0 conn(0x7f74dc0b2d90 msgr2=0x7f74dc0b3860 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T05:39:05.135 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f8f03626640 1 -- 172.21.15.120:0/3155824181 shutdown_connections 2023-12-19T05:39:05.135 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f8f03626640 1 --2- 172.21.15.120:0/3155824181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8efc06fa50 0x7f8efc070390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.135 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f8f03626640 1 --2- 172.21.15.120:0/3155824181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8efc069f70 0x7f8efc14ef30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.135 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.123+0000 7f8f03626640 1 -- 172.21.15.120:0/3155824181 >> 172.21.15.120:0/3155824181 conn(0x7f8efc0b8b90 msgr2=0x7f8efc0b8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.135 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7ff87f238640 1 Processor -- start 2023-12-19T05:39:05.136 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7f74e10b0640 1 --2- 172.21.15.120:0/2858865409 >> v2:172.21.15.155:3300/0 conn(0x7f74dc0b2d90 0x7f74dc0b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.136 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7f74e18b1640 1 --2- 172.21.15.120:0/2858865409 >> v2:172.21.15.155:3300/0 conn(0x7f74dc0b2d90 0x7f74dc0b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.136 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7f74e18b1640 1 -- 172.21.15.120:0/2858865409 >> v1:172.21.15.120:6789/0 conn(0x7f74dc06a120 legacy=0x7f74dc14bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.136 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7f74e18b1640 1 -- 172.21.15.120:0/2858865409 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc148e00 con 0x7f74dc14c490 2023-12-19T05:39:05.136 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7ff87f238640 1 -- start start 2023-12-19T05:39:05.136 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7fdb0c8b4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdb000398f0 0x7fdb000d8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7f8f03626640 1 -- 172.21.15.120:0/3155824181 shutdown_connections 2023-12-19T05:39:05.137 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7f8f03626640 1 -- 172.21.15.120:0/3155824181 wait complete. 2023-12-19T05:39:05.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7fdb0c8b4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb000cfb00 0x7fdb0003e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7fdb0c8b4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0003aba0 con 0x7fdb00007260 2023-12-19T05:39:05.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7fdb0c8b4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0003ae80 con 0x7fdb000398f0 2023-12-19T05:39:05.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7fdb0c8b4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0003e100 con 0x7fdb000cfb00 2023-12-19T05:39:05.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7fdb07fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb000cfb00 0x7fdb0003e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7fdb07fff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb000cfb00 0x7fdb0003e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:44276/0 (socket says 172.21.15.120:44276) 2023-12-19T05:39:05.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7fdb07fff640 1 -- 172.21.15.120:0/1788364476 learned_addr learned my addr 172.21.15.120:0/1788364476 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.138 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.124+0000 7fdb06ffd640 1 --2- 172.21.15.120:0/1788364476 >> v2:172.21.15.120:3300/0 conn(0x7fdb000398f0 0x7fdb000d8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7f8197a96640 1 -- 172.21.15.120:0/3491991311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8190149180 msgr2=0x7f819015a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7f8197a96640 1 --2- 172.21.15.120:0/3491991311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8190149180 0x7f819015a570 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f818c009870 tx=0x7f818c02b880 comp rx=0 tx=0).stop 2023-12-19T05:39:05.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7f74e18b1640 1 --2- 172.21.15.120:0/2858865409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc14c490 0x7f74dc153110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f74dc06d1c0 tx=0x7f74d402c030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26345d9dd738330 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.139 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7f74d3fff640 1 -- 172.21.15.120:0/2858865409 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d402cbd0 con 0x7f74dc14c490 2023-12-19T05:39:05.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7ff87f238640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff8780b7d90 0x7ff878144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7ff87cfd4640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff8780b79b0 0x7ff8780b8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49716/0 (socket says 172.21.15.120:49716) 2023-12-19T05:39:05.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7ff87cfd4640 1 -- 172.21.15.120:0/135164946 learned_addr learned my addr 172.21.15.120:0/135164946 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:05.140 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7ff877fff640 1 --2- 172.21.15.120:0/135164946 >> v2:172.21.15.120:3300/0 conn(0x7ff8780b7d90 0x7ff878144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.141 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7f8f03626640 1 Processor -- start 2023-12-19T05:39:05.141 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7f74d3fff640 1 -- 172.21.15.120:0/2858865409 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d402cd30 con 0x7f74dc14c490 2023-12-19T05:39:05.141 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7ff87f238640 1 -- 172.21.15.120:0/135164946 --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8780b96b0 con 0x7ff8780b79b0 2023-12-19T05:39:05.141 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7f74d3fff640 1 -- 172.21.15.120:0/2858865409 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4034610 con 0x7f74dc14c490 2023-12-19T05:39:05.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7f425ad9d640 1 --2- 172.21.15.120:0/324037148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540cedb0 0x7f42540407d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f424c0097a0 tx=0x7f424c02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dc38581a7d88af3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7f8197a96640 1 -- 172.21.15.120:0/3491991311 shutdown_connections 2023-12-19T05:39:05.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7f8197a96640 1 --2- 172.21.15.120:0/3491991311 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8190149180 0x7f819015a570 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.142 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7f8197a96640 1 -- 172.21.15.120:0/3491991311 >> 172.21.15.120:0/3491991311 conn(0x7f81900b8810 msgr2=0x7f81900b8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.143 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7ff87f238640 1 -- 172.21.15.120:0/135164946 --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8780b81d0 con 0x7ff878145010 2023-12-19T05:39:05.143 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7ff87f238640 1 -- 172.21.15.120:0/135164946 --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87814ae10 con 0x7ff8780b7d90 2023-12-19T05:39:05.143 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7ff8777fe640 1 -- 172.21.15.120:0/135164946 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357987105 0 0) 0x7ff8780b96b0 con 0x7ff8780b79b0 2023-12-19T05:39:05.143 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7f8197a96640 1 -- 172.21.15.120:0/3491991311 shutdown_connections 2023-12-19T05:39:05.143 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7f8197a96640 1 -- 172.21.15.120:0/3491991311 wait complete. 2023-12-19T05:39:05.144 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7fdb07fff640 1 -- 172.21.15.120:0/1788364476 >> v2:172.21.15.120:3300/0 conn(0x7fdb000398f0 msgr2=0x7fdb000d8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:05.144 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7fdb07fff640 1 --2- 172.21.15.120:0/1788364476 >> v2:172.21.15.120:3300/0 conn(0x7fdb000398f0 0x7fdb000d8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.144 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7fdb07fff640 1 -- 172.21.15.120:0/1788364476 >> v1:172.21.15.120:6789/0 conn(0x7fdb00007260 legacy=0x7fdb000cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.144 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7fdb07fff640 1 -- 172.21.15.120:0/1788364476 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0003e3e0 con 0x7fdb000cfb00 2023-12-19T05:39:05.144 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7ff8777fe640 1 -- 172.21.15.120:0/135164946 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff860003520 con 0x7ff8780b79b0 2023-12-19T05:39:05.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7f74e3314640 1 -- 172.21.15.120:0/2858865409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc14c490 msgr2=0x7f74dc153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7f74e3314640 1 --2- 172.21.15.120:0/2858865409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc14c490 0x7f74dc153110 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f74dc06d1c0 tx=0x7f74d402c030 comp rx=0 tx=0).stop 2023-12-19T05:39:05.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7f425959a640 1 -- 172.21.15.120:0/324037148 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c031780 con 0x7f42540cedb0 2023-12-19T05:39:05.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7f425959a640 1 -- 172.21.15.120:0/324037148 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c0318e0 con 0x7f42540cedb0 2023-12-19T05:39:05.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7f425959a640 1 -- 172.21.15.120:0/324037148 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c031c70 con 0x7f42540cedb0 2023-12-19T05:39:05.145 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.125+0000 7f8f03626640 1 -- start start 2023-12-19T05:39:05.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7f8f03626640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc069f70 0x7f8efc14baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7f8f03626640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8efc06fa50 0x7f8efc0b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f013c2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc069f70 0x7f8efc14baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f013c2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc069f70 0x7f8efc14baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45410/0 (socket says 172.21.15.120:45410) 2023-12-19T05:39:05.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f03626640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8efc148dd0 0x7f8efc0b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7ff877fff640 1 -- 172.21.15.120:0/135164946 >> v1:172.21.15.155:6789/0 conn(0x7ff878145010 legacy=0x7ff87814b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:05.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.126+0000 7ff877fff640 1 -- 172.21.15.120:0/135164946 >> v1:172.21.15.120:6789/0 conn(0x7ff8780b79b0 legacy=0x7ff8780b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.146 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f013c2640 1 -- 172.21.15.120:0/3214584062 learned_addr learned my addr 172.21.15.120:0/3214584062 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.147 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7ff877fff640 1 -- 172.21.15.120:0/135164946 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8780b90f0 con 0x7ff8780b7d90 2023-12-19T05:39:05.147 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f00bc1640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8efc06fa50 0x7f8efc0b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.147 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f03626640 1 -- 172.21.15.120:0/3214584062 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc14c030 con 0x7f8efc069f70 2023-12-19T05:39:05.147 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f74e3314640 1 -- 172.21.15.120:0/2858865409 shutdown_connections 2023-12-19T05:39:05.147 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f74e3314640 1 --2- 172.21.15.120:0/2858865409 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc14c490 0x7f74dc153110 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.148 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f74e3314640 1 --2- 172.21.15.120:0/2858865409 >> v2:172.21.15.155:3300/0 conn(0x7f74dc0b2d90 0x7f74dc0b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.148 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f74e3314640 1 -- 172.21.15.120:0/2858865409 >> 172.21.15.120:0/2858865409 conn(0x7f74dc0b8dd0 msgr2=0x7f74dc0b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.148 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f01bc3640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8efc148dd0 0x7f8efc0b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.148 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f03626640 1 -- 172.21.15.120:0/3214584062 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc1338f0 con 0x7f8efc148dd0 2023-12-19T05:39:05.148 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f03626640 1 -- 172.21.15.120:0/3214584062 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc0b6340 con 0x7f8efc06fa50 2023-12-19T05:39:05.148 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f74e3314640 1 -- 172.21.15.120:0/2858865409 shutdown_connections 2023-12-19T05:39:05.149 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f4260b4e640 1 -- 172.21.15.120:0/324037148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540cedb0 msgr2=0x7f42540407d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.149 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f4260b4e640 1 --2- 172.21.15.120:0/324037148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540cedb0 0x7f42540407d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f424c0097a0 tx=0x7f424c02b820 comp rx=0 tx=0).stop 2023-12-19T05:39:05.149 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f013c2640 1 -- 172.21.15.120:0/3214584062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8efc06fa50 msgr2=0x7f8efc0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.149 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f013c2640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8efc06fa50 0x7f8efc0b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.150 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f013c2640 1 -- 172.21.15.120:0/3214584062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8efc148dd0 msgr2=0x7f8efc0b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.150 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f013c2640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8efc148dd0 0x7f8efc0b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.150 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7fdb07fff640 1 --2- 172.21.15.120:0/1788364476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb000cfb00 0x7fdb0003e900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdb08066a80 tx=0x7fdb080a5740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7085a5eb6a8b343d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.150 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7fdb067fc640 1 -- 172.21.15.120:0/1788364476 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0806cea0 con 0x7fdb000cfb00 2023-12-19T05:39:05.150 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7fdb067fc640 1 -- 172.21.15.120:0/1788364476 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb080a8050 con 0x7fdb000cfb00 2023-12-19T05:39:05.150 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7fdb067fc640 1 -- 172.21.15.120:0/1788364476 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb080615a0 con 0x7fdb000cfb00 2023-12-19T05:39:05.151 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f013c2640 1 -- 172.21.15.120:0/3214584062 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec0094d0 con 0x7f8efc069f70 2023-12-19T05:39:05.151 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f00bc1640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8efc06fa50 0x7f8efc0b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:05.151 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8f01bc3640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8efc148dd0 0x7f8efc0b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:05.151 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7ff877fff640 1 --2- 172.21.15.120:0/135164946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8780b7d90 0x7ff878144ad0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff86c0097a0 tx=0x7ff86c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8643aa89722972 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.151 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f4260b4e640 1 -- 172.21.15.120:0/324037148 shutdown_connections 2023-12-19T05:39:05.152 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f4260b4e640 1 --2- 172.21.15.120:0/324037148 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f42540cedb0 0x7f42540407d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.152 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f4260b4e640 1 --2- 172.21.15.120:0/324037148 >> v2:172.21.15.120:3300/0 conn(0x7f4254007430 0x7f425403d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.152 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f4260b4e640 1 -- 172.21.15.120:0/324037148 >> 172.21.15.120:0/324037148 conn(0x7f4254041060 msgr2=0x7f4254041440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.152 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f4260b4e640 1 -- 172.21.15.120:0/324037148 shutdown_connections 2023-12-19T05:39:05.152 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f4260b4e640 1 -- 172.21.15.120:0/324037148 wait complete. 2023-12-19T05:39:05.152 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/1788364476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb000cfb00 msgr2=0x7fdb0003e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.152 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7fdb0c8b4640 1 --2- 172.21.15.120:0/1788364476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb000cfb00 0x7fdb0003e900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdb08066a80 tx=0x7fdb080a5740 comp rx=0 tx=0).stop 2023-12-19T05:39:05.152 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f8f013c2640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc069f70 0x7f8efc14baf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8eec000c00 tx=0x7f8eec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.153 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/1788364476 shutdown_connections 2023-12-19T05:39:05.153 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7fdb0c8b4640 1 --2- 172.21.15.120:0/1788364476 >> v2:172.21.15.120:3300/0 conn(0x7fdb000398f0 0x7fdb000d8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.153 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7fdb0c8b4640 1 --2- 172.21.15.120:0/1788364476 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb000cfb00 0x7fdb0003e900 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.153 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/1788364476 >> 172.21.15.120:0/1788364476 conn(0x7fdb0003ef70 msgr2=0x7fdb0003f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.153 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/1788364476 shutdown_connections 2023-12-19T05:39:05.154 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8197a96640 1 Processor -- start 2023-12-19T05:39:05.154 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.127+0000 7f8197a96640 1 -- start start 2023-12-19T05:39:05.154 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f8197a96640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f819006ca80 0x7f819014eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.154 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f8197a96640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81900b2a10 0x7f819014da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.154 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f8197a96640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8190149180 0x7f81901396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.154 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7ff8777fe640 1 -- 172.21.15.120:0/135164946 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868001670 con 0x7ff8780b7d90 2023-12-19T05:39:05.154 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7ff8777fe640 1 -- 172.21.15.120:0/135164946 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c02e050 con 0x7ff8780b7d90 2023-12-19T05:39:05.155 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f8197a96640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8190142020 con 0x7f81900b2a10 2023-12-19T05:39:05.155 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f8197a96640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819014f0d0 con 0x7f819006ca80 2023-12-19T05:39:05.155 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f8197a96640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819014f770 con 0x7f8190149180 2023-12-19T05:39:05.155 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f8195832640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f819006ca80 0x7f819014eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.155 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7f8195832640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f819006ca80 0x7f819014eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59728/0 (socket says 172.21.15.120:59728) 2023-12-19T05:39:05.155 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7f8195832640 1 -- 172.21.15.120:0/1076096918 learned_addr learned my addr 172.21.15.120:0/1076096918 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.155 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7f8196033640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8190149180 0x7f81901396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.156 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7f8195832640 1 -- 172.21.15.120:0/1076096918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8190149180 msgr2=0x7f81901396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.156 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7f8195031640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81900b2a10 0x7f819014da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.156 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7f8195832640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8190149180 0x7f81901396f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.156 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7f8195832640 1 -- 172.21.15.120:0/1076096918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81900b2a10 msgr2=0x7f819014da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.156 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7f8195832640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81900b2a10 0x7f819014da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.156 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7f8195832640 1 -- 172.21.15.120:0/1076096918 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0094d0 con 0x7f819006ca80 2023-12-19T05:39:05.156 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7f8195031640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81900b2a10 0x7f819014da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:05.156 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/1788364476 wait complete. 2023-12-19T05:39:05.157 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7f8ef1ffb640 1 -- 172.21.15.120:0/3214584062 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec039c90 con 0x7f8efc069f70 2023-12-19T05:39:05.157 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7f8ef1ffb640 1 -- 172.21.15.120:0/3214584062 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec039e10 con 0x7f8efc069f70 2023-12-19T05:39:05.157 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7f8f03626640 1 -- 172.21.15.120:0/3214584062 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8efc0b3ec0 con 0x7f8efc069f70 2023-12-19T05:39:05.157 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.130+0000 7f8f03626640 1 -- 172.21.15.120:0/3214584062 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc1322f0 con 0x7f8efc069f70 2023-12-19T05:39:05.157 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.130+0000 7f8ef1ffb640 1 -- 172.21.15.120:0/3214584062 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec043640 con 0x7f8efc069f70 2023-12-19T05:39:05.157 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.130+0000 7fdb0c8b4640 1 Processor -- start 2023-12-19T05:39:05.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.128+0000 7f74e3314640 1 -- 172.21.15.120:0/2858865409 wait complete. 2023-12-19T05:39:05.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.130+0000 7f74e3314640 1 Processor -- start 2023-12-19T05:39:05.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.130+0000 7f74e3314640 1 -- start start 2023-12-19T05:39:05.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f74e3314640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc06a120 0x7f74dc146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f74e3314640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc0b2d90 0x7f74dc143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f74e3314640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74dc14c490 0x7f74dc13dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f74e3314640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc147300 con 0x7f74dc0b2d90 2023-12-19T05:39:05.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f74e3314640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc144aa0 con 0x7f74dc06a120 2023-12-19T05:39:05.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f74e3314640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc13eba0 con 0x7f74dc14c490 2023-12-19T05:39:05.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.129+0000 7f4260b4e640 1 Processor -- start 2023-12-19T05:39:05.159 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.130+0000 7f4260b4e640 1 -- start start 2023-12-19T05:39:05.159 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f4260b4e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4254007430 0x7f42540c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.159 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f4260b4e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f425403c890 0x7f4254037590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.159 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.130+0000 7ff8777fe640 1 -- 172.21.15.120:0/135164946 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868001670 con 0x7ff8780b7d90 2023-12-19T05:39:05.159 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.130+0000 7ff87f238640 1 -- 172.21.15.120:0/135164946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8780b7d90 msgr2=0x7ff878144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.159 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.130+0000 7ff87f238640 1 --2- 172.21.15.120:0/135164946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8780b7d90 0x7ff878144ad0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff86c0097a0 tx=0x7ff86c02b710 comp rx=0 tx=0).stop 2023-12-19T05:39:05.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f425a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4254007430 0x7f42540c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f425a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4254007430 0x7f42540c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59738/0 (socket says 172.21.15.120:59738) 2023-12-19T05:39:05.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f4259d9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f425403c890 0x7f4254037590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f4259d9b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f425403c890 0x7f4254037590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:44308/0 (socket says 172.21.15.120:44308) 2023-12-19T05:39:05.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f4260b4e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42540cedb0 0x7f4254037ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f74e08af640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc0b2d90 0x7f74dc143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.161 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.130+0000 7fdb0c8b4640 1 -- start start 2023-12-19T05:39:05.161 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f4259d9b640 1 -- 172.21.15.120:0/1706885461 learned_addr learned my addr 172.21.15.120:0/1706885461 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.161 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7fdb0c8b4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb00007260 0x7fdb0001ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.161 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.130+0000 7f8195832640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f819006ca80 0x7f819014eb90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f818800bd80 tx=0x7f8188009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f4260b4e640 1 -- 172.21.15.120:0/1706885461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42540d3020 con 0x7f42540cedb0 2023-12-19T05:39:05.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f4260b4e640 1 -- 172.21.15.120:0/1706885461 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42540c9db0 con 0x7f4254007430 2023-12-19T05:39:05.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7ff87f238640 1 -- 172.21.15.120:0/135164946 shutdown_connections 2023-12-19T05:39:05.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f4260b4e640 1 -- 172.21.15.120:0/1706885461 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42540cbd40 con 0x7f425403c890 2023-12-19T05:39:05.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7fdb0c8b4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb000398f0 0x7fdb0016a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f425ad9d640 1 --2- 172.21.15.120:0/1706885461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42540cedb0 0x7f4254037ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7ff87f238640 1 --2- 172.21.15.120:0/135164946 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff8780b7d90 0x7ff878144ad0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7ff87f238640 1 -- 172.21.15.120:0/135164946 >> 172.21.15.120:0/135164946 conn(0x7ff8780c0340 msgr2=0x7ff8780c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f74e08af640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc0b2d90 0x7f74dc143b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45420/0 (socket says 172.21.15.120:45420) 2023-12-19T05:39:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7fdb077fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb00007260 0x7fdb0001ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7fdb077fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb00007260 0x7fdb0001ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59746/0 (socket says 172.21.15.120:59746) 2023-12-19T05:39:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7fdb06ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb000398f0 0x7fdb0016a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7fdb06ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb000398f0 0x7fdb0016a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45440/0 (socket says 172.21.15.120:45440) 2023-12-19T05:39:05.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f81867fc640 1 -- 172.21.15.120:0/1076096918 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8188011710 con 0x7f819006ca80 2023-12-19T05:39:05.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7fdb077fe640 1 -- 172.21.15.120:0/3867391526 learned_addr learned my addr 172.21.15.120:0/3867391526 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f81867fc640 1 -- 172.21.15.120:0/1076096918 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818800f050 con 0x7f819006ca80 2023-12-19T05:39:05.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f81867fc640 1 -- 172.21.15.120:0/1076096918 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8188011b10 con 0x7f819006ca80 2023-12-19T05:39:05.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7fdb0c8b4640 1 --2- 172.21.15.120:0/3867391526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb000cfb00 0x7fdb000c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7ff87f238640 1 -- 172.21.15.120:0/135164946 shutdown_connections 2023-12-19T05:39:05.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7ff87f238640 1 -- 172.21.15.120:0/135164946 wait complete. 2023-12-19T05:39:05.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7f8f03626640 1 -- 172.21.15.120:0/3214584062 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc005250 con 0x7f8efc069f70 2023-12-19T05:39:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7f425ad9d640 1 -- 172.21.15.120:0/1706885461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f425403c890 msgr2=0x7f4254037590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7f425ad9d640 1 --2- 172.21.15.120:0/1706885461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f425403c890 0x7f4254037590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7f425ad9d640 1 -- 172.21.15.120:0/1706885461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4254007430 msgr2=0x7f42540c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7f425ad9d640 1 --2- 172.21.15.120:0/1706885461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4254007430 0x7f42540c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7f425ad9d640 1 -- 172.21.15.120:0/1706885461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424c009400 con 0x7f42540cedb0 2023-12-19T05:39:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7f425ad9d640 1 --2- 172.21.15.120:0/1706885461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42540cedb0 0x7f4254037ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f424c033000 tx=0x7f424c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.131+0000 7f74e08af640 1 -- 172.21.15.120:0/312674935 learned_addr learned my addr 172.21.15.120:0/312674935 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.133+0000 7f8ef1ffb640 1 -- 172.21.15.120:0/3214584062 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8eec0437a0 con 0x7f8efc069f70 2023-12-19T05:39:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/3867391526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0001c4e0 con 0x7fdb000398f0 2023-12-19T05:39:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/3867391526 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0001d760 con 0x7fdb00007260 2023-12-19T05:39:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/3867391526 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0016a510 con 0x7fdb000cfb00 2023-12-19T05:39:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.133+0000 7fdb07fff640 1 --2- 172.21.15.120:0/3867391526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb000cfb00 0x7fdb000c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.133+0000 7f74e08af640 1 -- 172.21.15.120:0/312674935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74dc14c490 msgr2=0x7f74dc13dfe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T05:39:05.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.133+0000 7f74e08af640 1 --2- 172.21.15.120:0/312674935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74dc14c490 0x7f74dc13dfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.169 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.133+0000 7f74e08af640 1 -- 172.21.15.120:0/312674935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc06a120 msgr2=0x7f74dc146dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T05:39:05.169 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.133+0000 7f74e08af640 1 --2- 172.21.15.120:0/312674935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc06a120 0x7f74dc146dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.169 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.133+0000 7f74e08af640 1 -- 172.21.15.120:0/312674935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d4009b30 con 0x7f74dc0b2d90 2023-12-19T05:39:05.169 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.133+0000 7ff87f238640 1 Processor -- start 2023-12-19T05:39:05.169 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.133+0000 7ff87f238640 1 -- start start 2023-12-19T05:39:05.169 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.133+0000 7f8ef1ffb640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8ee006a500 0x7f8ee006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.133+0000 7f74e08af640 1 --2- 172.21.15.120:0/312674935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc0b2d90 0x7f74dc143b90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f74d800c400 tx=0x7f74d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.134+0000 7f8f00bc1640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8ee006a500 0x7f8ee006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.134+0000 7fdb06ffd640 1 -- 172.21.15.120:0/3867391526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb000cfb00 msgr2=0x7fdb000c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.134+0000 7fdb06ffd640 1 --2- 172.21.15.120:0/3867391526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb000cfb00 0x7fdb000c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.134+0000 7fdb06ffd640 1 -- 172.21.15.120:0/3867391526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb00007260 msgr2=0x7fdb0001ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.134+0000 7fdb06ffd640 1 --2- 172.21.15.120:0/3867391526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb00007260 0x7fdb0001ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.134+0000 7fdb06ffd640 1 -- 172.21.15.120:0/3867391526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0804ef70 con 0x7fdb000398f0 2023-12-19T05:39:05.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.134+0000 7fdb06ffd640 1 --2- 172.21.15.120:0/3867391526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb000398f0 0x7fdb0016a9a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400e850 tx=0x7fdaf400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7f8197a96640 1 -- 172.21.15.120:0/1076096918 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819014fa10 con 0x7f819006ca80 2023-12-19T05:39:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.134+0000 7f8ef1ffb640 1 -- 172.21.15.120:0/3214584062 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8eec03e070 con 0x7f8efc069f70 2023-12-19T05:39:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.134+0000 7f8f00bc1640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8ee006a500 0x7f8ee006c9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8efc1454d0 tx=0x7f8ef400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.132+0000 7f8197a96640 1 -- 172.21.15.120:0/1076096918 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8190142550 con 0x7f819006ca80 2023-12-19T05:39:05.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.134+0000 7ff87f238640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8780b79b0 0x7ff8780b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.134+0000 7f81867fc640 1 -- 172.21.15.120:0/1076096918 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8188011c70 con 0x7f819006ca80 2023-12-19T05:39:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87f238640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8780b7d90 0x7ff8781e3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.134+0000 7f8197a96640 1 -- 172.21.15.120:0/1076096918 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8178005250 con 0x7f819006ca80 2023-12-19T05:39:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87f238640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff878145010 0x7ff8780a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87cfd4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8780b79b0 0x7ff8780b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87cfd4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8780b79b0 0x7ff8780b26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:44346/0 (socket says 172.21.15.120:44346) 2023-12-19T05:39:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87f238640 1 -- 172.21.15.120:0/1608325842 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780b2bf0 con 0x7ff878145010 2023-12-19T05:39:05.174 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7f81867fc640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f817406a500 0x7f817406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87f238640 1 -- 172.21.15.120:0/1608325842 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8780a7430 con 0x7ff8780b7d90 2023-12-19T05:39:05.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87f238640 1 -- 172.21.15.120:0/1608325842 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8781e2b10 con 0x7ff8780b79b0 2023-12-19T05:39:05.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87d7d5640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff878145010 0x7ff8780a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87cfd4640 1 -- 172.21.15.120:0/1608325842 learned_addr learned my addr 172.21.15.120:0/1608325842 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff877fff640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8780b7d90 0x7ff8781e3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.176 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7f81867fc640 1 -- 172.21.15.120:0/1076096918 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81880893b0 con 0x7f819006ca80 2023-12-19T05:39:05.176 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7f8195031640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f817406a500 0x7f817406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.176 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87cfd4640 1 -- 172.21.15.120:0/1608325842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8780b7d90 msgr2=0x7ff8781e3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.176 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87cfd4640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8780b7d90 0x7ff8781e3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87cfd4640 1 -- 172.21.15.120:0/1608325842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff878145010 msgr2=0x7ff8780a5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87cfd4640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff878145010 0x7ff8780a5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87cfd4640 1 -- 172.21.15.120:0/1608325842 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c009400 con 0x7ff8780b79b0 2023-12-19T05:39:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.135+0000 7ff87d7d5640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff878145010 0x7ff8780a5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.136+0000 7ff87cfd4640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8780b79b0 0x7ff8780b26b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff86800c890 tx=0x7ff86800cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.136+0000 7ff8757fa640 1 -- 172.21.15.120:0/1608325842 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8680074e0 con 0x7ff8780b79b0 2023-12-19T05:39:05.177 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.136+0000 7f8195031640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f817406a500 0x7f817406c9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f819006fb80 tx=0x7f8180009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.136+0000 7ff8757fa640 1 -- 172.21.15.120:0/1608325842 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff868007640 con 0x7ff8780b79b0 2023-12-19T05:39:05.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.136+0000 7ff87f238640 1 -- 172.21.15.120:0/1608325842 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff878146eb0 con 0x7ff8780b79b0 2023-12-19T05:39:05.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.136+0000 7ff87f238640 1 -- 172.21.15.120:0/1608325842 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8780a6b40 con 0x7ff8780b79b0 2023-12-19T05:39:05.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.136+0000 7ff8757fa640 1 -- 172.21.15.120:0/1608325842 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868004a00 con 0x7ff8780b79b0 2023-12-19T05:39:05.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.137+0000 7ff87f238640 1 -- 172.21.15.120:0/1608325842 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff858005250 con 0x7ff8780b79b0 2023-12-19T05:39:05.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.138+0000 7ff8757fa640 1 -- 172.21.15.120:0/1608325842 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff868004b60 con 0x7ff8780b79b0 2023-12-19T05:39:05.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.138+0000 7ff8757fa640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff86406a430 0x7ff86406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7f74d1ffb640 1 -- 172.21.15.120:0/312674935 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d80074e0 con 0x7f74dc0b2d90 2023-12-19T05:39:05.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.138+0000 7f424affd640 1 -- 172.21.15.120:0/1706885461 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c032820 con 0x7f42540cedb0 2023-12-19T05:39:05.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7f424affd640 1 -- 172.21.15.120:0/1706885461 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c0329c0 con 0x7f42540cedb0 2023-12-19T05:39:05.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7fdaf3fff640 1 -- 172.21.15.120:0/3867391526 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40095b0 con 0x7fdb000398f0 2023-12-19T05:39:05.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/3867391526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0001bcf0 con 0x7fdb000398f0 2023-12-19T05:39:05.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/3867391526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb00037f20 con 0x7fdb000398f0 2023-12-19T05:39:05.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7f8ef1ffb640 1 -- 172.21.15.120:0/3214584062 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8eec076f20 con 0x7f8efc069f70 2023-12-19T05:39:05.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7f81867fc640 1 -- 172.21.15.120:0/1076096918 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f81880548f0 con 0x7f819006ca80 2023-12-19T05:39:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7f74e3314640 1 -- 172.21.15.120:0/312674935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74dc1440d0 con 0x7f74dc0b2d90 2023-12-19T05:39:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7f74d1ffb640 1 -- 172.21.15.120:0/312674935 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d8007640 con 0x7f74dc0b2d90 2023-12-19T05:39:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7f74d1ffb640 1 -- 172.21.15.120:0/312674935 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d80049e0 con 0x7f74dc0b2d90 2023-12-19T05:39:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7f74e3314640 1 -- 172.21.15.120:0/312674935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc0700a0 con 0x7f74dc0b2d90 2023-12-19T05:39:05.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.138+0000 7ff8757fa640 1 -- 172.21.15.120:0/1608325842 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff868087d50 con 0x7ff8780b79b0 2023-12-19T05:39:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7ff877fff640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff86406a430 0x7ff86406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7f424affd640 1 -- 172.21.15.120:0/1706885461 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c032d70 con 0x7f42540cedb0 2023-12-19T05:39:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7f4260b4e640 1 -- 172.21.15.120:0/1706885461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42540cad50 con 0x7f42540cedb0 2023-12-19T05:39:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7f4260b4e640 1 -- 172.21.15.120:0/1706885461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42540cb3e0 con 0x7f42540cedb0 2023-12-19T05:39:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.139+0000 7fdaf3fff640 1 -- 172.21.15.120:0/3867391526 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf4005990 con 0x7fdb000398f0 2023-12-19T05:39:05.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.140+0000 7fdaf3fff640 1 -- 172.21.15.120:0/3867391526 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4005d00 con 0x7fdb000398f0 2023-12-19T05:39:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.140+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/3867391526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae8005250 con 0x7fdb000398f0 2023-12-19T05:39:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.140+0000 7f74e3314640 1 -- 172.21.15.120:0/312674935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74dc143660 con 0x7f74dc0b2d90 2023-12-19T05:39:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.140+0000 7f4260b4e640 1 -- 172.21.15.120:0/1706885461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42540cbe80 con 0x7f42540cedb0 2023-12-19T05:39:05.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.142+0000 7ff877fff640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff86406a430 0x7ff86406c8f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff86c034000 tx=0x7ff86c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.142+0000 7f74d1ffb640 1 -- 172.21.15.120:0/312674935 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f74d8004b40 con 0x7f74dc0b2d90 2023-12-19T05:39:05.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.142+0000 7fdaf3fff640 1 -- 172.21.15.120:0/3867391526 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdaf400c940 con 0x7fdb000398f0 2023-12-19T05:39:05.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.143+0000 7f74d1ffb640 1 --2- 172.21.15.120:0/312674935 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f74c006a430 0x7f74c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.142+0000 7fdaf3fff640 1 --2- 172.21.15.120:0/3867391526 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdaec06a430 0x7fdaec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.142+0000 7fdaf3fff640 1 -- 172.21.15.120:0/3867391526 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdaf4088da0 con 0x7fdb000398f0 2023-12-19T05:39:05.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.143+0000 7f74d1ffb640 1 -- 172.21.15.120:0/312674935 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74d80886f0 con 0x7f74dc0b2d90 2023-12-19T05:39:05.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.143+0000 7f424affd640 1 -- 172.21.15.120:0/1706885461 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f424c04d3f0 con 0x7f42540cedb0 2023-12-19T05:39:05.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.143+0000 7f424affd640 1 --2- 172.21.15.120:0/1706885461 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f423c06a460 0x7f423c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.143+0000 7fdb077fe640 1 --2- 172.21.15.120:0/3867391526 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdaec06a430 0x7fdaec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.143+0000 7f74e10b0640 1 --2- 172.21.15.120:0/312674935 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f74c006a430 0x7f74c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.143+0000 7f424affd640 1 -- 172.21.15.120:0/1706885461 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f424c0aa300 con 0x7f42540cedb0 2023-12-19T05:39:05.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.144+0000 7f425a59c640 1 --2- 172.21.15.120:0/1706885461 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f423c06a460 0x7f423c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.144+0000 7f74e10b0640 1 --2- 172.21.15.120:0/312674935 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f74c006a430 0x7f74c006c8f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00a830 tx=0x7f74cc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.143+0000 7ff8757fa640 1 -- 172.21.15.120:0/1608325842 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff86808b030 con 0x7ff8780b79b0 2023-12-19T05:39:05.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.144+0000 7fdb077fe640 1 --2- 172.21.15.120:0/3867391526 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdaec06a430 0x7fdaec06c8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdafc000f60 tx=0x7fdafc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.145+0000 7f425a59c640 1 --2- 172.21.15.120:0/1706885461 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f423c06a460 0x7f423c06c920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4250006fd0 tx=0x7f4250008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.151+0000 7f424affd640 1 -- 172.21.15.120:0/1706885461 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f424c075a80 con 0x7f42540cedb0 2023-12-19T05:39:05.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.159+0000 7fdaf3fff640 1 -- 172.21.15.120:0/3867391526 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdaf4054420 con 0x7fdb000398f0 2023-12-19T05:39:05.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.167+0000 7f74d1ffb640 1 -- 172.21.15.120:0/312674935 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f74d8053d50 con 0x7f74dc0b2d90 2023-12-19T05:39:05.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.456+0000 7f8160e04640 1 -- 172.21.15.120:0/222472155 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f815403e860 con 0x7f8154007590 2023-12-19T05:39:05.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.457+0000 7f8147fff640 1 -- 172.21.15.120:0/222472155 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8150017020 con 0x7f8154007590 2023-12-19T05:39:05.458 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2023-12-19T05:39:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.460+0000 7f8145ffb640 1 -- 172.21.15.120:0/222472155 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f814c06a6f0 msgr2=0x7f814c06cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.461+0000 7f8145ffb640 1 --2- 172.21.15.120:0/222472155 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f814c06a6f0 0x7f814c06cbb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8154004dc0 tx=0x7f815c0aa000 comp rx=0 tx=0).stop 2023-12-19T05:39:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.461+0000 7f8145ffb640 1 -- 172.21.15.120:0/222472155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8154007590 msgr2=0x7f8154037090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.461+0000 7f8145ffb640 1 --2- 172.21.15.120:0/222472155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8154007590 0x7f8154037090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f815000c410 tx=0x7f815000c810 comp rx=0 tx=0).stop 2023-12-19T05:39:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.461+0000 7f8145ffb640 1 -- 172.21.15.120:0/222472155 shutdown_connections 2023-12-19T05:39:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.461+0000 7f8145ffb640 1 --2- 172.21.15.120:0/222472155 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f814c06a6f0 0x7f814c06cbb0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8154004dc0 tx=0x7f815c0aa000 comp rx=0 tx=0).stop 2023-12-19T05:39:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.461+0000 7f8145ffb640 1 --2- 172.21.15.120:0/222472155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8154176020 0x7f81541764b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.461+0000 7f8145ffb640 1 --2- 172.21.15.120:0/222472155 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f81540d67b0 0x7f81540d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.461+0000 7f8145ffb640 1 --2- 172.21.15.120:0/222472155 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8154007590 0x7f8154037090 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.461+0000 7f8145ffb640 1 -- 172.21.15.120:0/222472155 >> 172.21.15.120:0/222472155 conn(0x7f815403f2a0 msgr2=0x7f8154040f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.462+0000 7f8145ffb640 1 -- 172.21.15.120:0/222472155 shutdown_connections 2023-12-19T05:39:05.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.462+0000 7f8145ffb640 1 -- 172.21.15.120:0/222472155 wait complete. 2023-12-19T05:39:05.476 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.475+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/3320184928 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa7880057d0 con 0x7fa7a00712e0 2023-12-19T05:39:05.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.477+0000 7fa7967fc640 1 -- 172.21.15.120:0/3320184928 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7980576f0 con 0x7fa7a00712e0 2023-12-19T05:39:05.479 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2023-12-19T05:39:05.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-12-19T05:39:05.479 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:05.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.480+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/3320184928 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa78c06a960 msgr2=0x7fa78c06ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.480+0000 7fa7a7fe0640 1 --2- 172.21.15.120:0/3320184928 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa78c06a960 0x7fa78c06ce20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa790009930 tx=0x7fa790009190 comp rx=0 tx=0).stop 2023-12-19T05:39:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.480+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/3320184928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a00712e0 msgr2=0x7fa7a0146670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.480+0000 7fa7a7fe0640 1 --2- 172.21.15.120:0/3320184928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a00712e0 0x7fa7a0146670 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa79800cb10 tx=0x7fa79800a060 comp rx=0 tx=0).stop 2023-12-19T05:39:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.480+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/3320184928 shutdown_connections 2023-12-19T05:39:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.480+0000 7fa7a7fe0640 1 --2- 172.21.15.120:0/3320184928 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa78c06a960 0x7fa78c06ce20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.480+0000 7fa7a7fe0640 1 --2- 172.21.15.120:0/3320184928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7a00712e0 0x7fa7a0146670 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.480+0000 7fa7a7fe0640 1 --2- 172.21.15.120:0/3320184928 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7a006f3f0 0x7fa7a014c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.480+0000 7fa7a7fe0640 1 --2- 172.21.15.120:0/3320184928 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa7a006efd0 0x7fa7a014fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.480+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/3320184928 >> 172.21.15.120:0/3320184928 conn(0x7fa7a00b8b90 msgr2=0x7fa7a00b7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.481+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/3320184928 shutdown_connections 2023-12-19T05:39:05.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.481+0000 7fa7a7fe0640 1 -- 172.21.15.120:0/3320184928 wait complete. 2023-12-19T05:39:05.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-12-19T05:39:05.497 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:05.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.504+0000 7f8197a96640 1 -- 172.21.15.120:0/1076096918 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f8178005500 con 0x7f819006ca80 2023-12-19T05:39:05.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.505+0000 7f81867fc640 1 -- 172.21.15.120:0/1076096918 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8188057f10 con 0x7f819006ca80 2023-12-19T05:39:05.506 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2023-12-19T05:39:05.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.507+0000 7f8197a96640 1 -- 172.21.15.120:0/1076096918 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f817406a500 msgr2=0x7f817406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.507+0000 7f8197a96640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f817406a500 0x7f817406c9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f819006fb80 tx=0x7f8180009040 comp rx=0 tx=0).stop 2023-12-19T05:39:05.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.507+0000 7f8197a96640 1 -- 172.21.15.120:0/1076096918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f819006ca80 msgr2=0x7f819014eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.507+0000 7f8197a96640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f819006ca80 0x7f819014eb90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f818800bd80 tx=0x7f8188009ed0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.507+0000 7f8197a96640 1 -- 172.21.15.120:0/1076096918 shutdown_connections 2023-12-19T05:39:05.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.507+0000 7f8197a96640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f817406a500 0x7f817406c9c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.507+0000 7f8197a96640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8190149180 0x7f81901396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.507+0000 7f8197a96640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f81900b2a10 0x7f819014da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.507+0000 7f8197a96640 1 --2- 172.21.15.120:0/1076096918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f819006ca80 0x7f819014eb90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.507+0000 7f8197a96640 1 -- 172.21.15.120:0/1076096918 >> 172.21.15.120:0/1076096918 conn(0x7f81900b8810 msgr2=0x7f8190146910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.507+0000 7f8197a96640 1 -- 172.21.15.120:0/1076096918 shutdown_connections 2023-12-19T05:39:05.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.507+0000 7f8197a96640 1 -- 172.21.15.120:0/1076096918 wait complete. 2023-12-19T05:39:05.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-12-19T05:39:05.519 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:05.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.519+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/3867391526 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fdae80057d0 con 0x7fdb000398f0 2023-12-19T05:39:05.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.519+0000 7fdaf3fff640 1 -- 172.21.15.120:0/3867391526 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdaf4021020 con 0x7fdb000398f0 2023-12-19T05:39:05.520 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2023-12-19T05:39:05.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.521+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/3867391526 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdaec06a430 msgr2=0x7fdaec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.521+0000 7fdb0c8b4640 1 --2- 172.21.15.120:0/3867391526 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdaec06a430 0x7fdaec06c8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdafc000f60 tx=0x7fdafc009040 comp rx=0 tx=0).stop 2023-12-19T05:39:05.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.521+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/3867391526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb000398f0 msgr2=0x7fdb0016a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.521+0000 7fdb0c8b4640 1 --2- 172.21.15.120:0/3867391526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb000398f0 0x7fdb0016a9a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400e850 tx=0x7fdaf400ed10 comp rx=0 tx=0).stop 2023-12-19T05:39:05.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.521+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/3867391526 shutdown_connections 2023-12-19T05:39:05.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.521+0000 7fdb0c8b4640 1 --2- 172.21.15.120:0/3867391526 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdaec06a430 0x7fdaec06c8f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.521+0000 7fdb0c8b4640 1 --2- 172.21.15.120:0/3867391526 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdb000cfb00 0x7fdb000c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.521+0000 7fdb0c8b4640 1 --2- 172.21.15.120:0/3867391526 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdb000398f0 0x7fdb0016a9a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.521+0000 7fdb0c8b4640 1 --2- 172.21.15.120:0/3867391526 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb00007260 0x7fdb0001ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.521+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/3867391526 >> 172.21.15.120:0/3867391526 conn(0x7fdb0003ef70 msgr2=0x7fdb0003f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.521+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/3867391526 shutdown_connections 2023-12-19T05:39:05.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.521+0000 7fdb0c8b4640 1 -- 172.21.15.120:0/3867391526 wait complete. 2023-12-19T05:39:05.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-12-19T05:39:05.533 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:05.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.537+0000 7ff87f238640 1 -- 172.21.15.120:0/1608325842 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff8580057d0 con 0x7ff8780b79b0 2023-12-19T05:39:05.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.537+0000 7ff8757fa640 1 -- 172.21.15.120:0/1608325842 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff868056e90 con 0x7ff8780b79b0 2023-12-19T05:39:05.538 INFO:teuthology.orchestra.run.smithi120.stdout:55834574854 2023-12-19T05:39:05.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.540+0000 7ff87f238640 1 -- 172.21.15.120:0/1608325842 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff86406a430 msgr2=0x7ff86406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.540+0000 7ff87f238640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff86406a430 0x7ff86406c8f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff86c034000 tx=0x7ff86c008030 comp rx=0 tx=0).stop 2023-12-19T05:39:05.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.540+0000 7ff87f238640 1 -- 172.21.15.120:0/1608325842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8780b79b0 msgr2=0x7ff8780b26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.540+0000 7ff87f238640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8780b79b0 0x7ff8780b26b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff86800c890 tx=0x7ff86800cd50 comp rx=0 tx=0).stop 2023-12-19T05:39:05.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.540+0000 7ff87f238640 1 -- 172.21.15.120:0/1608325842 shutdown_connections 2023-12-19T05:39:05.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.540+0000 7f8f03626640 1 -- 172.21.15.120:0/3214584062 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f8edc005500 con 0x7f8efc069f70 2023-12-19T05:39:05.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.540+0000 7ff87f238640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff86406a430 0x7ff86406c8f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.540+0000 7ff87f238640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff878145010 0x7ff8780a5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.540+0000 7ff87f238640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8780b7d90 0x7ff8781e3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.540+0000 7ff87f238640 1 --2- 172.21.15.120:0/1608325842 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff8780b79b0 0x7ff8780b26b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.540+0000 7ff87f238640 1 -- 172.21.15.120:0/1608325842 >> 172.21.15.120:0/1608325842 conn(0x7ff8780c0340 msgr2=0x7ff8780b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.540+0000 7ff87f238640 1 -- 172.21.15.120:0/1608325842 shutdown_connections 2023-12-19T05:39:05.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.540+0000 7ff87f238640 1 -- 172.21.15.120:0/1608325842 wait complete. 2023-12-19T05:39:05.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.541+0000 7f8ef1ffb640 1 -- 172.21.15.120:0/3214584062 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8eec07a540 con 0x7f8efc069f70 2023-12-19T05:39:05.543 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2023-12-19T05:39:05.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.543+0000 7f8f03626640 1 -- 172.21.15.120:0/3214584062 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8ee006a500 msgr2=0x7f8ee006c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.543+0000 7f8f03626640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8ee006a500 0x7f8ee006c9c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8efc1454d0 tx=0x7f8ef400b040 comp rx=0 tx=0).stop 2023-12-19T05:39:05.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.543+0000 7f8f03626640 1 -- 172.21.15.120:0/3214584062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc069f70 msgr2=0x7f8efc14baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.543+0000 7f8f03626640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc069f70 0x7f8efc14baf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8eec000c00 tx=0x7f8eec004730 comp rx=0 tx=0).stop 2023-12-19T05:39:05.544 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.543+0000 7f8f03626640 1 -- 172.21.15.120:0/3214584062 shutdown_connections 2023-12-19T05:39:05.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.543+0000 7f8f03626640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8ee006a500 0x7f8ee006c9c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.543+0000 7f8f03626640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8efc148dd0 0x7f8efc0b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.543+0000 7f8f03626640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8efc06fa50 0x7f8efc0b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.543+0000 7f8f03626640 1 --2- 172.21.15.120:0/3214584062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8efc069f70 0x7f8efc14baf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.543+0000 7f8f03626640 1 -- 172.21.15.120:0/3214584062 >> 172.21.15.120:0/3214584062 conn(0x7f8efc0b8b90 msgr2=0x7f8efc14ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.543+0000 7f8f03626640 1 -- 172.21.15.120:0/3214584062 shutdown_connections 2023-12-19T05:39:05.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.543+0000 7f8f03626640 1 -- 172.21.15.120:0/3214584062 wait complete. 2023-12-19T05:39:05.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.545+0000 7f4260b4e640 1 -- 172.21.15.120:0/1706885461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f42540cbe80 con 0x7f42540cedb0 2023-12-19T05:39:05.546 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.545+0000 7f424affd640 1 -- 172.21.15.120:0/1706885461 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f42540cbe80 con 0x7f42540cedb0 2023-12-19T05:39:05.546 INFO:teuthology.orchestra.run.smithi120.stdout:55834574855 2023-12-19T05:39:05.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.549+0000 7f4260b4e640 1 -- 172.21.15.120:0/1706885461 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f423c06a460 msgr2=0x7f423c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.549+0000 7f4260b4e640 1 --2- 172.21.15.120:0/1706885461 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f423c06a460 0x7f423c06c920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4250006fd0 tx=0x7f4250008040 comp rx=0 tx=0).stop 2023-12-19T05:39:05.550 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.549+0000 7f4260b4e640 1 -- 172.21.15.120:0/1706885461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42540cedb0 msgr2=0x7f4254037ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.549+0000 7f4260b4e640 1 --2- 172.21.15.120:0/1706885461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42540cedb0 0x7f4254037ad0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f424c033000 tx=0x7f424c0046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.549+0000 7f4260b4e640 1 -- 172.21.15.120:0/1706885461 shutdown_connections 2023-12-19T05:39:05.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.549+0000 7f4260b4e640 1 --2- 172.21.15.120:0/1706885461 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f423c06a460 0x7f423c06c920 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.549+0000 7f4260b4e640 1 --2- 172.21.15.120:0/1706885461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f42540cedb0 0x7f4254037ad0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.549+0000 7f4260b4e640 1 --2- 172.21.15.120:0/1706885461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f425403c890 0x7f4254037590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.549+0000 7f4260b4e640 1 --2- 172.21.15.120:0/1706885461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4254007430 0x7f42540c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.549+0000 7f4260b4e640 1 -- 172.21.15.120:0/1706885461 >> 172.21.15.120:0/1706885461 conn(0x7f4254041060 msgr2=0x7f4254004970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.549+0000 7f4260b4e640 1 -- 172.21.15.120:0/1706885461 shutdown_connections 2023-12-19T05:39:05.551 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.549+0000 7f4260b4e640 1 -- 172.21.15.120:0/1706885461 wait complete. 2023-12-19T05:39:05.555 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.554+0000 7f74e3314640 1 -- 172.21.15.120:0/312674935 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f74dc04e080 con 0x7f74dc0b2d90 2023-12-19T05:39:05.555 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.555+0000 7f74d1ffb640 1 -- 172.21.15.120:0/312674935 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74d8057370 con 0x7f74dc0b2d90 2023-12-19T05:39:05.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-12-19T05:39:05.556 INFO:teuthology.orchestra.run.smithi120.stdout:55834574856 2023-12-19T05:39:05.557 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:05.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-12-19T05:39:05.557 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:05.558 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.557+0000 7f74e3314640 1 -- 172.21.15.120:0/312674935 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f74c006a430 msgr2=0x7f74c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.558 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.557+0000 7f74e3314640 1 --2- 172.21.15.120:0/312674935 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f74c006a430 0x7f74c006c8f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00a830 tx=0x7f74cc008040 comp rx=0 tx=0).stop 2023-12-19T05:39:05.559 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.557+0000 7f74e3314640 1 -- 172.21.15.120:0/312674935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc0b2d90 msgr2=0x7f74dc143b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.559 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.557+0000 7f74e3314640 1 --2- 172.21.15.120:0/312674935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc0b2d90 0x7f74dc143b90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f74d800c400 tx=0x7f74d800c8c0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.559 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.557+0000 7f74e3314640 1 -- 172.21.15.120:0/312674935 shutdown_connections 2023-12-19T05:39:05.559 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.557+0000 7f74e3314640 1 --2- 172.21.15.120:0/312674935 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f74c006a430 0x7f74c006c8f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.559 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.557+0000 7f74e3314640 1 --2- 172.21.15.120:0/312674935 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f74dc14c490 0x7f74dc13dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.559 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.557+0000 7f74e3314640 1 --2- 172.21.15.120:0/312674935 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f74dc0b2d90 0x7f74dc143b90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.559 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.557+0000 7f74e3314640 1 --2- 172.21.15.120:0/312674935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74dc06a120 0x7f74dc146dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.559 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.557+0000 7f74e3314640 1 -- 172.21.15.120:0/312674935 >> 172.21.15.120:0/312674935 conn(0x7f74dc0b8dd0 msgr2=0x7f74dc147960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.559 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.557+0000 7f74e3314640 1 -- 172.21.15.120:0/312674935 shutdown_connections 2023-12-19T05:39:05.559 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.557+0000 7f74e3314640 1 -- 172.21.15.120:0/312674935 wait complete. 2023-12-19T05:39:05.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-12-19T05:39:05.564 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:05.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-12-19T05:39:05.569 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:05.570 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T05:39:05.570 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:05.710 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.707+0000 7f35cac41640 1 Processor -- start 2023-12-19T05:39:05.710 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.707+0000 7f35cac41640 1 -- start start 2023-12-19T05:39:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.707+0000 7f35cac41640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f35c40b79b0 0x7f35c40b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.707+0000 7f35cac41640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35c40b8860 0x7f35c4144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.707+0000 7f35cac41640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c40b96b0 con 0x7f35c4145010 2023-12-19T05:39:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.707+0000 7f35cac41640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c414ae10 con 0x7f35c40b79b0 2023-12-19T05:39:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.707+0000 7f35cac41640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40bacc0 con 0x7f35c40b8860 2023-12-19T05:39:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.708+0000 7f35bbfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35c40b8860 0x7f35c4144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.708+0000 7f35c89dd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f35c40b79b0 0x7f35c40b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.708+0000 7f35bbfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35c40b8860 0x7f35c4144ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:44362/0 (socket says 172.21.15.120:44362) 2023-12-19T05:39:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.708+0000 7f35c89dd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f35c40b79b0 0x7f35c40b7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59776/0 (socket says 172.21.15.120:59776) 2023-12-19T05:39:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.708+0000 7f35bbfff640 1 -- 172.21.15.120:0/3242953005 learned_addr learned my addr 172.21.15.120:0/3242953005 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.708+0000 7f35bbfff640 1 -- 172.21.15.120:0/3242953005 >> v2:172.21.15.155:3300/0 conn(0x7f35c40b79b0 msgr2=0x7f35c40b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.708+0000 7f35bbfff640 1 --2- 172.21.15.120:0/3242953005 >> v2:172.21.15.155:3300/0 conn(0x7f35c40b79b0 0x7f35c40b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.708+0000 7f35bbfff640 1 -- 172.21.15.120:0/3242953005 >> v1:172.21.15.155:6789/0 conn(0x7f35c4145010 legacy=0x7f35c414b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.708+0000 7f35bbfff640 1 -- 172.21.15.120:0/3242953005 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40b90f0 con 0x7f35c40b8860 2023-12-19T05:39:05.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.708+0000 7f35bb7fe640 1 -- 172.21.15.120:0/3242953005 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864648716 0 0) 0x7f35c40b96b0 con 0x7f35c4145010 2023-12-19T05:39:05.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.708+0000 7f35c89dd640 1 --2- 172.21.15.120:0/3242953005 >> v2:172.21.15.155:3300/0 conn(0x7f35c40b79b0 0x7f35c40b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:05.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.709+0000 7f35bbfff640 1 --2- 172.21.15.120:0/3242953005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35c40b8860 0x7f35c4144ad0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009870 tx=0x7f35b402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee912f994188d59 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.709+0000 7f35bb7fe640 1 -- 172.21.15.120:0/3242953005 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4030840 con 0x7f35c40b8860 2023-12-19T05:39:05.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.709+0000 7f35bb7fe640 1 -- 172.21.15.120:0/3242953005 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b40309a0 con 0x7f35c40b8860 2023-12-19T05:39:05.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.709+0000 7f35bb7fe640 1 -- 172.21.15.120:0/3242953005 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4030d30 con 0x7f35c40b8860 2023-12-19T05:39:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.710+0000 7f35cac41640 1 -- 172.21.15.120:0/3242953005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35c40b8860 msgr2=0x7f35c4144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.710+0000 7f35cac41640 1 --2- 172.21.15.120:0/3242953005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35c40b8860 0x7f35c4144ad0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009870 tx=0x7f35b402b980 comp rx=0 tx=0).stop 2023-12-19T05:39:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.710+0000 7f35cac41640 1 -- 172.21.15.120:0/3242953005 shutdown_connections 2023-12-19T05:39:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.710+0000 7f35cac41640 1 --2- 172.21.15.120:0/3242953005 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35c40b8860 0x7f35c4144ad0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.710+0000 7f35cac41640 1 --2- 172.21.15.120:0/3242953005 >> v2:172.21.15.155:3300/0 conn(0x7f35c40b79b0 0x7f35c40b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.710+0000 7f35cac41640 1 -- 172.21.15.120:0/3242953005 >> 172.21.15.120:0/3242953005 conn(0x7f35c40c0340 msgr2=0x7f35c40c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.710+0000 7f35cac41640 1 -- 172.21.15.120:0/3242953005 shutdown_connections 2023-12-19T05:39:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.710+0000 7f35cac41640 1 -- 172.21.15.120:0/3242953005 wait complete. 2023-12-19T05:39:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.711+0000 7f35cac41640 1 Processor -- start 2023-12-19T05:39:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.711+0000 7f35cac41640 1 -- start start 2023-12-19T05:39:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35cac41640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35c40b79b0 0x7f35c41e0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35cac41640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c40b8860 0x7f35c41d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35cac41640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35c4145010 0x7f35c41d41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35cac41640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c41e0650 con 0x7f35c40b8860 2023-12-19T05:39:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35cac41640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c41d5b40 con 0x7f35c4145010 2023-12-19T05:39:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35cac41640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c41e0000 con 0x7f35c40b79b0 2023-12-19T05:39:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35bbfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c40b8860 0x7f35c41d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35bbfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c40b8860 0x7f35c41d29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45456/0 (socket says 172.21.15.120:45456) 2023-12-19T05:39:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35bbfff640 1 -- 172.21.15.120:0/4117024544 learned_addr learned my addr 172.21.15.120:0/4117024544 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35c89dd640 1 --2- 172.21.15.120:0/4117024544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35c40b79b0 0x7f35c41e0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35c91de640 1 --2- 172.21.15.120:0/4117024544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35c4145010 0x7f35c41d41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35bbfff640 1 -- 172.21.15.120:0/4117024544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35c40b79b0 msgr2=0x7f35c41e0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35bbfff640 1 --2- 172.21.15.120:0/4117024544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35c40b79b0 0x7f35c41e0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35bbfff640 1 -- 172.21.15.120:0/4117024544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35c4145010 msgr2=0x7f35c41d41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35bbfff640 1 --2- 172.21.15.120:0/4117024544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35c4145010 0x7f35c41d41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35bbfff640 1 -- 172.21.15.120:0/4117024544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c0009400 con 0x7f35c40b8860 2023-12-19T05:39:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35bbfff640 1 --2- 172.21.15.120:0/4117024544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c40b8860 0x7f35c41d29d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009870 tx=0x7f35b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35b97fa640 1 -- 172.21.15.120:0/4117024544 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b403e040 con 0x7f35c40b8860 2023-12-19T05:39:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35b97fa640 1 -- 172.21.15.120:0/4117024544 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b4039c90 con 0x7f35c40b8860 2023-12-19T05:39:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35b97fa640 1 -- 172.21.15.120:0/4117024544 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4004030 con 0x7f35c40b8860 2023-12-19T05:39:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35cac41640 1 -- 172.21.15.120:0/4117024544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b40094d0 con 0x7f35c40b8860 2023-12-19T05:39:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.712+0000 7f35cac41640 1 -- 172.21.15.120:0/4117024544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c41d5e20 con 0x7f35c40b8860 2023-12-19T05:39:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.713+0000 7f35cac41640 1 -- 172.21.15.120:0/4117024544 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c41e0140 con 0x7f35c40b8860 2023-12-19T05:39:05.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.714+0000 7f35b97fa640 1 -- 172.21.15.120:0/4117024544 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f35b40041b0 con 0x7f35c40b8860 2023-12-19T05:39:05.718 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.714+0000 7f35b97fa640 1 --2- 172.21.15.120:0/4117024544 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f35b006a430 0x7f35b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:05.718 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.714+0000 7f35b97fa640 1 -- 172.21.15.120:0/4117024544 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35b40aac40 con 0x7f35c40b8860 2023-12-19T05:39:05.718 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.714+0000 7f35c89dd640 1 --2- 172.21.15.120:0/4117024544 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f35b006a430 0x7f35b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:05.718 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.715+0000 7f35c89dd640 1 --2- 172.21.15.120:0/4117024544 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f35b006a430 0x7f35b006c8f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009c60 tx=0x7f35c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:05.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.719+0000 7f35b97fa640 1 -- 172.21.15.120:0/4117024544 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f35c41e0140 con 0x7f35c40b8860 2023-12-19T05:39:05.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.884+0000 7f35cac41640 1 -- 172.21.15.120:0/4117024544 --> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35c41e0140 con 0x7f35b006a430 2023-12-19T05:39:05.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.890+0000 7f35b97fa640 1 -- 172.21.15.120:0/4117024544 <== mgr.4101 v2:172.21.15.120:6832/89586 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264532 (secure 0 0 0) 0x7f35c41e0140 con 0x7f35b006a430 2023-12-19T05:39:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:05.896 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2023-12-19T05:39:05.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.893+0000 7f35cac41640 1 -- 172.21.15.120:0/4117024544 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f35b006a430 msgr2=0x7f35b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.893+0000 7f35cac41640 1 --2- 172.21.15.120:0/4117024544 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f35b006a430 0x7f35b006c8f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009c60 tx=0x7f35c0008040 comp rx=0 tx=0).stop 2023-12-19T05:39:05.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.893+0000 7f35cac41640 1 -- 172.21.15.120:0/4117024544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c40b8860 msgr2=0x7f35c41d29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:05.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.893+0000 7f35cac41640 1 --2- 172.21.15.120:0/4117024544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c40b8860 0x7f35c41d29d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009870 tx=0x7f35b4004730 comp rx=0 tx=0).stop 2023-12-19T05:39:05.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.893+0000 7f35cac41640 1 -- 172.21.15.120:0/4117024544 shutdown_connections 2023-12-19T05:39:05.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.893+0000 7f35cac41640 1 --2- 172.21.15.120:0/4117024544 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f35b006a430 0x7f35b006c8f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.893+0000 7f35cac41640 1 --2- 172.21.15.120:0/4117024544 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f35c4145010 0x7f35c41d41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.893+0000 7f35cac41640 1 --2- 172.21.15.120:0/4117024544 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f35c40b8860 0x7f35c41d29d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.893+0000 7f35cac41640 1 --2- 172.21.15.120:0/4117024544 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f35c40b79b0 0x7f35c41e0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:05.899 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.893+0000 7f35cac41640 1 -- 172.21.15.120:0/4117024544 >> 172.21.15.120:0/4117024544 conn(0x7f35c40c0340 msgr2=0x7f35c4148970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:05.899 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.893+0000 7f35cac41640 1 -- 172.21.15.120:0/4117024544 shutdown_connections 2023-12-19T05:39:05.899 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:05.893+0000 7f35cac41640 1 -- 172.21.15.120:0/4117024544 wait complete. 2023-12-19T05:39:05.905 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-12-19T05:39:03.937507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218432,"kb_used_data":2816,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756288,"statfs":{"total":773094113280,"available":772870438912,"internally_reserved":0,"allocated":2883584,"data_stored":1750606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.207879"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581779+0000","last_change":"2023-12-19T05:38:58.110250+0000","last_active":"2023-12-19T05:38:59.581779+0000","last_peered":"2023-12-19T05:38:59.581779+0000","last_clean":"2023-12-19T05:38:59.581779+0000","last_became_active":"2023-12-19T05:38:58.109517+0000","last_became_peered":"2023-12-19T05:38:58.109517+0000","last_unstale":"2023-12-19T05:38:59.581779+0000","last_undegraded":"2023-12-19T05:38:59.581779+0000","last_fullsized":"2023-12-19T05:38:59.581779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583825+0000","last_change":"2023-12-19T05:38:58.105317+0000","last_active":"2023-12-19T05:38:59.583825+0000","last_peered":"2023-12-19T05:38:59.583825+0000","last_clean":"2023-12-19T05:38:59.583825+0000","last_became_active":"2023-12-19T05:38:58.105045+0000","last_became_peered":"2023-12-19T05:38:58.105045+0000","last_unstale":"2023-12-19T05:38:59.583825+0000","last_undegraded":"2023-12-19T05:38:59.583825+0000","last_fullsized":"2023-12-19T05:38:59.583825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581433+0000","last_change":"2023-12-19T05:38:58.100348+0000","last_active":"2023-12-19T05:38:59.581433+0000","last_peered":"2023-12-19T05:38:59.581433+0000","last_clean":"2023-12-19T05:38:59.581433+0000","last_became_active":"2023-12-19T05:38:58.100063+0000","last_became_peered":"2023-12-19T05:38:58.100063+0000","last_unstale":"2023-12-19T05:38:59.581433+0000","last_undegraded":"2023-12-19T05:38:59.581433+0000","last_fullsized":"2023-12-19T05:38:59.581433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:21:31.517735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581706+0000","last_change":"2023-12-19T05:38:58.104289+0000","last_active":"2023-12-19T05:38:59.581706+0000","last_peered":"2023-12-19T05:38:59.581706+0000","last_clean":"2023-12-19T05:38:59.581706+0000","last_became_active":"2023-12-19T05:38:58.104000+0000","last_became_peered":"2023-12-19T05:38:58.104000+0000","last_unstale":"2023-12-19T05:38:59.581706+0000","last_undegraded":"2023-12-19T05:38:59.581706+0000","last_fullsized":"2023-12-19T05:38:59.581706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:59.418017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581619+0000","last_change":"2023-12-19T05:38:58.107206+0000","last_active":"2023-12-19T05:38:59.581619+0000","last_peered":"2023-12-19T05:38:59.581619+0000","last_clean":"2023-12-19T05:38:59.581619+0000","last_became_active":"2023-12-19T05:38:58.106923+0000","last_became_peered":"2023-12-19T05:38:58.106923+0000","last_unstale":"2023-12-19T05:38:59.581619+0000","last_undegraded":"2023-12-19T05:38:59.581619+0000","last_fullsized":"2023-12-19T05:38:59.581619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:43.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581843+0000","last_change":"2023-12-19T05:38:58.105909+0000","last_active":"2023-12-19T05:38:59.581843+0000","last_peered":"2023-12-19T05:38:59.581843+0000","last_clean":"2023-12-19T05:38:59.581843+0000","last_became_active":"2023-12-19T05:38:58.105631+0000","last_became_peered":"2023-12-19T05:38:58.105631+0000","last_unstale":"2023-12-19T05:38:59.581843+0000","last_undegraded":"2023-12-19T05:38:59.581843+0000","last_fullsized":"2023-12-19T05:38:59.581843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:43.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581275+0000","last_change":"2023-12-19T05:38:58.111894+0000","last_active":"2023-12-19T05:38:59.581275+0000","last_peered":"2023-12-19T05:38:59.581275+0000","last_clean":"2023-12-19T05:38:59.581275+0000","last_became_active":"2023-12-19T05:38:58.111533+0000","last_became_peered":"2023-12-19T05:38:58.111533+0000","last_unstale":"2023-12-19T05:38:59.581275+0000","last_undegraded":"2023-12-19T05:38:59.581275+0000","last_fullsized":"2023-12-19T05:38:59.581275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:40:14.448992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090400+0000","last_change":"2023-12-19T05:38:58.101614+0000","last_active":"2023-12-19T05:38:59.090400+0000","last_peered":"2023-12-19T05:38:59.090400+0000","last_clean":"2023-12-19T05:38:59.090400+0000","last_became_active":"2023-12-19T05:38:58.101372+0000","last_became_peered":"2023-12-19T05:38:58.101372+0000","last_unstale":"2023-12-19T05:38:59.090400+0000","last_undegraded":"2023-12-19T05:38:59.090400+0000","last_fullsized":"2023-12-19T05:38:59.090400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581894+0000","last_change":"2023-12-19T05:38:58.113056+0000","last_active":"2023-12-19T05:38:59.581894+0000","last_peered":"2023-12-19T05:38:59.581894+0000","last_clean":"2023-12-19T05:38:59.581894+0000","last_became_active":"2023-12-19T05:38:58.112370+0000","last_became_peered":"2023-12-19T05:38:58.112370+0000","last_unstale":"2023-12-19T05:38:59.581894+0000","last_undegraded":"2023-12-19T05:38:59.581894+0000","last_fullsized":"2023-12-19T05:38:59.581894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:45:31.440161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090265+0000","last_change":"2023-12-19T05:38:58.098952+0000","last_active":"2023-12-19T05:38:59.090265+0000","last_peered":"2023-12-19T05:38:59.090265+0000","last_clean":"2023-12-19T05:38:59.090265+0000","last_became_active":"2023-12-19T05:38:58.098688+0000","last_became_peered":"2023-12-19T05:38:58.098688+0000","last_unstale":"2023-12-19T05:38:59.090265+0000","last_undegraded":"2023-12-19T05:38:59.090265+0000","last_fullsized":"2023-12-19T05:38:59.090265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089927+0000","last_change":"2023-12-19T05:38:58.101480+0000","last_active":"2023-12-19T05:38:59.089927+0000","last_peered":"2023-12-19T05:38:59.089927+0000","last_clean":"2023-12-19T05:38:59.089927+0000","last_became_active":"2023-12-19T05:38:58.101192+0000","last_became_peered":"2023-12-19T05:38:58.101192+0000","last_unstale":"2023-12-19T05:38:59.089927+0000","last_undegraded":"2023-12-19T05:38:59.089927+0000","last_fullsized":"2023-12-19T05:38:59.089927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:27.315801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090474+0000","last_change":"2023-12-19T05:38:58.091884+0000","last_active":"2023-12-19T05:38:59.090474+0000","last_peered":"2023-12-19T05:38:59.090474+0000","last_clean":"2023-12-19T05:38:59.090474+0000","last_became_active":"2023-12-19T05:38:58.091578+0000","last_became_peered":"2023-12-19T05:38:58.091578+0000","last_unstale":"2023-12-19T05:38:59.090474+0000","last_undegraded":"2023-12-19T05:38:59.090474+0000","last_fullsized":"2023-12-19T05:38:59.090474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:16.970670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090626+0000","last_change":"2023-12-19T05:38:58.101436+0000","last_active":"2023-12-19T05:38:59.090626+0000","last_peered":"2023-12-19T05:38:59.090626+0000","last_clean":"2023-12-19T05:38:59.090626+0000","last_became_active":"2023-12-19T05:38:58.100401+0000","last_became_peered":"2023-12-19T05:38:58.100401+0000","last_unstale":"2023-12-19T05:38:59.090626+0000","last_undegraded":"2023-12-19T05:38:59.090626+0000","last_fullsized":"2023-12-19T05:38:59.090626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:11:32.894490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581146+0000","last_change":"2023-12-19T05:38:58.102811+0000","last_active":"2023-12-19T05:38:59.581146+0000","last_peered":"2023-12-19T05:38:59.581146+0000","last_clean":"2023-12-19T05:38:59.581146+0000","last_became_active":"2023-12-19T05:38:58.102580+0000","last_became_peered":"2023-12-19T05:38:58.102580+0000","last_unstale":"2023-12-19T05:38:59.581146+0000","last_undegraded":"2023-12-19T05:38:59.581146+0000","last_fullsized":"2023-12-19T05:38:59.581146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583668+0000","last_change":"2023-12-19T05:38:58.102035+0000","last_active":"2023-12-19T05:38:59.583668+0000","last_peered":"2023-12-19T05:38:59.583668+0000","last_clean":"2023-12-19T05:38:59.583668+0000","last_became_active":"2023-12-19T05:38:58.101153+0000","last_became_peered":"2023-12-19T05:38:58.101153+0000","last_unstale":"2023-12-19T05:38:59.583668+0000","last_undegraded":"2023-12-19T05:38:59.583668+0000","last_fullsized":"2023-12-19T05:38:59.583668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:27.315801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581251+0000","last_change":"2023-12-19T05:38:58.106052+0000","last_active":"2023-12-19T05:38:59.581251+0000","last_peered":"2023-12-19T05:38:59.581251+0000","last_clean":"2023-12-19T05:38:59.581251+0000","last_became_active":"2023-12-19T05:38:58.105526+0000","last_became_peered":"2023-12-19T05:38:58.105526+0000","last_unstale":"2023-12-19T05:38:59.581251+0000","last_undegraded":"2023-12-19T05:38:59.581251+0000","last_fullsized":"2023-12-19T05:38:59.581251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582066+0000","last_change":"2023-12-19T05:38:58.108370+0000","last_active":"2023-12-19T05:38:59.582066+0000","last_peered":"2023-12-19T05:38:59.582066+0000","last_clean":"2023-12-19T05:38:59.582066+0000","last_became_active":"2023-12-19T05:38:58.108107+0000","last_became_peered":"2023-12-19T05:38:58.108107+0000","last_unstale":"2023-12-19T05:38:59.582066+0000","last_undegraded":"2023-12-19T05:38:59.582066+0000","last_fullsized":"2023-12-19T05:38:59.582066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:52.928586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583650+0000","last_change":"2023-12-19T05:38:58.102611+0000","last_active":"2023-12-19T05:38:59.583650+0000","last_peered":"2023-12-19T05:38:59.583650+0000","last_clean":"2023-12-19T05:38:59.583650+0000","last_became_active":"2023-12-19T05:38:58.102361+0000","last_became_peered":"2023-12-19T05:38:58.102361+0000","last_unstale":"2023-12-19T05:38:59.583650+0000","last_undegraded":"2023-12-19T05:38:59.583650+0000","last_fullsized":"2023-12-19T05:38:59.583650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:31.277716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582028+0000","last_change":"2023-12-19T05:38:58.107547+0000","last_active":"2023-12-19T05:38:59.582028+0000","last_peered":"2023-12-19T05:38:59.582028+0000","last_clean":"2023-12-19T05:38:59.582028+0000","last_became_active":"2023-12-19T05:38:58.106808+0000","last_became_peered":"2023-12-19T05:38:58.106808+0000","last_unstale":"2023-12-19T05:38:59.582028+0000","last_undegraded":"2023-12-19T05:38:59.582028+0000","last_fullsized":"2023-12-19T05:38:59.582028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:52.928586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089864+0000","last_change":"2023-12-19T05:38:58.094094+0000","last_active":"2023-12-19T05:38:59.089864+0000","last_peered":"2023-12-19T05:38:59.089864+0000","last_clean":"2023-12-19T05:38:59.089864+0000","last_became_active":"2023-12-19T05:38:58.093233+0000","last_became_peered":"2023-12-19T05:38:58.093233+0000","last_unstale":"2023-12-19T05:38:59.089864+0000","last_undegraded":"2023-12-19T05:38:59.089864+0000","last_fullsized":"2023-12-19T05:38:59.089864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581342+0000","last_change":"2023-12-19T05:38:58.098898+0000","last_active":"2023-12-19T05:38:59.581342+0000","last_peered":"2023-12-19T05:38:59.581342+0000","last_clean":"2023-12-19T05:38:59.581342+0000","last_became_active":"2023-12-19T05:38:58.098655+0000","last_became_peered":"2023-12-19T05:38:58.098655+0000","last_unstale":"2023-12-19T05:38:59.581342+0000","last_undegraded":"2023-12-19T05:38:59.581342+0000","last_fullsized":"2023-12-19T05:38:59.581342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582246+0000","last_change":"2023-12-19T05:38:58.109033+0000","last_active":"2023-12-19T05:38:59.582246+0000","last_peered":"2023-12-19T05:38:59.582246+0000","last_clean":"2023-12-19T05:38:59.582246+0000","last_became_active":"2023-12-19T05:38:58.108755+0000","last_became_peered":"2023-12-19T05:38:58.108755+0000","last_unstale":"2023-12-19T05:38:59.582246+0000","last_undegraded":"2023-12-19T05:38:59.582246+0000","last_fullsized":"2023-12-19T05:38:59.582246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:45:31.440161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090497+0000","last_change":"2023-12-19T05:38:58.103472+0000","last_active":"2023-12-19T05:38:59.090497+0000","last_peered":"2023-12-19T05:38:59.090497+0000","last_clean":"2023-12-19T05:38:59.090497+0000","last_became_active":"2023-12-19T05:38:58.103212+0000","last_became_peered":"2023-12-19T05:38:58.103212+0000","last_unstale":"2023-12-19T05:38:59.090497+0000","last_undegraded":"2023-12-19T05:38:59.090497+0000","last_fullsized":"2023-12-19T05:38:59.090497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581328+0000","last_change":"2023-12-19T05:38:58.100231+0000","last_active":"2023-12-19T05:38:59.581328+0000","last_peered":"2023-12-19T05:38:59.581328+0000","last_clean":"2023-12-19T05:38:59.581328+0000","last_became_active":"2023-12-19T05:38:58.100015+0000","last_became_peered":"2023-12-19T05:38:58.100015+0000","last_unstale":"2023-12-19T05:38:59.581328+0000","last_undegraded":"2023-12-19T05:38:59.581328+0000","last_fullsized":"2023-12-19T05:38:59.581328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:06:44.968515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090809+0000","last_change":"2023-12-19T05:38:58.104008+0000","last_active":"2023-12-19T05:38:59.090809+0000","last_peered":"2023-12-19T05:38:59.090809+0000","last_clean":"2023-12-19T05:38:59.090809+0000","last_became_active":"2023-12-19T05:38:58.103773+0000","last_became_peered":"2023-12-19T05:38:58.103773+0000","last_unstale":"2023-12-19T05:38:59.090809+0000","last_undegraded":"2023-12-19T05:38:59.090809+0000","last_fullsized":"2023-12-19T05:38:59.090809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:39:36.270833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090360+0000","last_change":"2023-12-19T05:38:58.098405+0000","last_active":"2023-12-19T05:38:59.090360+0000","last_peered":"2023-12-19T05:38:59.090360+0000","last_clean":"2023-12-19T05:38:59.090360+0000","last_became_active":"2023-12-19T05:38:58.098169+0000","last_became_peered":"2023-12-19T05:38:58.098169+0000","last_unstale":"2023-12-19T05:38:59.090360+0000","last_undegraded":"2023-12-19T05:38:59.090360+0000","last_fullsized":"2023-12-19T05:38:59.090360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583795+0000","last_change":"2023-12-19T05:38:58.103378+0000","last_active":"2023-12-19T05:38:59.583795+0000","last_peered":"2023-12-19T05:38:59.583795+0000","last_clean":"2023-12-19T05:38:59.583795+0000","last_became_active":"2023-12-19T05:38:58.103170+0000","last_became_peered":"2023-12-19T05:38:58.103170+0000","last_unstale":"2023-12-19T05:38:59.583795+0000","last_undegraded":"2023-12-19T05:38:59.583795+0000","last_fullsized":"2023-12-19T05:38:59.583795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090735+0000","last_change":"2023-12-19T05:38:58.104682+0000","last_active":"2023-12-19T05:38:59.090735+0000","last_peered":"2023-12-19T05:38:59.090735+0000","last_clean":"2023-12-19T05:38:59.090735+0000","last_became_active":"2023-12-19T05:38:58.104111+0000","last_became_peered":"2023-12-19T05:38:58.104111+0000","last_unstale":"2023-12-19T05:38:59.090735+0000","last_undegraded":"2023-12-19T05:38:59.090735+0000","last_fullsized":"2023-12-19T05:38:59.090735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:04:17.113504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581369+0000","last_change":"2023-12-19T05:38:58.109481+0000","last_active":"2023-12-19T05:38:59.581369+0000","last_peered":"2023-12-19T05:38:59.581369+0000","last_clean":"2023-12-19T05:38:59.581369+0000","last_became_active":"2023-12-19T05:38:58.109231+0000","last_became_peered":"2023-12-19T05:38:58.109231+0000","last_unstale":"2023-12-19T05:38:59.581369+0000","last_undegraded":"2023-12-19T05:38:59.581369+0000","last_fullsized":"2023-12-19T05:38:59.581369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:11:32.894490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581984+0000","last_change":"2023-12-19T05:38:58.099092+0000","last_active":"2023-12-19T05:38:59.581984+0000","last_peered":"2023-12-19T05:38:59.581984+0000","last_clean":"2023-12-19T05:38:59.581984+0000","last_became_active":"2023-12-19T05:38:58.098814+0000","last_became_peered":"2023-12-19T05:38:58.098814+0000","last_unstale":"2023-12-19T05:38:59.581984+0000","last_undegraded":"2023-12-19T05:38:59.581984+0000","last_fullsized":"2023-12-19T05:38:59.581984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:49:37.511914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583537+0000","last_change":"2023-12-19T05:38:58.101510+0000","last_active":"2023-12-19T05:38:59.583537+0000","last_peered":"2023-12-19T05:38:59.583537+0000","last_clean":"2023-12-19T05:38:59.583537+0000","last_became_active":"2023-12-19T05:38:58.101267+0000","last_became_peered":"2023-12-19T05:38:58.101267+0000","last_unstale":"2023-12-19T05:38:59.583537+0000","last_undegraded":"2023-12-19T05:38:59.583537+0000","last_fullsized":"2023-12-19T05:38:59.583537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:12.386527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089518+0000","last_change":"2023-12-19T05:38:58.090308+0000","last_active":"2023-12-19T05:38:59.089518+0000","last_peered":"2023-12-19T05:38:59.089518+0000","last_clean":"2023-12-19T05:38:59.089518+0000","last_became_active":"2023-12-19T05:38:58.090012+0000","last_became_peered":"2023-12-19T05:38:58.090012+0000","last_unstale":"2023-12-19T05:38:59.089518+0000","last_undegraded":"2023-12-19T05:38:59.089518+0000","last_fullsized":"2023-12-19T05:38:59.089518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089935+0000","last_change":"2023-12-19T05:38:58.104390+0000","last_active":"2023-12-19T05:38:59.089935+0000","last_peered":"2023-12-19T05:38:59.089935+0000","last_clean":"2023-12-19T05:38:59.089935+0000","last_became_active":"2023-12-19T05:38:58.103851+0000","last_became_peered":"2023-12-19T05:38:58.103851+0000","last_unstale":"2023-12-19T05:38:59.089935+0000","last_undegraded":"2023-12-19T05:38:59.089935+0000","last_fullsized":"2023-12-19T05:38:59.089935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:31.277716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090708+0000","last_change":"2023-12-19T05:38:57.749842+0000","last_active":"2023-12-19T05:38:59.090708+0000","last_peered":"2023-12-19T05:38:59.090708+0000","last_clean":"2023-12-19T05:38:59.090708+0000","last_became_active":"2023-12-19T05:38:57.749527+0000","last_became_peered":"2023-12-19T05:38:57.749527+0000","last_unstale":"2023-12-19T05:38:59.090708+0000","last_undegraded":"2023-12-19T05:38:59.090708+0000","last_fullsized":"2023-12-19T05:38:59.090708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:33:24.465492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581443+0000","last_change":"2023-12-19T05:38:58.097552+0000","last_active":"2023-12-19T05:38:59.581443+0000","last_peered":"2023-12-19T05:38:59.581443+0000","last_clean":"2023-12-19T05:38:59.581443+0000","last_became_active":"2023-12-19T05:38:58.095804+0000","last_became_peered":"2023-12-19T05:38:58.095804+0000","last_unstale":"2023-12-19T05:38:59.581443+0000","last_undegraded":"2023-12-19T05:38:59.581443+0000","last_fullsized":"2023-12-19T05:38:59.581443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:43.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089572+0000","last_change":"2023-12-19T05:38:57.745855+0000","last_active":"2023-12-19T05:38:59.089572+0000","last_peered":"2023-12-19T05:38:59.089572+0000","last_clean":"2023-12-19T05:38:59.089572+0000","last_became_active":"2023-12-19T05:38:57.745612+0000","last_became_peered":"2023-12-19T05:38:57.745612+0000","last_unstale":"2023-12-19T05:38:59.089572+0000","last_undegraded":"2023-12-19T05:38:59.089572+0000","last_fullsized":"2023-12-19T05:38:59.089572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:04.242717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090578+0000","last_change":"2023-12-19T05:38:57.743029+0000","last_active":"2023-12-19T05:38:59.090578+0000","last_peered":"2023-12-19T05:38:59.090578+0000","last_clean":"2023-12-19T05:38:59.090578+0000","last_became_active":"2023-12-19T05:38:57.742745+0000","last_became_peered":"2023-12-19T05:38:57.742745+0000","last_unstale":"2023-12-19T05:38:59.090578+0000","last_undegraded":"2023-12-19T05:38:59.090578+0000","last_fullsized":"2023-12-19T05:38:59.090578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:50:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090439+0000","last_change":"2023-12-19T05:38:58.105433+0000","last_active":"2023-12-19T05:38:59.090439+0000","last_peered":"2023-12-19T05:38:59.090439+0000","last_clean":"2023-12-19T05:38:59.090439+0000","last_became_active":"2023-12-19T05:38:58.105208+0000","last_became_peered":"2023-12-19T05:38:58.105208+0000","last_unstale":"2023-12-19T05:38:59.090439+0000","last_undegraded":"2023-12-19T05:38:59.090439+0000","last_fullsized":"2023-12-19T05:38:59.090439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:21:31.517735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581358+0000","last_change":"2023-12-19T05:38:57.748694+0000","last_active":"2023-12-19T05:38:59.581358+0000","last_peered":"2023-12-19T05:38:59.581358+0000","last_clean":"2023-12-19T05:38:59.581358+0000","last_became_active":"2023-12-19T05:38:57.748438+0000","last_became_peered":"2023-12-19T05:38:57.748438+0000","last_unstale":"2023-12-19T05:38:59.581358+0000","last_undegraded":"2023-12-19T05:38:59.581358+0000","last_fullsized":"2023-12-19T05:38:59.581358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:50:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583565+0000","last_change":"2023-12-19T05:38:58.104021+0000","last_active":"2023-12-19T05:38:59.583565+0000","last_peered":"2023-12-19T05:38:59.583565+0000","last_clean":"2023-12-19T05:38:59.583565+0000","last_became_active":"2023-12-19T05:38:58.103716+0000","last_became_peered":"2023-12-19T05:38:58.103716+0000","last_unstale":"2023-12-19T05:38:59.583565+0000","last_undegraded":"2023-12-19T05:38:59.583565+0000","last_fullsized":"2023-12-19T05:38:59.583565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090207+0000","last_change":"2023-12-19T05:38:57.741260+0000","last_active":"2023-12-19T05:38:59.090207+0000","last_peered":"2023-12-19T05:38:59.090207+0000","last_clean":"2023-12-19T05:38:59.090207+0000","last_became_active":"2023-12-19T05:38:57.740992+0000","last_became_peered":"2023-12-19T05:38:57.740992+0000","last_unstale":"2023-12-19T05:38:59.090207+0000","last_undegraded":"2023-12-19T05:38:59.090207+0000","last_fullsized":"2023-12-19T05:38:59.090207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:33.835019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581639+0000","last_change":"2023-12-19T05:38:58.107290+0000","last_active":"2023-12-19T05:38:59.581639+0000","last_peered":"2023-12-19T05:38:59.581639+0000","last_clean":"2023-12-19T05:38:59.581639+0000","last_became_active":"2023-12-19T05:38:58.107029+0000","last_became_peered":"2023-12-19T05:38:58.107029+0000","last_unstale":"2023-12-19T05:38:59.581639+0000","last_undegraded":"2023-12-19T05:38:59.581639+0000","last_fullsized":"2023-12-19T05:38:59.581639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581826+0000","last_change":"2023-12-19T05:38:57.742723+0000","last_active":"2023-12-19T05:38:59.581826+0000","last_peered":"2023-12-19T05:38:59.581826+0000","last_clean":"2023-12-19T05:38:59.581826+0000","last_became_active":"2023-12-19T05:38:57.742471+0000","last_became_peered":"2023-12-19T05:38:57.742471+0000","last_unstale":"2023-12-19T05:38:59.581826+0000","last_undegraded":"2023-12-19T05:38:59.581826+0000","last_fullsized":"2023-12-19T05:38:59.581826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581502+0000","last_change":"2023-12-19T05:38:58.099111+0000","last_active":"2023-12-19T05:38:59.581502+0000","last_peered":"2023-12-19T05:38:59.581502+0000","last_clean":"2023-12-19T05:38:59.581502+0000","last_became_active":"2023-12-19T05:38:58.098866+0000","last_became_peered":"2023-12-19T05:38:58.098866+0000","last_unstale":"2023-12-19T05:38:59.581502+0000","last_undegraded":"2023-12-19T05:38:59.581502+0000","last_fullsized":"2023-12-19T05:38:59.581502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583938+0000","last_change":"2023-12-19T05:38:57.748284+0000","last_active":"2023-12-19T05:38:59.583938+0000","last_peered":"2023-12-19T05:38:59.583938+0000","last_clean":"2023-12-19T05:38:59.583938+0000","last_became_active":"2023-12-19T05:38:57.747886+0000","last_became_peered":"2023-12-19T05:38:57.747886+0000","last_unstale":"2023-12-19T05:38:59.583938+0000","last_undegraded":"2023-12-19T05:38:59.583938+0000","last_fullsized":"2023-12-19T05:38:59.583938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:04.242717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090492+0000","last_change":"2023-12-19T05:38:58.109568+0000","last_active":"2023-12-19T05:38:59.090492+0000","last_peered":"2023-12-19T05:38:59.090492+0000","last_clean":"2023-12-19T05:38:59.090492+0000","last_became_active":"2023-12-19T05:38:58.108532+0000","last_became_peered":"2023-12-19T05:38:58.108532+0000","last_unstale":"2023-12-19T05:38:59.090492+0000","last_undegraded":"2023-12-19T05:38:59.090492+0000","last_fullsized":"2023-12-19T05:38:59.090492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:38:34.042375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089982+0000","last_change":"2023-12-19T05:38:57.744873+0000","last_active":"2023-12-19T05:38:59.089982+0000","last_peered":"2023-12-19T05:38:59.089982+0000","last_clean":"2023-12-19T05:38:59.089982+0000","last_became_active":"2023-12-19T05:38:57.744145+0000","last_became_peered":"2023-12-19T05:38:57.744145+0000","last_unstale":"2023-12-19T05:38:59.089982+0000","last_undegraded":"2023-12-19T05:38:59.089982+0000","last_fullsized":"2023-12-19T05:38:59.089982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581811+0000","last_change":"2023-12-19T05:38:58.110455+0000","last_active":"2023-12-19T05:38:59.581811+0000","last_peered":"2023-12-19T05:38:59.581811+0000","last_clean":"2023-12-19T05:38:59.581811+0000","last_became_active":"2023-12-19T05:38:58.109945+0000","last_became_peered":"2023-12-19T05:38:58.109945+0000","last_unstale":"2023-12-19T05:38:59.581811+0000","last_undegraded":"2023-12-19T05:38:59.581811+0000","last_fullsized":"2023-12-19T05:38:59.581811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:33:14.172127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581486+0000","last_change":"2023-12-19T05:38:57.748546+0000","last_active":"2023-12-19T05:38:59.581486+0000","last_peered":"2023-12-19T05:38:59.581486+0000","last_clean":"2023-12-19T05:38:59.581486+0000","last_became_active":"2023-12-19T05:38:57.748278+0000","last_became_peered":"2023-12-19T05:38:57.748278+0000","last_unstale":"2023-12-19T05:38:59.581486+0000","last_undegraded":"2023-12-19T05:38:59.581486+0000","last_fullsized":"2023-12-19T05:38:59.581486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581224+0000","last_change":"2023-12-19T05:38:58.098339+0000","last_active":"2023-12-19T05:38:59.581224+0000","last_peered":"2023-12-19T05:38:59.581224+0000","last_clean":"2023-12-19T05:38:59.581224+0000","last_became_active":"2023-12-19T05:38:58.098089+0000","last_became_peered":"2023-12-19T05:38:58.098089+0000","last_unstale":"2023-12-19T05:38:59.581224+0000","last_undegraded":"2023-12-19T05:38:59.581224+0000","last_fullsized":"2023-12-19T05:38:59.581224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:04:17.113504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582073+0000","last_change":"2023-12-19T05:38:57.745004+0000","last_active":"2023-12-19T05:38:59.582073+0000","last_peered":"2023-12-19T05:38:59.582073+0000","last_clean":"2023-12-19T05:38:59.582073+0000","last_became_active":"2023-12-19T05:38:57.744741+0000","last_became_peered":"2023-12-19T05:38:57.744741+0000","last_unstale":"2023-12-19T05:38:59.582073+0000","last_undegraded":"2023-12-19T05:38:59.582073+0000","last_fullsized":"2023-12-19T05:38:59.582073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:33:24.465492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581723+0000","last_change":"2023-12-19T05:38:58.111124+0000","last_active":"2023-12-19T05:38:59.581723+0000","last_peered":"2023-12-19T05:38:59.581723+0000","last_clean":"2023-12-19T05:38:59.581723+0000","last_became_active":"2023-12-19T05:38:58.110863+0000","last_became_peered":"2023-12-19T05:38:58.110863+0000","last_unstale":"2023-12-19T05:38:59.581723+0000","last_undegraded":"2023-12-19T05:38:59.581723+0000","last_fullsized":"2023-12-19T05:38:59.581723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:11:32.894490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089625+0000","last_change":"2023-12-19T05:38:57.746422+0000","last_active":"2023-12-19T05:38:59.089625+0000","last_peered":"2023-12-19T05:38:59.089625+0000","last_clean":"2023-12-19T05:38:59.089625+0000","last_became_active":"2023-12-19T05:38:57.745789+0000","last_became_peered":"2023-12-19T05:38:57.745789+0000","last_unstale":"2023-12-19T05:38:59.089625+0000","last_undegraded":"2023-12-19T05:38:59.089625+0000","last_fullsized":"2023-12-19T05:38:59.089625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:33:24.465492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089575+0000","last_change":"2023-12-19T05:38:58.090187+0000","last_active":"2023-12-19T05:38:59.089575+0000","last_peered":"2023-12-19T05:38:59.089575+0000","last_clean":"2023-12-19T05:38:59.089575+0000","last_became_active":"2023-12-19T05:38:58.089802+0000","last_became_peered":"2023-12-19T05:38:58.089802+0000","last_unstale":"2023-12-19T05:38:59.089575+0000","last_undegraded":"2023-12-19T05:38:59.089575+0000","last_fullsized":"2023-12-19T05:38:59.089575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:39:36.270833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583432+0000","last_change":"2023-12-19T05:38:57.741208+0000","last_active":"2023-12-19T05:38:59.583432+0000","last_peered":"2023-12-19T05:38:59.583432+0000","last_clean":"2023-12-19T05:38:59.583432+0000","last_became_active":"2023-12-19T05:38:57.740907+0000","last_became_peered":"2023-12-19T05:38:57.740907+0000","last_unstale":"2023-12-19T05:38:59.583432+0000","last_undegraded":"2023-12-19T05:38:59.583432+0000","last_fullsized":"2023-12-19T05:38:59.583432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581282+0000","last_change":"2023-12-19T05:38:58.113284+0000","last_active":"2023-12-19T05:38:59.581282+0000","last_peered":"2023-12-19T05:38:59.581282+0000","last_clean":"2023-12-19T05:38:59.581282+0000","last_became_active":"2023-12-19T05:38:58.112846+0000","last_became_peered":"2023-12-19T05:38:58.112846+0000","last_unstale":"2023-12-19T05:38:59.581282+0000","last_undegraded":"2023-12-19T05:38:59.581282+0000","last_fullsized":"2023-12-19T05:38:59.581282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:49:37.511914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090448+0000","last_change":"2023-12-19T05:38:57.745168+0000","last_active":"2023-12-19T05:38:59.090448+0000","last_peered":"2023-12-19T05:38:59.090448+0000","last_clean":"2023-12-19T05:38:59.090448+0000","last_became_active":"2023-12-19T05:38:57.744905+0000","last_became_peered":"2023-12-19T05:38:57.744905+0000","last_unstale":"2023-12-19T05:38:59.090448+0000","last_undegraded":"2023-12-19T05:38:59.090448+0000","last_fullsized":"2023-12-19T05:38:59.090448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:51:13.990639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581693+0000","last_change":"2023-12-19T05:38:58.108513+0000","last_active":"2023-12-19T05:38:59.581693+0000","last_peered":"2023-12-19T05:38:59.581693+0000","last_clean":"2023-12-19T05:38:59.581693+0000","last_became_active":"2023-12-19T05:38:58.108250+0000","last_became_peered":"2023-12-19T05:38:58.108250+0000","last_unstale":"2023-12-19T05:38:59.581693+0000","last_undegraded":"2023-12-19T05:38:59.581693+0000","last_fullsized":"2023-12-19T05:38:59.581693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:59.418017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583713+0000","last_change":"2023-12-19T05:38:57.745413+0000","last_active":"2023-12-19T05:38:59.583713+0000","last_peered":"2023-12-19T05:38:59.583713+0000","last_clean":"2023-12-19T05:38:59.583713+0000","last_became_active":"2023-12-19T05:38:57.745149+0000","last_became_peered":"2023-12-19T05:38:57.745149+0000","last_unstale":"2023-12-19T05:38:59.583713+0000","last_undegraded":"2023-12-19T05:38:59.583713+0000","last_fullsized":"2023-12-19T05:38:59.583713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:50:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582004+0000","last_change":"2023-12-19T05:38:58.112902+0000","last_active":"2023-12-19T05:38:59.582004+0000","last_peered":"2023-12-19T05:38:59.582004+0000","last_clean":"2023-12-19T05:38:59.582004+0000","last_became_active":"2023-12-19T05:38:58.112627+0000","last_became_peered":"2023-12-19T05:38:58.112627+0000","last_unstale":"2023-12-19T05:38:59.582004+0000","last_undegraded":"2023-12-19T05:38:59.582004+0000","last_fullsized":"2023-12-19T05:38:59.582004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:06:44.968515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583906+0000","last_change":"2023-12-19T05:38:57.748007+0000","last_active":"2023-12-19T05:38:59.583906+0000","last_peered":"2023-12-19T05:38:59.583906+0000","last_clean":"2023-12-19T05:38:59.583906+0000","last_became_active":"2023-12-19T05:38:57.747719+0000","last_became_peered":"2023-12-19T05:38:57.747719+0000","last_unstale":"2023-12-19T05:38:59.583906+0000","last_undegraded":"2023-12-19T05:38:59.583906+0000","last_fullsized":"2023-12-19T05:38:59.583906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:30.273362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582169+0000","last_change":"2023-12-19T05:38:58.104239+0000","last_active":"2023-12-19T05:38:59.582169+0000","last_peered":"2023-12-19T05:38:59.582169+0000","last_clean":"2023-12-19T05:38:59.582169+0000","last_became_active":"2023-12-19T05:38:58.103949+0000","last_became_peered":"2023-12-19T05:38:58.103949+0000","last_unstale":"2023-12-19T05:38:59.582169+0000","last_undegraded":"2023-12-19T05:38:59.582169+0000","last_fullsized":"2023-12-19T05:38:59.582169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:11:32.894490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583613+0000","last_change":"2023-12-19T05:38:57.743974+0000","last_active":"2023-12-19T05:38:59.583613+0000","last_peered":"2023-12-19T05:38:59.583613+0000","last_clean":"2023-12-19T05:38:59.583613+0000","last_became_active":"2023-12-19T05:38:57.743685+0000","last_became_peered":"2023-12-19T05:38:57.743685+0000","last_unstale":"2023-12-19T05:38:59.583613+0000","last_undegraded":"2023-12-19T05:38:59.583613+0000","last_fullsized":"2023-12-19T05:38:59.583613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:33:24.465492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581912+0000","last_change":"2023-12-19T05:38:58.106818+0000","last_active":"2023-12-19T05:38:59.581912+0000","last_peered":"2023-12-19T05:38:59.581912+0000","last_clean":"2023-12-19T05:38:59.581912+0000","last_became_active":"2023-12-19T05:38:58.106450+0000","last_became_peered":"2023-12-19T05:38:58.106450+0000","last_unstale":"2023-12-19T05:38:59.581912+0000","last_undegraded":"2023-12-19T05:38:59.581912+0000","last_fullsized":"2023-12-19T05:38:59.581912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:44:05.254781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:38:58.098353+0000","last_change":"2023-12-19T05:38:47.150620+0000","last_active":"2023-12-19T05:38:58.098353+0000","last_peered":"2023-12-19T05:38:58.098353+0000","last_clean":"2023-12-19T05:38:58.098353+0000","last_became_active":"2023-12-19T05:38:47.149844+0000","last_became_peered":"2023-12-19T05:38:47.149844+0000","last_unstale":"2023-12-19T05:38:58.098353+0000","last_undegraded":"2023-12-19T05:38:58.098353+0000","last_fullsized":"2023-12-19T05:38:58.098353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_clean_scrub_stamp":"2023-12-19T05:38:46.034642+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:51.920917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581466+0000","last_change":"2023-12-19T05:38:57.741233+0000","last_active":"2023-12-19T05:38:59.581466+0000","last_peered":"2023-12-19T05:38:59.581466+0000","last_clean":"2023-12-19T05:38:59.581466+0000","last_became_active":"2023-12-19T05:38:57.740919+0000","last_became_peered":"2023-12-19T05:38:57.740919+0000","last_unstale":"2023-12-19T05:38:59.581466+0000","last_undegraded":"2023-12-19T05:38:59.581466+0000","last_fullsized":"2023-12-19T05:38:59.581466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:33.835019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090563+0000","last_change":"2023-12-19T05:38:58.101883+0000","last_active":"2023-12-19T05:38:59.090563+0000","last_peered":"2023-12-19T05:38:59.090563+0000","last_clean":"2023-12-19T05:38:59.090563+0000","last_became_active":"2023-12-19T05:38:58.101654+0000","last_became_peered":"2023-12-19T05:38:58.101654+0000","last_unstale":"2023-12-19T05:38:59.090563+0000","last_undegraded":"2023-12-19T05:38:59.090563+0000","last_fullsized":"2023-12-19T05:38:59.090563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581246+0000","last_change":"2023-12-19T05:38:57.753323+0000","last_active":"2023-12-19T05:38:59.581246+0000","last_peered":"2023-12-19T05:38:59.581246+0000","last_clean":"2023-12-19T05:38:59.581246+0000","last_became_active":"2023-12-19T05:38:57.752998+0000","last_became_peered":"2023-12-19T05:38:57.752998+0000","last_unstale":"2023-12-19T05:38:59.581246+0000","last_undegraded":"2023-12-19T05:38:59.581246+0000","last_fullsized":"2023-12-19T05:38:59.581246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:33.835019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581129+0000","last_change":"2023-12-19T05:38:58.093174+0000","last_active":"2023-12-19T05:38:59.581129+0000","last_peered":"2023-12-19T05:38:59.581129+0000","last_clean":"2023-12-19T05:38:59.581129+0000","last_became_active":"2023-12-19T05:38:58.092933+0000","last_became_peered":"2023-12-19T05:38:58.092933+0000","last_unstale":"2023-12-19T05:38:59.581129+0000","last_undegraded":"2023-12-19T05:38:59.581129+0000","last_fullsized":"2023-12-19T05:38:59.581129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:52.928586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583580+0000","last_change":"2023-12-19T05:38:57.745338+0000","last_active":"2023-12-19T05:38:59.583580+0000","last_peered":"2023-12-19T05:38:59.583580+0000","last_clean":"2023-12-19T05:38:59.583580+0000","last_became_active":"2023-12-19T05:38:57.745038+0000","last_became_peered":"2023-12-19T05:38:57.745038+0000","last_unstale":"2023-12-19T05:38:59.583580+0000","last_undegraded":"2023-12-19T05:38:59.583580+0000","last_fullsized":"2023-12-19T05:38:59.583580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583564+0000","last_change":"2023-12-19T05:38:58.102456+0000","last_active":"2023-12-19T05:38:59.583564+0000","last_peered":"2023-12-19T05:38:59.583564+0000","last_clean":"2023-12-19T05:38:59.583564+0000","last_became_active":"2023-12-19T05:38:58.102200+0000","last_became_peered":"2023-12-19T05:38:58.102200+0000","last_unstale":"2023-12-19T05:38:59.583564+0000","last_undegraded":"2023-12-19T05:38:59.583564+0000","last_fullsized":"2023-12-19T05:38:59.583564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:04:17.113504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582159+0000","last_change":"2023-12-19T05:38:57.743585+0000","last_active":"2023-12-19T05:38:59.582159+0000","last_peered":"2023-12-19T05:38:59.582159+0000","last_clean":"2023-12-19T05:38:59.582159+0000","last_became_active":"2023-12-19T05:38:57.743280+0000","last_became_peered":"2023-12-19T05:38:57.743280+0000","last_unstale":"2023-12-19T05:38:59.582159+0000","last_undegraded":"2023-12-19T05:38:59.582159+0000","last_fullsized":"2023-12-19T05:38:59.582159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090317+0000","last_change":"2023-12-19T05:38:58.091932+0000","last_active":"2023-12-19T05:38:59.090317+0000","last_peered":"2023-12-19T05:38:59.090317+0000","last_clean":"2023-12-19T05:38:59.090317+0000","last_became_active":"2023-12-19T05:38:58.091652+0000","last_became_peered":"2023-12-19T05:38:58.091652+0000","last_unstale":"2023-12-19T05:38:59.090317+0000","last_undegraded":"2023-12-19T05:38:59.090317+0000","last_fullsized":"2023-12-19T05:38:59.090317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:12.386527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583836+0000","last_change":"2023-12-19T05:38:57.745683+0000","last_active":"2023-12-19T05:38:59.583836+0000","last_peered":"2023-12-19T05:38:59.583836+0000","last_clean":"2023-12-19T05:38:59.583836+0000","last_became_active":"2023-12-19T05:38:57.745397+0000","last_became_peered":"2023-12-19T05:38:57.745397+0000","last_unstale":"2023-12-19T05:38:59.583836+0000","last_undegraded":"2023-12-19T05:38:59.583836+0000","last_fullsized":"2023-12-19T05:38:59.583836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581745+0000","last_change":"2023-12-19T05:38:58.103911+0000","last_active":"2023-12-19T05:38:59.581745+0000","last_peered":"2023-12-19T05:38:59.581745+0000","last_clean":"2023-12-19T05:38:59.581745+0000","last_became_active":"2023-12-19T05:38:58.103234+0000","last_became_peered":"2023-12-19T05:38:58.103234+0000","last_unstale":"2023-12-19T05:38:59.581745+0000","last_undegraded":"2023-12-19T05:38:59.581745+0000","last_fullsized":"2023-12-19T05:38:59.581745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:33:14.172127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582052+0000","last_change":"2023-12-19T05:38:57.753286+0000","last_active":"2023-12-19T05:38:59.582052+0000","last_peered":"2023-12-19T05:38:59.582052+0000","last_clean":"2023-12-19T05:38:59.582052+0000","last_became_active":"2023-12-19T05:38:57.752956+0000","last_became_peered":"2023-12-19T05:38:57.752956+0000","last_unstale":"2023-12-19T05:38:59.582052+0000","last_undegraded":"2023-12-19T05:38:59.582052+0000","last_fullsized":"2023-12-19T05:38:59.582052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583722+0000","last_change":"2023-12-19T05:38:58.106316+0000","last_active":"2023-12-19T05:38:59.583722+0000","last_peered":"2023-12-19T05:38:59.583722+0000","last_clean":"2023-12-19T05:38:59.583722+0000","last_became_active":"2023-12-19T05:38:58.106080+0000","last_became_peered":"2023-12-19T05:38:58.106080+0000","last_unstale":"2023-12-19T05:38:59.583722+0000","last_undegraded":"2023-12-19T05:38:59.583722+0000","last_fullsized":"2023-12-19T05:38:59.583722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:39:36.270833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:39:00.991292+0000","last_change":"2023-12-19T05:38:57.745431+0000","last_active":"2023-12-19T05:39:00.991292+0000","last_peered":"2023-12-19T05:39:00.991292+0000","last_clean":"2023-12-19T05:39:00.991292+0000","last_became_active":"2023-12-19T05:38:57.745111+0000","last_became_peered":"2023-12-19T05:38:57.745111+0000","last_unstale":"2023-12-19T05:39:00.991292+0000","last_undegraded":"2023-12-19T05:39:00.991292+0000","last_fullsized":"2023-12-19T05:39:00.991292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:15.966316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090806+0000","last_change":"2023-12-19T05:38:58.104157+0000","last_active":"2023-12-19T05:38:59.090806+0000","last_peered":"2023-12-19T05:38:59.090806+0000","last_clean":"2023-12-19T05:38:59.090806+0000","last_became_active":"2023-12-19T05:38:58.103934+0000","last_became_peered":"2023-12-19T05:38:58.103934+0000","last_unstale":"2023-12-19T05:38:59.090806+0000","last_undegraded":"2023-12-19T05:38:59.090806+0000","last_fullsized":"2023-12-19T05:38:59.090806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:52.928586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090306+0000","last_change":"2023-12-19T05:38:57.747086+0000","last_active":"2023-12-19T05:38:59.090306+0000","last_peered":"2023-12-19T05:38:59.090306+0000","last_clean":"2023-12-19T05:38:59.090306+0000","last_became_active":"2023-12-19T05:38:57.746818+0000","last_became_peered":"2023-12-19T05:38:57.746818+0000","last_unstale":"2023-12-19T05:38:59.090306+0000","last_undegraded":"2023-12-19T05:38:59.090306+0000","last_fullsized":"2023-12-19T05:38:59.090306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:15.966316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581497+0000","last_change":"2023-12-19T05:38:58.103335+0000","last_active":"2023-12-19T05:38:59.581497+0000","last_peered":"2023-12-19T05:38:59.581497+0000","last_clean":"2023-12-19T05:38:59.581497+0000","last_became_active":"2023-12-19T05:38:58.103108+0000","last_became_peered":"2023-12-19T05:38:58.103108+0000","last_unstale":"2023-12-19T05:38:59.581497+0000","last_undegraded":"2023-12-19T05:38:59.581497+0000","last_fullsized":"2023-12-19T05:38:59.581497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:27.315801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581446+0000","last_change":"2023-12-19T05:38:57.753153+0000","last_active":"2023-12-19T05:38:59.581446+0000","last_peered":"2023-12-19T05:38:59.581446+0000","last_clean":"2023-12-19T05:38:59.581446+0000","last_became_active":"2023-12-19T05:38:57.752881+0000","last_became_peered":"2023-12-19T05:38:57.752881+0000","last_unstale":"2023-12-19T05:38:59.581446+0000","last_undegraded":"2023-12-19T05:38:59.581446+0000","last_fullsized":"2023-12-19T05:38:59.581446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:04.242717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089877+0000","last_change":"2023-12-19T05:38:58.101259+0000","last_active":"2023-12-19T05:38:59.089877+0000","last_peered":"2023-12-19T05:38:59.089877+0000","last_clean":"2023-12-19T05:38:59.089877+0000","last_became_active":"2023-12-19T05:38:58.100992+0000","last_became_peered":"2023-12-19T05:38:58.100992+0000","last_unstale":"2023-12-19T05:38:59.089877+0000","last_undegraded":"2023-12-19T05:38:59.089877+0000","last_fullsized":"2023-12-19T05:38:59.089877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:05.247071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583860+0000","last_change":"2023-12-19T05:38:57.745745+0000","last_active":"2023-12-19T05:38:59.583860+0000","last_peered":"2023-12-19T05:38:59.583860+0000","last_clean":"2023-12-19T05:38:59.583860+0000","last_became_active":"2023-12-19T05:38:57.745477+0000","last_became_peered":"2023-12-19T05:38:57.745477+0000","last_unstale":"2023-12-19T05:38:59.583860+0000","last_undegraded":"2023-12-19T05:38:59.583860+0000","last_fullsized":"2023-12-19T05:38:59.583860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090521+0000","last_change":"2023-12-19T05:38:58.107888+0000","last_active":"2023-12-19T05:38:59.090521+0000","last_peered":"2023-12-19T05:38:59.090521+0000","last_clean":"2023-12-19T05:38:59.090521+0000","last_became_active":"2023-12-19T05:38:58.107286+0000","last_became_peered":"2023-12-19T05:38:58.107286+0000","last_unstale":"2023-12-19T05:38:59.090521+0000","last_undegraded":"2023-12-19T05:38:59.090521+0000","last_fullsized":"2023-12-19T05:38:59.090521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:27.315801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583857+0000","last_change":"2023-12-19T05:38:57.745515+0000","last_active":"2023-12-19T05:38:59.583857+0000","last_peered":"2023-12-19T05:38:59.583857+0000","last_clean":"2023-12-19T05:38:59.583857+0000","last_became_active":"2023-12-19T05:38:57.745072+0000","last_became_peered":"2023-12-19T05:38:57.745072+0000","last_unstale":"2023-12-19T05:38:59.583857+0000","last_undegraded":"2023-12-19T05:38:59.583857+0000","last_fullsized":"2023-12-19T05:38:59.583857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:33.835019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090635+0000","last_change":"2023-12-19T05:38:58.106802+0000","last_active":"2023-12-19T05:38:59.090635+0000","last_peered":"2023-12-19T05:38:59.090635+0000","last_clean":"2023-12-19T05:38:59.090635+0000","last_became_active":"2023-12-19T05:38:58.106522+0000","last_became_peered":"2023-12-19T05:38:58.106522+0000","last_unstale":"2023-12-19T05:38:59.090635+0000","last_undegraded":"2023-12-19T05:38:59.090635+0000","last_fullsized":"2023-12-19T05:38:59.090635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581817+0000","last_change":"2023-12-19T05:38:57.748708+0000","last_active":"2023-12-19T05:38:59.581817+0000","last_peered":"2023-12-19T05:38:59.581817+0000","last_clean":"2023-12-19T05:38:59.581817+0000","last_became_active":"2023-12-19T05:38:57.748432+0000","last_became_peered":"2023-12-19T05:38:57.748432+0000","last_unstale":"2023-12-19T05:38:59.581817+0000","last_undegraded":"2023-12-19T05:38:59.581817+0000","last_fullsized":"2023-12-19T05:38:59.581817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089691+0000","last_change":"2023-12-19T05:38:58.093836+0000","last_active":"2023-12-19T05:38:59.089691+0000","last_peered":"2023-12-19T05:38:59.089691+0000","last_clean":"2023-12-19T05:38:59.089691+0000","last_became_active":"2023-12-19T05:38:58.093559+0000","last_became_peered":"2023-12-19T05:38:58.093559+0000","last_unstale":"2023-12-19T05:38:59.089691+0000","last_undegraded":"2023-12-19T05:38:59.089691+0000","last_fullsized":"2023-12-19T05:38:59.089691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:04:17.113504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581656+0000","last_change":"2023-12-19T05:38:58.104146+0000","last_active":"2023-12-19T05:38:59.581656+0000","last_peered":"2023-12-19T05:38:59.581656+0000","last_clean":"2023-12-19T05:38:59.581656+0000","last_became_active":"2023-12-19T05:38:58.102734+0000","last_became_peered":"2023-12-19T05:38:58.102734+0000","last_unstale":"2023-12-19T05:38:59.581656+0000","last_undegraded":"2023-12-19T05:38:59.581656+0000","last_fullsized":"2023-12-19T05:38:59.581656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581673+0000","last_change":"2023-12-19T05:38:57.750833+0000","last_active":"2023-12-19T05:38:59.581673+0000","last_peered":"2023-12-19T05:38:59.581673+0000","last_clean":"2023-12-19T05:38:59.581673+0000","last_became_active":"2023-12-19T05:38:57.750555+0000","last_became_peered":"2023-12-19T05:38:57.750555+0000","last_unstale":"2023-12-19T05:38:59.581673+0000","last_undegraded":"2023-12-19T05:38:59.581673+0000","last_fullsized":"2023-12-19T05:38:59.581673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:15.966316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581801+0000","last_change":"2023-12-19T05:38:58.103122+0000","last_active":"2023-12-19T05:38:59.581801+0000","last_peered":"2023-12-19T05:38:59.581801+0000","last_clean":"2023-12-19T05:38:59.581801+0000","last_became_active":"2023-12-19T05:38:58.102705+0000","last_became_peered":"2023-12-19T05:38:58.102705+0000","last_unstale":"2023-12-19T05:38:59.581801+0000","last_undegraded":"2023-12-19T05:38:59.581801+0000","last_fullsized":"2023-12-19T05:38:59.581801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581950+0000","last_change":"2023-12-19T05:38:57.750383+0000","last_active":"2023-12-19T05:38:59.581950+0000","last_peered":"2023-12-19T05:38:59.581950+0000","last_clean":"2023-12-19T05:38:59.581950+0000","last_became_active":"2023-12-19T05:38:57.750076+0000","last_became_peered":"2023-12-19T05:38:57.750076+0000","last_unstale":"2023-12-19T05:38:59.581950+0000","last_undegraded":"2023-12-19T05:38:59.581950+0000","last_fullsized":"2023-12-19T05:38:59.581950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:30.273362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581472+0000","last_change":"2023-12-19T05:38:58.099053+0000","last_active":"2023-12-19T05:38:59.581472+0000","last_peered":"2023-12-19T05:38:59.581472+0000","last_clean":"2023-12-19T05:38:59.581472+0000","last_became_active":"2023-12-19T05:38:58.098823+0000","last_became_peered":"2023-12-19T05:38:58.098823+0000","last_unstale":"2023-12-19T05:38:59.581472+0000","last_undegraded":"2023-12-19T05:38:59.581472+0000","last_fullsized":"2023-12-19T05:38:59.581472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090815+0000","last_change":"2023-12-19T05:38:57.750220+0000","last_active":"2023-12-19T05:38:59.090815+0000","last_peered":"2023-12-19T05:38:59.090815+0000","last_clean":"2023-12-19T05:38:59.090815+0000","last_became_active":"2023-12-19T05:38:57.749929+0000","last_became_peered":"2023-12-19T05:38:57.749929+0000","last_unstale":"2023-12-19T05:38:59.090815+0000","last_undegraded":"2023-12-19T05:38:59.090815+0000","last_fullsized":"2023-12-19T05:38:59.090815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:12:26.203081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090707+0000","last_change":"2023-12-19T05:38:58.101262+0000","last_active":"2023-12-19T05:38:59.090707+0000","last_peered":"2023-12-19T05:38:59.090707+0000","last_clean":"2023-12-19T05:38:59.090707+0000","last_became_active":"2023-12-19T05:38:58.100440+0000","last_became_peered":"2023-12-19T05:38:58.100440+0000","last_unstale":"2023-12-19T05:38:59.090707+0000","last_undegraded":"2023-12-19T05:38:59.090707+0000","last_fullsized":"2023-12-19T05:38:59.090707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:43.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581530+0000","last_change":"2023-12-19T05:38:57.748866+0000","last_active":"2023-12-19T05:38:59.581530+0000","last_peered":"2023-12-19T05:38:59.581530+0000","last_clean":"2023-12-19T05:38:59.581530+0000","last_became_active":"2023-12-19T05:38:57.748578+0000","last_became_peered":"2023-12-19T05:38:57.748578+0000","last_unstale":"2023-12-19T05:38:59.581530+0000","last_undegraded":"2023-12-19T05:38:59.581530+0000","last_fullsized":"2023-12-19T05:38:59.581530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:50:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":69969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T05:39:05.913 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.043+0000 7fc6d4177640 1 Processor -- start 2023-12-19T05:39:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.043+0000 7fc6d4177640 1 -- start start 2023-12-19T05:39:06.047 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.044+0000 7fc6d4177640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc6cc0b79b0 0x7fc6cc0b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.044+0000 7fc6d4177640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6cc14b230 0x7fc6cc14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.044+0000 7fc6d4177640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc0b96b0 con 0x7fc6cc0b8860 2023-12-19T05:39:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.044+0000 7fc6d4177640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc14ae10 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.044+0000 7fc6d4177640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0bacc0 con 0x7fc6cc14b230 2023-12-19T05:39:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.044+0000 7fc6d1f13640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc6cc0b79b0 0x7fc6cc0b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.044+0000 7fc6d1f13640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc6cc0b79b0 0x7fc6cc0b7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45458/0 (socket says 172.21.15.120:45458) 2023-12-19T05:39:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.044+0000 7fc6d1f13640 1 -- 172.21.15.120:0/976914236 learned_addr learned my addr 172.21.15.120:0/976914236 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.044+0000 7fc6d2714640 1 --2- 172.21.15.120:0/976914236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6cc14b230 0x7fc6cc14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.044+0000 7fc6d1f13640 1 -- 172.21.15.120:0/976914236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6cc14b230 msgr2=0x7fc6cc14b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.044+0000 7fc6d1f13640 1 --2- 172.21.15.120:0/976914236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6cc14b230 0x7fc6cc14b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.044+0000 7fc6d1f13640 1 -- 172.21.15.120:0/976914236 >> v1:172.21.15.155:6789/0 conn(0x7fc6cc0b8860 legacy=0x7fc6cc144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.044+0000 7fc6d1f13640 1 -- 172.21.15.120:0/976914236 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc0b90f0 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.044+0000 7fc6d2714640 1 --2- 172.21.15.120:0/976914236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6cc14b230 0x7fc6cc14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:06.048 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.045+0000 7fc6d1f13640 1 --2- 172.21.15.120:0/976914236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6cc0b79b0 0x7fc6cc0b7d90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009e50 tx=0x7fc6c802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15ac028f493ee16 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.045+0000 7fc6d0f11640 1 -- 172.21.15.120:0/976914236 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c802ca70 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.045+0000 7fc6d0f11640 1 -- 172.21.15.120:0/976914236 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c802cbd0 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.045+0000 7fc6d0f11640 1 -- 172.21.15.120:0/976914236 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80343f0 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.046+0000 7fc6d4177640 1 -- 172.21.15.120:0/976914236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6cc0b79b0 msgr2=0x7fc6cc0b7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.046+0000 7fc6d4177640 1 --2- 172.21.15.120:0/976914236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6cc0b79b0 0x7fc6cc0b7d90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009e50 tx=0x7fc6c802bed0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.046+0000 7fc6d4177640 1 -- 172.21.15.120:0/976914236 shutdown_connections 2023-12-19T05:39:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.046+0000 7fc6d4177640 1 --2- 172.21.15.120:0/976914236 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6cc14b230 0x7fc6cc14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.046+0000 7fc6d4177640 1 --2- 172.21.15.120:0/976914236 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6cc0b79b0 0x7fc6cc0b7d90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.046+0000 7fc6d4177640 1 -- 172.21.15.120:0/976914236 >> 172.21.15.120:0/976914236 conn(0x7fc6cc0c0340 msgr2=0x7fc6cc0c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.046+0000 7fc6d4177640 1 -- 172.21.15.120:0/976914236 shutdown_connections 2023-12-19T05:39:06.049 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.046+0000 7fc6d4177640 1 -- 172.21.15.120:0/976914236 wait complete. 2023-12-19T05:39:06.052 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.047+0000 7fc6d4177640 1 Processor -- start 2023-12-19T05:39:06.052 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.047+0000 7fc6d4177640 1 -- start start 2023-12-19T05:39:06.052 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.047+0000 7fc6d4177640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6cc0b79b0 0x7fc6cc0b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.047+0000 7fc6d4177640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6cc0b8860 0x7fc6cc1d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d4177640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6cc14b230 0x7fc6cc1d10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d4177640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0b64a0 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d4177640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc1d1e20 con 0x7fc6cc14b230 2023-12-19T05:39:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d4177640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc1d26c0 con 0x7fc6cc0b8860 2023-12-19T05:39:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d1f13640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6cc0b79b0 0x7fc6cc0b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d1f13640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6cc0b79b0 0x7fc6cc0b5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45464/0 (socket says 172.21.15.120:45464) 2023-12-19T05:39:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d1f13640 1 -- 172.21.15.120:0/3207570720 learned_addr learned my addr 172.21.15.120:0/3207570720 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d1712640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6cc0b8860 0x7fc6cc1d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d2714640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6cc14b230 0x7fc6cc1d10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d1f13640 1 -- 172.21.15.120:0/3207570720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6cc0b8860 msgr2=0x7fc6cc1d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.053 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d1f13640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6cc0b8860 0x7fc6cc1d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d1f13640 1 -- 172.21.15.120:0/3207570720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6cc14b230 msgr2=0x7fc6cc1d10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d1f13640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6cc14b230 0x7fc6cc1d10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d1f13640 1 -- 172.21.15.120:0/3207570720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c8009b30 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d2714640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6cc14b230 0x7fc6cc1d10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d1f13640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6cc0b79b0 0x7fc6cc0b5f60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009e50 tx=0x7fc6c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6c27fc640 1 -- 172.21.15.120:0/3207570720 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c803e450 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6c27fc640 1 -- 172.21.15.120:0/3207570720 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c803e5f0 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6c27fc640 1 -- 172.21.15.120:0/3207570720 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c803e9a0 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d4177640 1 -- 172.21.15.120:0/3207570720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc147660 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.048+0000 7fc6d4177640 1 -- 172.21.15.120:0/3207570720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc1d2070 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.049+0000 7fc6d4177640 1 -- 172.21.15.120:0/3207570720 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc0b8c80 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.050+0000 7fc6c27fc640 1 -- 172.21.15.120:0/3207570720 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc6c803eb00 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.050+0000 7fc6c27fc640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc6b006a430 0x7fc6b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.050+0000 7fc6d1712640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc6b006a430 0x7fc6b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.050+0000 7fc6c27fc640 1 -- 172.21.15.120:0/3207570720 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6c80ab810 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.051+0000 7fc6d1712640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc6b006a430 0x7fc6b006c8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc006fd0 tx=0x7fc6bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.054+0000 7fc6c27fc640 1 -- 172.21.15.120:0/3207570720 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc6cc0b8c80 con 0x7fc6cc0b79b0 2023-12-19T05:39:06.223 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.222+0000 7fc6d4177640 1 -- 172.21.15.120:0/3207570720 --> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc6cc1451e0 con 0x7fc6b006a430 2023-12-19T05:39:06.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.228+0000 7fc6c27fc640 1 -- 172.21.15.120:0/3207570720 <== mgr.4101 v2:172.21.15.120:6832/89586 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264532 (secure 0 0 0) 0x7fc6bc00be30 con 0x7fc6b006a430 2023-12-19T05:39:06.232 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:06.234 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2023-12-19T05:39:06.236 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.231+0000 7fc6d4177640 1 -- 172.21.15.120:0/3207570720 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc6b006a430 msgr2=0x7fc6b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.236 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.231+0000 7fc6d4177640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc6b006a430 0x7fc6b006c8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc006fd0 tx=0x7fc6bc008040 comp rx=0 tx=0).stop 2023-12-19T05:39:06.236 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.231+0000 7fc6d4177640 1 -- 172.21.15.120:0/3207570720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6cc0b79b0 msgr2=0x7fc6cc0b5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.236 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.231+0000 7fc6d4177640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6cc0b79b0 0x7fc6cc0b5f60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009e50 tx=0x7fc6c8004a40 comp rx=0 tx=0).stop 2023-12-19T05:39:06.236 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.231+0000 7fc6d4177640 1 -- 172.21.15.120:0/3207570720 shutdown_connections 2023-12-19T05:39:06.236 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.231+0000 7fc6d4177640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc6b006a430 0x7fc6b006c8f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.236 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.231+0000 7fc6d4177640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6cc14b230 0x7fc6cc1d10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.237 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.231+0000 7fc6d4177640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc6cc0b8860 0x7fc6cc1d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.237 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.231+0000 7fc6d4177640 1 --2- 172.21.15.120:0/3207570720 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc6cc0b79b0 0x7fc6cc0b5f60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.237 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.231+0000 7fc6d4177640 1 -- 172.21.15.120:0/3207570720 >> 172.21.15.120:0/3207570720 conn(0x7fc6cc0c0340 msgr2=0x7fc6cc14a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:06.237 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.231+0000 7fc6d4177640 1 -- 172.21.15.120:0/3207570720 shutdown_connections 2023-12-19T05:39:06.237 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.231+0000 7fc6d4177640 1 -- 172.21.15.120:0/3207570720 wait complete. 2023-12-19T05:39:06.243 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-19T05:39:05.937944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218432,"kb_used_data":2816,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756288,"statfs":{"total":773094113280,"available":772870438912,"internally_reserved":0,"allocated":2883584,"data_stored":1750606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001530"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581779+0000","last_change":"2023-12-19T05:38:58.110250+0000","last_active":"2023-12-19T05:38:59.581779+0000","last_peered":"2023-12-19T05:38:59.581779+0000","last_clean":"2023-12-19T05:38:59.581779+0000","last_became_active":"2023-12-19T05:38:58.109517+0000","last_became_peered":"2023-12-19T05:38:58.109517+0000","last_unstale":"2023-12-19T05:38:59.581779+0000","last_undegraded":"2023-12-19T05:38:59.581779+0000","last_fullsized":"2023-12-19T05:38:59.581779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583825+0000","last_change":"2023-12-19T05:38:58.105317+0000","last_active":"2023-12-19T05:38:59.583825+0000","last_peered":"2023-12-19T05:38:59.583825+0000","last_clean":"2023-12-19T05:38:59.583825+0000","last_became_active":"2023-12-19T05:38:58.105045+0000","last_became_peered":"2023-12-19T05:38:58.105045+0000","last_unstale":"2023-12-19T05:38:59.583825+0000","last_undegraded":"2023-12-19T05:38:59.583825+0000","last_fullsized":"2023-12-19T05:38:59.583825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581433+0000","last_change":"2023-12-19T05:38:58.100348+0000","last_active":"2023-12-19T05:38:59.581433+0000","last_peered":"2023-12-19T05:38:59.581433+0000","last_clean":"2023-12-19T05:38:59.581433+0000","last_became_active":"2023-12-19T05:38:58.100063+0000","last_became_peered":"2023-12-19T05:38:58.100063+0000","last_unstale":"2023-12-19T05:38:59.581433+0000","last_undegraded":"2023-12-19T05:38:59.581433+0000","last_fullsized":"2023-12-19T05:38:59.581433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:21:31.517735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581706+0000","last_change":"2023-12-19T05:38:58.104289+0000","last_active":"2023-12-19T05:38:59.581706+0000","last_peered":"2023-12-19T05:38:59.581706+0000","last_clean":"2023-12-19T05:38:59.581706+0000","last_became_active":"2023-12-19T05:38:58.104000+0000","last_became_peered":"2023-12-19T05:38:58.104000+0000","last_unstale":"2023-12-19T05:38:59.581706+0000","last_undegraded":"2023-12-19T05:38:59.581706+0000","last_fullsized":"2023-12-19T05:38:59.581706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:59.418017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581619+0000","last_change":"2023-12-19T05:38:58.107206+0000","last_active":"2023-12-19T05:38:59.581619+0000","last_peered":"2023-12-19T05:38:59.581619+0000","last_clean":"2023-12-19T05:38:59.581619+0000","last_became_active":"2023-12-19T05:38:58.106923+0000","last_became_peered":"2023-12-19T05:38:58.106923+0000","last_unstale":"2023-12-19T05:38:59.581619+0000","last_undegraded":"2023-12-19T05:38:59.581619+0000","last_fullsized":"2023-12-19T05:38:59.581619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:43.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581843+0000","last_change":"2023-12-19T05:38:58.105909+0000","last_active":"2023-12-19T05:38:59.581843+0000","last_peered":"2023-12-19T05:38:59.581843+0000","last_clean":"2023-12-19T05:38:59.581843+0000","last_became_active":"2023-12-19T05:38:58.105631+0000","last_became_peered":"2023-12-19T05:38:58.105631+0000","last_unstale":"2023-12-19T05:38:59.581843+0000","last_undegraded":"2023-12-19T05:38:59.581843+0000","last_fullsized":"2023-12-19T05:38:59.581843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:43.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581275+0000","last_change":"2023-12-19T05:38:58.111894+0000","last_active":"2023-12-19T05:38:59.581275+0000","last_peered":"2023-12-19T05:38:59.581275+0000","last_clean":"2023-12-19T05:38:59.581275+0000","last_became_active":"2023-12-19T05:38:58.111533+0000","last_became_peered":"2023-12-19T05:38:58.111533+0000","last_unstale":"2023-12-19T05:38:59.581275+0000","last_undegraded":"2023-12-19T05:38:59.581275+0000","last_fullsized":"2023-12-19T05:38:59.581275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:40:14.448992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090400+0000","last_change":"2023-12-19T05:38:58.101614+0000","last_active":"2023-12-19T05:38:59.090400+0000","last_peered":"2023-12-19T05:38:59.090400+0000","last_clean":"2023-12-19T05:38:59.090400+0000","last_became_active":"2023-12-19T05:38:58.101372+0000","last_became_peered":"2023-12-19T05:38:58.101372+0000","last_unstale":"2023-12-19T05:38:59.090400+0000","last_undegraded":"2023-12-19T05:38:59.090400+0000","last_fullsized":"2023-12-19T05:38:59.090400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581894+0000","last_change":"2023-12-19T05:38:58.113056+0000","last_active":"2023-12-19T05:38:59.581894+0000","last_peered":"2023-12-19T05:38:59.581894+0000","last_clean":"2023-12-19T05:38:59.581894+0000","last_became_active":"2023-12-19T05:38:58.112370+0000","last_became_peered":"2023-12-19T05:38:58.112370+0000","last_unstale":"2023-12-19T05:38:59.581894+0000","last_undegraded":"2023-12-19T05:38:59.581894+0000","last_fullsized":"2023-12-19T05:38:59.581894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:45:31.440161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090265+0000","last_change":"2023-12-19T05:38:58.098952+0000","last_active":"2023-12-19T05:38:59.090265+0000","last_peered":"2023-12-19T05:38:59.090265+0000","last_clean":"2023-12-19T05:38:59.090265+0000","last_became_active":"2023-12-19T05:38:58.098688+0000","last_became_peered":"2023-12-19T05:38:58.098688+0000","last_unstale":"2023-12-19T05:38:59.090265+0000","last_undegraded":"2023-12-19T05:38:59.090265+0000","last_fullsized":"2023-12-19T05:38:59.090265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089927+0000","last_change":"2023-12-19T05:38:58.101480+0000","last_active":"2023-12-19T05:38:59.089927+0000","last_peered":"2023-12-19T05:38:59.089927+0000","last_clean":"2023-12-19T05:38:59.089927+0000","last_became_active":"2023-12-19T05:38:58.101192+0000","last_became_peered":"2023-12-19T05:38:58.101192+0000","last_unstale":"2023-12-19T05:38:59.089927+0000","last_undegraded":"2023-12-19T05:38:59.089927+0000","last_fullsized":"2023-12-19T05:38:59.089927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:27.315801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090474+0000","last_change":"2023-12-19T05:38:58.091884+0000","last_active":"2023-12-19T05:38:59.090474+0000","last_peered":"2023-12-19T05:38:59.090474+0000","last_clean":"2023-12-19T05:38:59.090474+0000","last_became_active":"2023-12-19T05:38:58.091578+0000","last_became_peered":"2023-12-19T05:38:58.091578+0000","last_unstale":"2023-12-19T05:38:59.090474+0000","last_undegraded":"2023-12-19T05:38:59.090474+0000","last_fullsized":"2023-12-19T05:38:59.090474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:16.970670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090626+0000","last_change":"2023-12-19T05:38:58.101436+0000","last_active":"2023-12-19T05:38:59.090626+0000","last_peered":"2023-12-19T05:38:59.090626+0000","last_clean":"2023-12-19T05:38:59.090626+0000","last_became_active":"2023-12-19T05:38:58.100401+0000","last_became_peered":"2023-12-19T05:38:58.100401+0000","last_unstale":"2023-12-19T05:38:59.090626+0000","last_undegraded":"2023-12-19T05:38:59.090626+0000","last_fullsized":"2023-12-19T05:38:59.090626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:11:32.894490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581146+0000","last_change":"2023-12-19T05:38:58.102811+0000","last_active":"2023-12-19T05:38:59.581146+0000","last_peered":"2023-12-19T05:38:59.581146+0000","last_clean":"2023-12-19T05:38:59.581146+0000","last_became_active":"2023-12-19T05:38:58.102580+0000","last_became_peered":"2023-12-19T05:38:58.102580+0000","last_unstale":"2023-12-19T05:38:59.581146+0000","last_undegraded":"2023-12-19T05:38:59.581146+0000","last_fullsized":"2023-12-19T05:38:59.581146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583668+0000","last_change":"2023-12-19T05:38:58.102035+0000","last_active":"2023-12-19T05:38:59.583668+0000","last_peered":"2023-12-19T05:38:59.583668+0000","last_clean":"2023-12-19T05:38:59.583668+0000","last_became_active":"2023-12-19T05:38:58.101153+0000","last_became_peered":"2023-12-19T05:38:58.101153+0000","last_unstale":"2023-12-19T05:38:59.583668+0000","last_undegraded":"2023-12-19T05:38:59.583668+0000","last_fullsized":"2023-12-19T05:38:59.583668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:27.315801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581251+0000","last_change":"2023-12-19T05:38:58.106052+0000","last_active":"2023-12-19T05:38:59.581251+0000","last_peered":"2023-12-19T05:38:59.581251+0000","last_clean":"2023-12-19T05:38:59.581251+0000","last_became_active":"2023-12-19T05:38:58.105526+0000","last_became_peered":"2023-12-19T05:38:58.105526+0000","last_unstale":"2023-12-19T05:38:59.581251+0000","last_undegraded":"2023-12-19T05:38:59.581251+0000","last_fullsized":"2023-12-19T05:38:59.581251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582066+0000","last_change":"2023-12-19T05:38:58.108370+0000","last_active":"2023-12-19T05:38:59.582066+0000","last_peered":"2023-12-19T05:38:59.582066+0000","last_clean":"2023-12-19T05:38:59.582066+0000","last_became_active":"2023-12-19T05:38:58.108107+0000","last_became_peered":"2023-12-19T05:38:58.108107+0000","last_unstale":"2023-12-19T05:38:59.582066+0000","last_undegraded":"2023-12-19T05:38:59.582066+0000","last_fullsized":"2023-12-19T05:38:59.582066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:52.928586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583650+0000","last_change":"2023-12-19T05:38:58.102611+0000","last_active":"2023-12-19T05:38:59.583650+0000","last_peered":"2023-12-19T05:38:59.583650+0000","last_clean":"2023-12-19T05:38:59.583650+0000","last_became_active":"2023-12-19T05:38:58.102361+0000","last_became_peered":"2023-12-19T05:38:58.102361+0000","last_unstale":"2023-12-19T05:38:59.583650+0000","last_undegraded":"2023-12-19T05:38:59.583650+0000","last_fullsized":"2023-12-19T05:38:59.583650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:31.277716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582028+0000","last_change":"2023-12-19T05:38:58.107547+0000","last_active":"2023-12-19T05:38:59.582028+0000","last_peered":"2023-12-19T05:38:59.582028+0000","last_clean":"2023-12-19T05:38:59.582028+0000","last_became_active":"2023-12-19T05:38:58.106808+0000","last_became_peered":"2023-12-19T05:38:58.106808+0000","last_unstale":"2023-12-19T05:38:59.582028+0000","last_undegraded":"2023-12-19T05:38:59.582028+0000","last_fullsized":"2023-12-19T05:38:59.582028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:52.928586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089864+0000","last_change":"2023-12-19T05:38:58.094094+0000","last_active":"2023-12-19T05:38:59.089864+0000","last_peered":"2023-12-19T05:38:59.089864+0000","last_clean":"2023-12-19T05:38:59.089864+0000","last_became_active":"2023-12-19T05:38:58.093233+0000","last_became_peered":"2023-12-19T05:38:58.093233+0000","last_unstale":"2023-12-19T05:38:59.089864+0000","last_undegraded":"2023-12-19T05:38:59.089864+0000","last_fullsized":"2023-12-19T05:38:59.089864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581342+0000","last_change":"2023-12-19T05:38:58.098898+0000","last_active":"2023-12-19T05:38:59.581342+0000","last_peered":"2023-12-19T05:38:59.581342+0000","last_clean":"2023-12-19T05:38:59.581342+0000","last_became_active":"2023-12-19T05:38:58.098655+0000","last_became_peered":"2023-12-19T05:38:58.098655+0000","last_unstale":"2023-12-19T05:38:59.581342+0000","last_undegraded":"2023-12-19T05:38:59.581342+0000","last_fullsized":"2023-12-19T05:38:59.581342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582246+0000","last_change":"2023-12-19T05:38:58.109033+0000","last_active":"2023-12-19T05:38:59.582246+0000","last_peered":"2023-12-19T05:38:59.582246+0000","last_clean":"2023-12-19T05:38:59.582246+0000","last_became_active":"2023-12-19T05:38:58.108755+0000","last_became_peered":"2023-12-19T05:38:58.108755+0000","last_unstale":"2023-12-19T05:38:59.582246+0000","last_undegraded":"2023-12-19T05:38:59.582246+0000","last_fullsized":"2023-12-19T05:38:59.582246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:45:31.440161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090497+0000","last_change":"2023-12-19T05:38:58.103472+0000","last_active":"2023-12-19T05:38:59.090497+0000","last_peered":"2023-12-19T05:38:59.090497+0000","last_clean":"2023-12-19T05:38:59.090497+0000","last_became_active":"2023-12-19T05:38:58.103212+0000","last_became_peered":"2023-12-19T05:38:58.103212+0000","last_unstale":"2023-12-19T05:38:59.090497+0000","last_undegraded":"2023-12-19T05:38:59.090497+0000","last_fullsized":"2023-12-19T05:38:59.090497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581328+0000","last_change":"2023-12-19T05:38:58.100231+0000","last_active":"2023-12-19T05:38:59.581328+0000","last_peered":"2023-12-19T05:38:59.581328+0000","last_clean":"2023-12-19T05:38:59.581328+0000","last_became_active":"2023-12-19T05:38:58.100015+0000","last_became_peered":"2023-12-19T05:38:58.100015+0000","last_unstale":"2023-12-19T05:38:59.581328+0000","last_undegraded":"2023-12-19T05:38:59.581328+0000","last_fullsized":"2023-12-19T05:38:59.581328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:06:44.968515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090809+0000","last_change":"2023-12-19T05:38:58.104008+0000","last_active":"2023-12-19T05:38:59.090809+0000","last_peered":"2023-12-19T05:38:59.090809+0000","last_clean":"2023-12-19T05:38:59.090809+0000","last_became_active":"2023-12-19T05:38:58.103773+0000","last_became_peered":"2023-12-19T05:38:58.103773+0000","last_unstale":"2023-12-19T05:38:59.090809+0000","last_undegraded":"2023-12-19T05:38:59.090809+0000","last_fullsized":"2023-12-19T05:38:59.090809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:39:36.270833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090360+0000","last_change":"2023-12-19T05:38:58.098405+0000","last_active":"2023-12-19T05:38:59.090360+0000","last_peered":"2023-12-19T05:38:59.090360+0000","last_clean":"2023-12-19T05:38:59.090360+0000","last_became_active":"2023-12-19T05:38:58.098169+0000","last_became_peered":"2023-12-19T05:38:58.098169+0000","last_unstale":"2023-12-19T05:38:59.090360+0000","last_undegraded":"2023-12-19T05:38:59.090360+0000","last_fullsized":"2023-12-19T05:38:59.090360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583795+0000","last_change":"2023-12-19T05:38:58.103378+0000","last_active":"2023-12-19T05:38:59.583795+0000","last_peered":"2023-12-19T05:38:59.583795+0000","last_clean":"2023-12-19T05:38:59.583795+0000","last_became_active":"2023-12-19T05:38:58.103170+0000","last_became_peered":"2023-12-19T05:38:58.103170+0000","last_unstale":"2023-12-19T05:38:59.583795+0000","last_undegraded":"2023-12-19T05:38:59.583795+0000","last_fullsized":"2023-12-19T05:38:59.583795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090735+0000","last_change":"2023-12-19T05:38:58.104682+0000","last_active":"2023-12-19T05:38:59.090735+0000","last_peered":"2023-12-19T05:38:59.090735+0000","last_clean":"2023-12-19T05:38:59.090735+0000","last_became_active":"2023-12-19T05:38:58.104111+0000","last_became_peered":"2023-12-19T05:38:58.104111+0000","last_unstale":"2023-12-19T05:38:59.090735+0000","last_undegraded":"2023-12-19T05:38:59.090735+0000","last_fullsized":"2023-12-19T05:38:59.090735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:04:17.113504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581369+0000","last_change":"2023-12-19T05:38:58.109481+0000","last_active":"2023-12-19T05:38:59.581369+0000","last_peered":"2023-12-19T05:38:59.581369+0000","last_clean":"2023-12-19T05:38:59.581369+0000","last_became_active":"2023-12-19T05:38:58.109231+0000","last_became_peered":"2023-12-19T05:38:58.109231+0000","last_unstale":"2023-12-19T05:38:59.581369+0000","last_undegraded":"2023-12-19T05:38:59.581369+0000","last_fullsized":"2023-12-19T05:38:59.581369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:11:32.894490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581984+0000","last_change":"2023-12-19T05:38:58.099092+0000","last_active":"2023-12-19T05:38:59.581984+0000","last_peered":"2023-12-19T05:38:59.581984+0000","last_clean":"2023-12-19T05:38:59.581984+0000","last_became_active":"2023-12-19T05:38:58.098814+0000","last_became_peered":"2023-12-19T05:38:58.098814+0000","last_unstale":"2023-12-19T05:38:59.581984+0000","last_undegraded":"2023-12-19T05:38:59.581984+0000","last_fullsized":"2023-12-19T05:38:59.581984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:49:37.511914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583537+0000","last_change":"2023-12-19T05:38:58.101510+0000","last_active":"2023-12-19T05:38:59.583537+0000","last_peered":"2023-12-19T05:38:59.583537+0000","last_clean":"2023-12-19T05:38:59.583537+0000","last_became_active":"2023-12-19T05:38:58.101267+0000","last_became_peered":"2023-12-19T05:38:58.101267+0000","last_unstale":"2023-12-19T05:38:59.583537+0000","last_undegraded":"2023-12-19T05:38:59.583537+0000","last_fullsized":"2023-12-19T05:38:59.583537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:12.386527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089518+0000","last_change":"2023-12-19T05:38:58.090308+0000","last_active":"2023-12-19T05:38:59.089518+0000","last_peered":"2023-12-19T05:38:59.089518+0000","last_clean":"2023-12-19T05:38:59.089518+0000","last_became_active":"2023-12-19T05:38:58.090012+0000","last_became_peered":"2023-12-19T05:38:58.090012+0000","last_unstale":"2023-12-19T05:38:59.089518+0000","last_undegraded":"2023-12-19T05:38:59.089518+0000","last_fullsized":"2023-12-19T05:38:59.089518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089935+0000","last_change":"2023-12-19T05:38:58.104390+0000","last_active":"2023-12-19T05:38:59.089935+0000","last_peered":"2023-12-19T05:38:59.089935+0000","last_clean":"2023-12-19T05:38:59.089935+0000","last_became_active":"2023-12-19T05:38:58.103851+0000","last_became_peered":"2023-12-19T05:38:58.103851+0000","last_unstale":"2023-12-19T05:38:59.089935+0000","last_undegraded":"2023-12-19T05:38:59.089935+0000","last_fullsized":"2023-12-19T05:38:59.089935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:31.277716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090708+0000","last_change":"2023-12-19T05:38:57.749842+0000","last_active":"2023-12-19T05:38:59.090708+0000","last_peered":"2023-12-19T05:38:59.090708+0000","last_clean":"2023-12-19T05:38:59.090708+0000","last_became_active":"2023-12-19T05:38:57.749527+0000","last_became_peered":"2023-12-19T05:38:57.749527+0000","last_unstale":"2023-12-19T05:38:59.090708+0000","last_undegraded":"2023-12-19T05:38:59.090708+0000","last_fullsized":"2023-12-19T05:38:59.090708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:33:24.465492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581443+0000","last_change":"2023-12-19T05:38:58.097552+0000","last_active":"2023-12-19T05:38:59.581443+0000","last_peered":"2023-12-19T05:38:59.581443+0000","last_clean":"2023-12-19T05:38:59.581443+0000","last_became_active":"2023-12-19T05:38:58.095804+0000","last_became_peered":"2023-12-19T05:38:58.095804+0000","last_unstale":"2023-12-19T05:38:59.581443+0000","last_undegraded":"2023-12-19T05:38:59.581443+0000","last_fullsized":"2023-12-19T05:38:59.581443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:43.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089572+0000","last_change":"2023-12-19T05:38:57.745855+0000","last_active":"2023-12-19T05:38:59.089572+0000","last_peered":"2023-12-19T05:38:59.089572+0000","last_clean":"2023-12-19T05:38:59.089572+0000","last_became_active":"2023-12-19T05:38:57.745612+0000","last_became_peered":"2023-12-19T05:38:57.745612+0000","last_unstale":"2023-12-19T05:38:59.089572+0000","last_undegraded":"2023-12-19T05:38:59.089572+0000","last_fullsized":"2023-12-19T05:38:59.089572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:04.242717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090578+0000","last_change":"2023-12-19T05:38:57.743029+0000","last_active":"2023-12-19T05:38:59.090578+0000","last_peered":"2023-12-19T05:38:59.090578+0000","last_clean":"2023-12-19T05:38:59.090578+0000","last_became_active":"2023-12-19T05:38:57.742745+0000","last_became_peered":"2023-12-19T05:38:57.742745+0000","last_unstale":"2023-12-19T05:38:59.090578+0000","last_undegraded":"2023-12-19T05:38:59.090578+0000","last_fullsized":"2023-12-19T05:38:59.090578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:50:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090439+0000","last_change":"2023-12-19T05:38:58.105433+0000","last_active":"2023-12-19T05:38:59.090439+0000","last_peered":"2023-12-19T05:38:59.090439+0000","last_clean":"2023-12-19T05:38:59.090439+0000","last_became_active":"2023-12-19T05:38:58.105208+0000","last_became_peered":"2023-12-19T05:38:58.105208+0000","last_unstale":"2023-12-19T05:38:59.090439+0000","last_undegraded":"2023-12-19T05:38:59.090439+0000","last_fullsized":"2023-12-19T05:38:59.090439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:21:31.517735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581358+0000","last_change":"2023-12-19T05:38:57.748694+0000","last_active":"2023-12-19T05:38:59.581358+0000","last_peered":"2023-12-19T05:38:59.581358+0000","last_clean":"2023-12-19T05:38:59.581358+0000","last_became_active":"2023-12-19T05:38:57.748438+0000","last_became_peered":"2023-12-19T05:38:57.748438+0000","last_unstale":"2023-12-19T05:38:59.581358+0000","last_undegraded":"2023-12-19T05:38:59.581358+0000","last_fullsized":"2023-12-19T05:38:59.581358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:50:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583565+0000","last_change":"2023-12-19T05:38:58.104021+0000","last_active":"2023-12-19T05:38:59.583565+0000","last_peered":"2023-12-19T05:38:59.583565+0000","last_clean":"2023-12-19T05:38:59.583565+0000","last_became_active":"2023-12-19T05:38:58.103716+0000","last_became_peered":"2023-12-19T05:38:58.103716+0000","last_unstale":"2023-12-19T05:38:59.583565+0000","last_undegraded":"2023-12-19T05:38:59.583565+0000","last_fullsized":"2023-12-19T05:38:59.583565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090207+0000","last_change":"2023-12-19T05:38:57.741260+0000","last_active":"2023-12-19T05:38:59.090207+0000","last_peered":"2023-12-19T05:38:59.090207+0000","last_clean":"2023-12-19T05:38:59.090207+0000","last_became_active":"2023-12-19T05:38:57.740992+0000","last_became_peered":"2023-12-19T05:38:57.740992+0000","last_unstale":"2023-12-19T05:38:59.090207+0000","last_undegraded":"2023-12-19T05:38:59.090207+0000","last_fullsized":"2023-12-19T05:38:59.090207+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:33.835019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581639+0000","last_change":"2023-12-19T05:38:58.107290+0000","last_active":"2023-12-19T05:38:59.581639+0000","last_peered":"2023-12-19T05:38:59.581639+0000","last_clean":"2023-12-19T05:38:59.581639+0000","last_became_active":"2023-12-19T05:38:58.107029+0000","last_became_peered":"2023-12-19T05:38:58.107029+0000","last_unstale":"2023-12-19T05:38:59.581639+0000","last_undegraded":"2023-12-19T05:38:59.581639+0000","last_fullsized":"2023-12-19T05:38:59.581639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581826+0000","last_change":"2023-12-19T05:38:57.742723+0000","last_active":"2023-12-19T05:38:59.581826+0000","last_peered":"2023-12-19T05:38:59.581826+0000","last_clean":"2023-12-19T05:38:59.581826+0000","last_became_active":"2023-12-19T05:38:57.742471+0000","last_became_peered":"2023-12-19T05:38:57.742471+0000","last_unstale":"2023-12-19T05:38:59.581826+0000","last_undegraded":"2023-12-19T05:38:59.581826+0000","last_fullsized":"2023-12-19T05:38:59.581826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581502+0000","last_change":"2023-12-19T05:38:58.099111+0000","last_active":"2023-12-19T05:38:59.581502+0000","last_peered":"2023-12-19T05:38:59.581502+0000","last_clean":"2023-12-19T05:38:59.581502+0000","last_became_active":"2023-12-19T05:38:58.098866+0000","last_became_peered":"2023-12-19T05:38:58.098866+0000","last_unstale":"2023-12-19T05:38:59.581502+0000","last_undegraded":"2023-12-19T05:38:59.581502+0000","last_fullsized":"2023-12-19T05:38:59.581502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583938+0000","last_change":"2023-12-19T05:38:57.748284+0000","last_active":"2023-12-19T05:38:59.583938+0000","last_peered":"2023-12-19T05:38:59.583938+0000","last_clean":"2023-12-19T05:38:59.583938+0000","last_became_active":"2023-12-19T05:38:57.747886+0000","last_became_peered":"2023-12-19T05:38:57.747886+0000","last_unstale":"2023-12-19T05:38:59.583938+0000","last_undegraded":"2023-12-19T05:38:59.583938+0000","last_fullsized":"2023-12-19T05:38:59.583938+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:04.242717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090492+0000","last_change":"2023-12-19T05:38:58.109568+0000","last_active":"2023-12-19T05:38:59.090492+0000","last_peered":"2023-12-19T05:38:59.090492+0000","last_clean":"2023-12-19T05:38:59.090492+0000","last_became_active":"2023-12-19T05:38:58.108532+0000","last_became_peered":"2023-12-19T05:38:58.108532+0000","last_unstale":"2023-12-19T05:38:59.090492+0000","last_undegraded":"2023-12-19T05:38:59.090492+0000","last_fullsized":"2023-12-19T05:38:59.090492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:38:34.042375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089982+0000","last_change":"2023-12-19T05:38:57.744873+0000","last_active":"2023-12-19T05:38:59.089982+0000","last_peered":"2023-12-19T05:38:59.089982+0000","last_clean":"2023-12-19T05:38:59.089982+0000","last_became_active":"2023-12-19T05:38:57.744145+0000","last_became_peered":"2023-12-19T05:38:57.744145+0000","last_unstale":"2023-12-19T05:38:59.089982+0000","last_undegraded":"2023-12-19T05:38:59.089982+0000","last_fullsized":"2023-12-19T05:38:59.089982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581811+0000","last_change":"2023-12-19T05:38:58.110455+0000","last_active":"2023-12-19T05:38:59.581811+0000","last_peered":"2023-12-19T05:38:59.581811+0000","last_clean":"2023-12-19T05:38:59.581811+0000","last_became_active":"2023-12-19T05:38:58.109945+0000","last_became_peered":"2023-12-19T05:38:58.109945+0000","last_unstale":"2023-12-19T05:38:59.581811+0000","last_undegraded":"2023-12-19T05:38:59.581811+0000","last_fullsized":"2023-12-19T05:38:59.581811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:33:14.172127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581486+0000","last_change":"2023-12-19T05:38:57.748546+0000","last_active":"2023-12-19T05:38:59.581486+0000","last_peered":"2023-12-19T05:38:59.581486+0000","last_clean":"2023-12-19T05:38:59.581486+0000","last_became_active":"2023-12-19T05:38:57.748278+0000","last_became_peered":"2023-12-19T05:38:57.748278+0000","last_unstale":"2023-12-19T05:38:59.581486+0000","last_undegraded":"2023-12-19T05:38:59.581486+0000","last_fullsized":"2023-12-19T05:38:59.581486+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581224+0000","last_change":"2023-12-19T05:38:58.098339+0000","last_active":"2023-12-19T05:38:59.581224+0000","last_peered":"2023-12-19T05:38:59.581224+0000","last_clean":"2023-12-19T05:38:59.581224+0000","last_became_active":"2023-12-19T05:38:58.098089+0000","last_became_peered":"2023-12-19T05:38:58.098089+0000","last_unstale":"2023-12-19T05:38:59.581224+0000","last_undegraded":"2023-12-19T05:38:59.581224+0000","last_fullsized":"2023-12-19T05:38:59.581224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:04:17.113504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582073+0000","last_change":"2023-12-19T05:38:57.745004+0000","last_active":"2023-12-19T05:38:59.582073+0000","last_peered":"2023-12-19T05:38:59.582073+0000","last_clean":"2023-12-19T05:38:59.582073+0000","last_became_active":"2023-12-19T05:38:57.744741+0000","last_became_peered":"2023-12-19T05:38:57.744741+0000","last_unstale":"2023-12-19T05:38:59.582073+0000","last_undegraded":"2023-12-19T05:38:59.582073+0000","last_fullsized":"2023-12-19T05:38:59.582073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:33:24.465492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581723+0000","last_change":"2023-12-19T05:38:58.111124+0000","last_active":"2023-12-19T05:38:59.581723+0000","last_peered":"2023-12-19T05:38:59.581723+0000","last_clean":"2023-12-19T05:38:59.581723+0000","last_became_active":"2023-12-19T05:38:58.110863+0000","last_became_peered":"2023-12-19T05:38:58.110863+0000","last_unstale":"2023-12-19T05:38:59.581723+0000","last_undegraded":"2023-12-19T05:38:59.581723+0000","last_fullsized":"2023-12-19T05:38:59.581723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:11:32.894490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089625+0000","last_change":"2023-12-19T05:38:57.746422+0000","last_active":"2023-12-19T05:38:59.089625+0000","last_peered":"2023-12-19T05:38:59.089625+0000","last_clean":"2023-12-19T05:38:59.089625+0000","last_became_active":"2023-12-19T05:38:57.745789+0000","last_became_peered":"2023-12-19T05:38:57.745789+0000","last_unstale":"2023-12-19T05:38:59.089625+0000","last_undegraded":"2023-12-19T05:38:59.089625+0000","last_fullsized":"2023-12-19T05:38:59.089625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:33:24.465492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089575+0000","last_change":"2023-12-19T05:38:58.090187+0000","last_active":"2023-12-19T05:38:59.089575+0000","last_peered":"2023-12-19T05:38:59.089575+0000","last_clean":"2023-12-19T05:38:59.089575+0000","last_became_active":"2023-12-19T05:38:58.089802+0000","last_became_peered":"2023-12-19T05:38:58.089802+0000","last_unstale":"2023-12-19T05:38:59.089575+0000","last_undegraded":"2023-12-19T05:38:59.089575+0000","last_fullsized":"2023-12-19T05:38:59.089575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:39:36.270833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583432+0000","last_change":"2023-12-19T05:38:57.741208+0000","last_active":"2023-12-19T05:38:59.583432+0000","last_peered":"2023-12-19T05:38:59.583432+0000","last_clean":"2023-12-19T05:38:59.583432+0000","last_became_active":"2023-12-19T05:38:57.740907+0000","last_became_peered":"2023-12-19T05:38:57.740907+0000","last_unstale":"2023-12-19T05:38:59.583432+0000","last_undegraded":"2023-12-19T05:38:59.583432+0000","last_fullsized":"2023-12-19T05:38:59.583432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581282+0000","last_change":"2023-12-19T05:38:58.113284+0000","last_active":"2023-12-19T05:38:59.581282+0000","last_peered":"2023-12-19T05:38:59.581282+0000","last_clean":"2023-12-19T05:38:59.581282+0000","last_became_active":"2023-12-19T05:38:58.112846+0000","last_became_peered":"2023-12-19T05:38:58.112846+0000","last_unstale":"2023-12-19T05:38:59.581282+0000","last_undegraded":"2023-12-19T05:38:59.581282+0000","last_fullsized":"2023-12-19T05:38:59.581282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:49:37.511914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090448+0000","last_change":"2023-12-19T05:38:57.745168+0000","last_active":"2023-12-19T05:38:59.090448+0000","last_peered":"2023-12-19T05:38:59.090448+0000","last_clean":"2023-12-19T05:38:59.090448+0000","last_became_active":"2023-12-19T05:38:57.744905+0000","last_became_peered":"2023-12-19T05:38:57.744905+0000","last_unstale":"2023-12-19T05:38:59.090448+0000","last_undegraded":"2023-12-19T05:38:59.090448+0000","last_fullsized":"2023-12-19T05:38:59.090448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:51:13.990639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581693+0000","last_change":"2023-12-19T05:38:58.108513+0000","last_active":"2023-12-19T05:38:59.581693+0000","last_peered":"2023-12-19T05:38:59.581693+0000","last_clean":"2023-12-19T05:38:59.581693+0000","last_became_active":"2023-12-19T05:38:58.108250+0000","last_became_peered":"2023-12-19T05:38:58.108250+0000","last_unstale":"2023-12-19T05:38:59.581693+0000","last_undegraded":"2023-12-19T05:38:59.581693+0000","last_fullsized":"2023-12-19T05:38:59.581693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:19:59.418017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583713+0000","last_change":"2023-12-19T05:38:57.745413+0000","last_active":"2023-12-19T05:38:59.583713+0000","last_peered":"2023-12-19T05:38:59.583713+0000","last_clean":"2023-12-19T05:38:59.583713+0000","last_became_active":"2023-12-19T05:38:57.745149+0000","last_became_peered":"2023-12-19T05:38:57.745149+0000","last_unstale":"2023-12-19T05:38:59.583713+0000","last_undegraded":"2023-12-19T05:38:59.583713+0000","last_fullsized":"2023-12-19T05:38:59.583713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:50:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582004+0000","last_change":"2023-12-19T05:38:58.112902+0000","last_active":"2023-12-19T05:38:59.582004+0000","last_peered":"2023-12-19T05:38:59.582004+0000","last_clean":"2023-12-19T05:38:59.582004+0000","last_became_active":"2023-12-19T05:38:58.112627+0000","last_became_peered":"2023-12-19T05:38:58.112627+0000","last_unstale":"2023-12-19T05:38:59.582004+0000","last_undegraded":"2023-12-19T05:38:59.582004+0000","last_fullsized":"2023-12-19T05:38:59.582004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:06:44.968515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583906+0000","last_change":"2023-12-19T05:38:57.748007+0000","last_active":"2023-12-19T05:38:59.583906+0000","last_peered":"2023-12-19T05:38:59.583906+0000","last_clean":"2023-12-19T05:38:59.583906+0000","last_became_active":"2023-12-19T05:38:57.747719+0000","last_became_peered":"2023-12-19T05:38:57.747719+0000","last_unstale":"2023-12-19T05:38:59.583906+0000","last_undegraded":"2023-12-19T05:38:59.583906+0000","last_fullsized":"2023-12-19T05:38:59.583906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:30.273362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582169+0000","last_change":"2023-12-19T05:38:58.104239+0000","last_active":"2023-12-19T05:38:59.582169+0000","last_peered":"2023-12-19T05:38:59.582169+0000","last_clean":"2023-12-19T05:38:59.582169+0000","last_became_active":"2023-12-19T05:38:58.103949+0000","last_became_peered":"2023-12-19T05:38:58.103949+0000","last_unstale":"2023-12-19T05:38:59.582169+0000","last_undegraded":"2023-12-19T05:38:59.582169+0000","last_fullsized":"2023-12-19T05:38:59.582169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:11:32.894490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583613+0000","last_change":"2023-12-19T05:38:57.743974+0000","last_active":"2023-12-19T05:38:59.583613+0000","last_peered":"2023-12-19T05:38:59.583613+0000","last_clean":"2023-12-19T05:38:59.583613+0000","last_became_active":"2023-12-19T05:38:57.743685+0000","last_became_peered":"2023-12-19T05:38:57.743685+0000","last_unstale":"2023-12-19T05:38:59.583613+0000","last_undegraded":"2023-12-19T05:38:59.583613+0000","last_fullsized":"2023-12-19T05:38:59.583613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:33:24.465492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581912+0000","last_change":"2023-12-19T05:38:58.106818+0000","last_active":"2023-12-19T05:38:59.581912+0000","last_peered":"2023-12-19T05:38:59.581912+0000","last_clean":"2023-12-19T05:38:59.581912+0000","last_became_active":"2023-12-19T05:38:58.106450+0000","last_became_peered":"2023-12-19T05:38:58.106450+0000","last_unstale":"2023-12-19T05:38:59.581912+0000","last_undegraded":"2023-12-19T05:38:59.581912+0000","last_fullsized":"2023-12-19T05:38:59.581912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:44:05.254781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T05:38:58.098353+0000","last_change":"2023-12-19T05:38:47.150620+0000","last_active":"2023-12-19T05:38:58.098353+0000","last_peered":"2023-12-19T05:38:58.098353+0000","last_clean":"2023-12-19T05:38:58.098353+0000","last_became_active":"2023-12-19T05:38:47.149844+0000","last_became_peered":"2023-12-19T05:38:47.149844+0000","last_unstale":"2023-12-19T05:38:58.098353+0000","last_undegraded":"2023-12-19T05:38:58.098353+0000","last_fullsized":"2023-12-19T05:38:58.098353+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_clean_scrub_stamp":"2023-12-19T05:38:46.034642+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:51.920917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581466+0000","last_change":"2023-12-19T05:38:57.741233+0000","last_active":"2023-12-19T05:38:59.581466+0000","last_peered":"2023-12-19T05:38:59.581466+0000","last_clean":"2023-12-19T05:38:59.581466+0000","last_became_active":"2023-12-19T05:38:57.740919+0000","last_became_peered":"2023-12-19T05:38:57.740919+0000","last_unstale":"2023-12-19T05:38:59.581466+0000","last_undegraded":"2023-12-19T05:38:59.581466+0000","last_fullsized":"2023-12-19T05:38:59.581466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:33.835019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090563+0000","last_change":"2023-12-19T05:38:58.101883+0000","last_active":"2023-12-19T05:38:59.090563+0000","last_peered":"2023-12-19T05:38:59.090563+0000","last_clean":"2023-12-19T05:38:59.090563+0000","last_became_active":"2023-12-19T05:38:58.101654+0000","last_became_peered":"2023-12-19T05:38:58.101654+0000","last_unstale":"2023-12-19T05:38:59.090563+0000","last_undegraded":"2023-12-19T05:38:59.090563+0000","last_fullsized":"2023-12-19T05:38:59.090563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:39:59.812690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581246+0000","last_change":"2023-12-19T05:38:57.753323+0000","last_active":"2023-12-19T05:38:59.581246+0000","last_peered":"2023-12-19T05:38:59.581246+0000","last_clean":"2023-12-19T05:38:59.581246+0000","last_became_active":"2023-12-19T05:38:57.752998+0000","last_became_peered":"2023-12-19T05:38:57.752998+0000","last_unstale":"2023-12-19T05:38:59.581246+0000","last_undegraded":"2023-12-19T05:38:59.581246+0000","last_fullsized":"2023-12-19T05:38:59.581246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:33.835019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581129+0000","last_change":"2023-12-19T05:38:58.093174+0000","last_active":"2023-12-19T05:38:59.581129+0000","last_peered":"2023-12-19T05:38:59.581129+0000","last_clean":"2023-12-19T05:38:59.581129+0000","last_became_active":"2023-12-19T05:38:58.092933+0000","last_became_peered":"2023-12-19T05:38:58.092933+0000","last_unstale":"2023-12-19T05:38:59.581129+0000","last_undegraded":"2023-12-19T05:38:59.581129+0000","last_fullsized":"2023-12-19T05:38:59.581129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:52.928586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583580+0000","last_change":"2023-12-19T05:38:57.745338+0000","last_active":"2023-12-19T05:38:59.583580+0000","last_peered":"2023-12-19T05:38:59.583580+0000","last_clean":"2023-12-19T05:38:59.583580+0000","last_became_active":"2023-12-19T05:38:57.745038+0000","last_became_peered":"2023-12-19T05:38:57.745038+0000","last_unstale":"2023-12-19T05:38:59.583580+0000","last_undegraded":"2023-12-19T05:38:59.583580+0000","last_fullsized":"2023-12-19T05:38:59.583580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583564+0000","last_change":"2023-12-19T05:38:58.102456+0000","last_active":"2023-12-19T05:38:59.583564+0000","last_peered":"2023-12-19T05:38:59.583564+0000","last_clean":"2023-12-19T05:38:59.583564+0000","last_became_active":"2023-12-19T05:38:58.102200+0000","last_became_peered":"2023-12-19T05:38:58.102200+0000","last_unstale":"2023-12-19T05:38:59.583564+0000","last_undegraded":"2023-12-19T05:38:59.583564+0000","last_fullsized":"2023-12-19T05:38:59.583564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:04:17.113504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582159+0000","last_change":"2023-12-19T05:38:57.743585+0000","last_active":"2023-12-19T05:38:59.582159+0000","last_peered":"2023-12-19T05:38:59.582159+0000","last_clean":"2023-12-19T05:38:59.582159+0000","last_became_active":"2023-12-19T05:38:57.743280+0000","last_became_peered":"2023-12-19T05:38:57.743280+0000","last_unstale":"2023-12-19T05:38:59.582159+0000","last_undegraded":"2023-12-19T05:38:59.582159+0000","last_fullsized":"2023-12-19T05:38:59.582159+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090317+0000","last_change":"2023-12-19T05:38:58.091932+0000","last_active":"2023-12-19T05:38:59.090317+0000","last_peered":"2023-12-19T05:38:59.090317+0000","last_clean":"2023-12-19T05:38:59.090317+0000","last_became_active":"2023-12-19T05:38:58.091652+0000","last_became_peered":"2023-12-19T05:38:58.091652+0000","last_unstale":"2023-12-19T05:38:59.090317+0000","last_undegraded":"2023-12-19T05:38:59.090317+0000","last_fullsized":"2023-12-19T05:38:59.090317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:07:12.386527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583836+0000","last_change":"2023-12-19T05:38:57.745683+0000","last_active":"2023-12-19T05:38:59.583836+0000","last_peered":"2023-12-19T05:38:59.583836+0000","last_clean":"2023-12-19T05:38:59.583836+0000","last_became_active":"2023-12-19T05:38:57.745397+0000","last_became_peered":"2023-12-19T05:38:57.745397+0000","last_unstale":"2023-12-19T05:38:59.583836+0000","last_undegraded":"2023-12-19T05:38:59.583836+0000","last_fullsized":"2023-12-19T05:38:59.583836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581745+0000","last_change":"2023-12-19T05:38:58.103911+0000","last_active":"2023-12-19T05:38:59.581745+0000","last_peered":"2023-12-19T05:38:59.581745+0000","last_clean":"2023-12-19T05:38:59.581745+0000","last_became_active":"2023-12-19T05:38:58.103234+0000","last_became_peered":"2023-12-19T05:38:58.103234+0000","last_unstale":"2023-12-19T05:38:59.581745+0000","last_undegraded":"2023-12-19T05:38:59.581745+0000","last_fullsized":"2023-12-19T05:38:59.581745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:33:14.172127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.582052+0000","last_change":"2023-12-19T05:38:57.753286+0000","last_active":"2023-12-19T05:38:59.582052+0000","last_peered":"2023-12-19T05:38:59.582052+0000","last_clean":"2023-12-19T05:38:59.582052+0000","last_became_active":"2023-12-19T05:38:57.752956+0000","last_became_peered":"2023-12-19T05:38:57.752956+0000","last_unstale":"2023-12-19T05:38:59.582052+0000","last_undegraded":"2023-12-19T05:38:59.582052+0000","last_fullsized":"2023-12-19T05:38:59.582052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:20:59.704318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583722+0000","last_change":"2023-12-19T05:38:58.106316+0000","last_active":"2023-12-19T05:38:59.583722+0000","last_peered":"2023-12-19T05:38:59.583722+0000","last_clean":"2023-12-19T05:38:59.583722+0000","last_became_active":"2023-12-19T05:38:58.106080+0000","last_became_peered":"2023-12-19T05:38:58.106080+0000","last_unstale":"2023-12-19T05:38:59.583722+0000","last_undegraded":"2023-12-19T05:38:59.583722+0000","last_fullsized":"2023-12-19T05:38:59.583722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:39:36.270833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:39:00.991292+0000","last_change":"2023-12-19T05:38:57.745431+0000","last_active":"2023-12-19T05:39:00.991292+0000","last_peered":"2023-12-19T05:39:00.991292+0000","last_clean":"2023-12-19T05:39:00.991292+0000","last_became_active":"2023-12-19T05:38:57.745111+0000","last_became_peered":"2023-12-19T05:38:57.745111+0000","last_unstale":"2023-12-19T05:39:00.991292+0000","last_undegraded":"2023-12-19T05:39:00.991292+0000","last_fullsized":"2023-12-19T05:39:00.991292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:15.966316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090806+0000","last_change":"2023-12-19T05:38:58.104157+0000","last_active":"2023-12-19T05:38:59.090806+0000","last_peered":"2023-12-19T05:38:59.090806+0000","last_clean":"2023-12-19T05:38:59.090806+0000","last_became_active":"2023-12-19T05:38:58.103934+0000","last_became_peered":"2023-12-19T05:38:58.103934+0000","last_unstale":"2023-12-19T05:38:59.090806+0000","last_undegraded":"2023-12-19T05:38:59.090806+0000","last_fullsized":"2023-12-19T05:38:59.090806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:55:52.928586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090306+0000","last_change":"2023-12-19T05:38:57.747086+0000","last_active":"2023-12-19T05:38:59.090306+0000","last_peered":"2023-12-19T05:38:59.090306+0000","last_clean":"2023-12-19T05:38:59.090306+0000","last_became_active":"2023-12-19T05:38:57.746818+0000","last_became_peered":"2023-12-19T05:38:57.746818+0000","last_unstale":"2023-12-19T05:38:59.090306+0000","last_undegraded":"2023-12-19T05:38:59.090306+0000","last_fullsized":"2023-12-19T05:38:59.090306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:15.966316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581497+0000","last_change":"2023-12-19T05:38:58.103335+0000","last_active":"2023-12-19T05:38:59.581497+0000","last_peered":"2023-12-19T05:38:59.581497+0000","last_clean":"2023-12-19T05:38:59.581497+0000","last_became_active":"2023-12-19T05:38:58.103108+0000","last_became_peered":"2023-12-19T05:38:58.103108+0000","last_unstale":"2023-12-19T05:38:59.581497+0000","last_undegraded":"2023-12-19T05:38:59.581497+0000","last_fullsized":"2023-12-19T05:38:59.581497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:27.315801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581446+0000","last_change":"2023-12-19T05:38:57.753153+0000","last_active":"2023-12-19T05:38:59.581446+0000","last_peered":"2023-12-19T05:38:59.581446+0000","last_clean":"2023-12-19T05:38:59.581446+0000","last_became_active":"2023-12-19T05:38:57.752881+0000","last_became_peered":"2023-12-19T05:38:57.752881+0000","last_unstale":"2023-12-19T05:38:59.581446+0000","last_undegraded":"2023-12-19T05:38:59.581446+0000","last_fullsized":"2023-12-19T05:38:59.581446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:04.242717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089877+0000","last_change":"2023-12-19T05:38:58.101259+0000","last_active":"2023-12-19T05:38:59.089877+0000","last_peered":"2023-12-19T05:38:59.089877+0000","last_clean":"2023-12-19T05:38:59.089877+0000","last_became_active":"2023-12-19T05:38:58.100992+0000","last_became_peered":"2023-12-19T05:38:58.100992+0000","last_unstale":"2023-12-19T05:38:59.089877+0000","last_undegraded":"2023-12-19T05:38:59.089877+0000","last_fullsized":"2023-12-19T05:38:59.089877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:52:05.247071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583860+0000","last_change":"2023-12-19T05:38:57.745745+0000","last_active":"2023-12-19T05:38:59.583860+0000","last_peered":"2023-12-19T05:38:59.583860+0000","last_clean":"2023-12-19T05:38:59.583860+0000","last_became_active":"2023-12-19T05:38:57.745477+0000","last_became_peered":"2023-12-19T05:38:57.745477+0000","last_unstale":"2023-12-19T05:38:59.583860+0000","last_undegraded":"2023-12-19T05:38:59.583860+0000","last_fullsized":"2023-12-19T05:38:59.583860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090521+0000","last_change":"2023-12-19T05:38:58.107888+0000","last_active":"2023-12-19T05:38:59.090521+0000","last_peered":"2023-12-19T05:38:59.090521+0000","last_clean":"2023-12-19T05:38:59.090521+0000","last_became_active":"2023-12-19T05:38:58.107286+0000","last_became_peered":"2023-12-19T05:38:58.107286+0000","last_unstale":"2023-12-19T05:38:59.090521+0000","last_undegraded":"2023-12-19T05:38:59.090521+0000","last_fullsized":"2023-12-19T05:38:59.090521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:52:27.315801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.583857+0000","last_change":"2023-12-19T05:38:57.745515+0000","last_active":"2023-12-19T05:38:59.583857+0000","last_peered":"2023-12-19T05:38:59.583857+0000","last_clean":"2023-12-19T05:38:59.583857+0000","last_became_active":"2023-12-19T05:38:57.745072+0000","last_became_peered":"2023-12-19T05:38:57.745072+0000","last_unstale":"2023-12-19T05:38:59.583857+0000","last_undegraded":"2023-12-19T05:38:59.583857+0000","last_fullsized":"2023-12-19T05:38:59.583857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:43:33.835019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090635+0000","last_change":"2023-12-19T05:38:58.106802+0000","last_active":"2023-12-19T05:38:59.090635+0000","last_peered":"2023-12-19T05:38:59.090635+0000","last_clean":"2023-12-19T05:38:59.090635+0000","last_became_active":"2023-12-19T05:38:58.106522+0000","last_became_peered":"2023-12-19T05:38:58.106522+0000","last_unstale":"2023-12-19T05:38:59.090635+0000","last_undegraded":"2023-12-19T05:38:59.090635+0000","last_fullsized":"2023-12-19T05:38:59.090635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:15:29.859453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581817+0000","last_change":"2023-12-19T05:38:57.748708+0000","last_active":"2023-12-19T05:38:59.581817+0000","last_peered":"2023-12-19T05:38:59.581817+0000","last_clean":"2023-12-19T05:38:59.581817+0000","last_became_active":"2023-12-19T05:38:57.748432+0000","last_became_peered":"2023-12-19T05:38:57.748432+0000","last_unstale":"2023-12-19T05:38:59.581817+0000","last_undegraded":"2023-12-19T05:38:59.581817+0000","last_fullsized":"2023-12-19T05:38:59.581817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:30:06.235940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.089691+0000","last_change":"2023-12-19T05:38:58.093836+0000","last_active":"2023-12-19T05:38:59.089691+0000","last_peered":"2023-12-19T05:38:59.089691+0000","last_clean":"2023-12-19T05:38:59.089691+0000","last_became_active":"2023-12-19T05:38:58.093559+0000","last_became_peered":"2023-12-19T05:38:58.093559+0000","last_unstale":"2023-12-19T05:38:59.089691+0000","last_undegraded":"2023-12-19T05:38:59.089691+0000","last_fullsized":"2023-12-19T05:38:59.089691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:04:17.113504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581656+0000","last_change":"2023-12-19T05:38:58.104146+0000","last_active":"2023-12-19T05:38:59.581656+0000","last_peered":"2023-12-19T05:38:59.581656+0000","last_clean":"2023-12-19T05:38:59.581656+0000","last_became_active":"2023-12-19T05:38:58.102734+0000","last_became_peered":"2023-12-19T05:38:58.102734+0000","last_unstale":"2023-12-19T05:38:59.581656+0000","last_undegraded":"2023-12-19T05:38:59.581656+0000","last_fullsized":"2023-12-19T05:38:59.581656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581673+0000","last_change":"2023-12-19T05:38:57.750833+0000","last_active":"2023-12-19T05:38:59.581673+0000","last_peered":"2023-12-19T05:38:59.581673+0000","last_clean":"2023-12-19T05:38:59.581673+0000","last_became_active":"2023-12-19T05:38:57.750555+0000","last_became_peered":"2023-12-19T05:38:57.750555+0000","last_unstale":"2023-12-19T05:38:59.581673+0000","last_undegraded":"2023-12-19T05:38:59.581673+0000","last_fullsized":"2023-12-19T05:38:59.581673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:16:15.966316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581801+0000","last_change":"2023-12-19T05:38:58.103122+0000","last_active":"2023-12-19T05:38:59.581801+0000","last_peered":"2023-12-19T05:38:59.581801+0000","last_clean":"2023-12-19T05:38:59.581801+0000","last_became_active":"2023-12-19T05:38:58.102705+0000","last_became_peered":"2023-12-19T05:38:58.102705+0000","last_unstale":"2023-12-19T05:38:59.581801+0000","last_undegraded":"2023-12-19T05:38:59.581801+0000","last_fullsized":"2023-12-19T05:38:59.581801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:35.666778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581950+0000","last_change":"2023-12-19T05:38:57.750383+0000","last_active":"2023-12-19T05:38:59.581950+0000","last_peered":"2023-12-19T05:38:59.581950+0000","last_clean":"2023-12-19T05:38:59.581950+0000","last_became_active":"2023-12-19T05:38:57.750076+0000","last_became_peered":"2023-12-19T05:38:57.750076+0000","last_unstale":"2023-12-19T05:38:59.581950+0000","last_undegraded":"2023-12-19T05:38:59.581950+0000","last_fullsized":"2023-12-19T05:38:59.581950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:30:30.273362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581472+0000","last_change":"2023-12-19T05:38:58.099053+0000","last_active":"2023-12-19T05:38:59.581472+0000","last_peered":"2023-12-19T05:38:59.581472+0000","last_clean":"2023-12-19T05:38:59.581472+0000","last_became_active":"2023-12-19T05:38:58.098823+0000","last_became_peered":"2023-12-19T05:38:58.098823+0000","last_unstale":"2023-12-19T05:38:59.581472+0000","last_undegraded":"2023-12-19T05:38:59.581472+0000","last_fullsized":"2023-12-19T05:38:59.581472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:24:35.422009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090815+0000","last_change":"2023-12-19T05:38:57.750220+0000","last_active":"2023-12-19T05:38:59.090815+0000","last_peered":"2023-12-19T05:38:59.090815+0000","last_clean":"2023-12-19T05:38:59.090815+0000","last_became_active":"2023-12-19T05:38:57.749929+0000","last_became_peered":"2023-12-19T05:38:57.749929+0000","last_unstale":"2023-12-19T05:38:59.090815+0000","last_undegraded":"2023-12-19T05:38:59.090815+0000","last_fullsized":"2023-12-19T05:38:59.090815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:12:26.203081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.090707+0000","last_change":"2023-12-19T05:38:58.101262+0000","last_active":"2023-12-19T05:38:59.090707+0000","last_peered":"2023-12-19T05:38:59.090707+0000","last_clean":"2023-12-19T05:38:59.090707+0000","last_became_active":"2023-12-19T05:38:58.100440+0000","last_became_peered":"2023-12-19T05:38:58.100440+0000","last_unstale":"2023-12-19T05:38:59.090707+0000","last_undegraded":"2023-12-19T05:38:59.090707+0000","last_fullsized":"2023-12-19T05:38:59.090707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:57.726959+0000","last_clean_scrub_stamp":"2023-12-19T05:38:57.726959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:21:43.441249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T05:38:59.581530+0000","last_change":"2023-12-19T05:38:57.748866+0000","last_active":"2023-12-19T05:38:59.581530+0000","last_peered":"2023-12-19T05:38:59.581530+0000","last_clean":"2023-12-19T05:38:59.581530+0000","last_became_active":"2023-12-19T05:38:57.748578+0000","last_became_peered":"2023-12-19T05:38:57.748578+0000","last_unstale":"2023-12-19T05:38:59.581530+0000","last_undegraded":"2023-12-19T05:38:59.581530+0000","last_fullsized":"2023-12-19T05:38:59.581530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:56.722605+0000","last_clean_scrub_stamp":"2023-12-19T05:38:56.722605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:50:57.497721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27736,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344104,"statfs":{"total":96636764160,"available":96608362496,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":69969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27164,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344676,"statfs":{"total":96636764160,"available":96608948224,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21199999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27160,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344680,"statfs":{"total":96636764160,"available":96608952320,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":806912,"data_stored":660885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T05:39:06.248 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T05:39:06.248 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-19T05:39:06.248 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-19T05:39:06.248 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-19T05:39:06.382 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.380+0000 7f39f7610640 1 Processor -- start 2023-12-19T05:39:06.382 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.381+0000 7f39f7610640 1 -- start start 2023-12-19T05:39:06.384 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.381+0000 7f39f7610640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f39f00b79b0 0x7f39f00b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.381+0000 7f39f7610640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f39f014b230 0x7f39f014b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.381+0000 7f39f7610640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f00b96b0 con 0x7f39f00b8860 2023-12-19T05:39:06.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.381+0000 7f39f7610640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f014ae10 con 0x7f39f00b79b0 2023-12-19T05:39:06.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.381+0000 7f39f7610640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f00bacc0 con 0x7f39f014b230 2023-12-19T05:39:06.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.381+0000 7f39f53ac640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f39f00b79b0 0x7f39f00b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.381+0000 7f39f4bab640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f39f00b8860 0x7f39f0144ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49728/0 (socket says 172.21.15.120:49728) 2023-12-19T05:39:06.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.381+0000 7f39f4bab640 1 -- 172.21.15.120:0/1801315493 learned_addr learned my addr 172.21.15.120:0/1801315493 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:06.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.382+0000 7f39f5bad640 1 --2- 172.21.15.120:0/1801315493 >> v2:172.21.15.155:3300/0 conn(0x7f39f014b230 0x7f39f014b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.382+0000 7f39f53ac640 1 -- 172.21.15.120:0/1801315493 >> v2:172.21.15.155:3300/0 conn(0x7f39f014b230 msgr2=0x7f39f014b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:06.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.382+0000 7f39f53ac640 1 --2- 172.21.15.120:0/1801315493 >> v2:172.21.15.155:3300/0 conn(0x7f39f014b230 0x7f39f014b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.382+0000 7f39f53ac640 1 -- 172.21.15.120:0/1801315493 >> v1:172.21.15.120:6789/0 conn(0x7f39f00b8860 legacy=0x7f39f0144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.382+0000 7f39f53ac640 1 -- 172.21.15.120:0/1801315493 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f00b90f0 con 0x7f39f00b79b0 2023-12-19T05:39:06.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.382+0000 7f39e3fff640 1 -- 172.21.15.120:0/1801315493 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555529998 0 0) 0x7f39f00b96b0 con 0x7f39f00b8860 2023-12-19T05:39:06.386 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.382+0000 7f39f5bad640 1 --2- 172.21.15.120:0/1801315493 >> v2:172.21.15.155:3300/0 conn(0x7f39f014b230 0x7f39f014b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:06.386 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.382+0000 7f39f53ac640 1 --2- 172.21.15.120:0/1801315493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f00b79b0 0x7f39f00b7d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f39f00bde20 tx=0x7f39e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fb6cc80d598c1a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.386 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.383+0000 7f39e3fff640 1 -- 172.21.15.120:0/1801315493 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4031830 con 0x7f39f00b79b0 2023-12-19T05:39:06.386 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.383+0000 7f39e3fff640 1 -- 172.21.15.120:0/1801315493 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e4031990 con 0x7f39f00b79b0 2023-12-19T05:39:06.386 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.383+0000 7f39e3fff640 1 -- 172.21.15.120:0/1801315493 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4031d20 con 0x7f39f00b79b0 2023-12-19T05:39:06.386 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.383+0000 7f39f7610640 1 -- 172.21.15.120:0/1801315493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f00b79b0 msgr2=0x7f39f00b7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.386 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.383+0000 7f39f7610640 1 --2- 172.21.15.120:0/1801315493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f00b79b0 0x7f39f00b7d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f39f00bde20 tx=0x7f39e402b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.386 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.383+0000 7f39f7610640 1 -- 172.21.15.120:0/1801315493 shutdown_connections 2023-12-19T05:39:06.386 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.383+0000 7f39f7610640 1 --2- 172.21.15.120:0/1801315493 >> v2:172.21.15.155:3300/0 conn(0x7f39f014b230 0x7f39f014b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.386 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.383+0000 7f39f7610640 1 --2- 172.21.15.120:0/1801315493 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f00b79b0 0x7f39f00b7d90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.386 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.383+0000 7f39f7610640 1 -- 172.21.15.120:0/1801315493 >> 172.21.15.120:0/1801315493 conn(0x7f39f00c0340 msgr2=0x7f39f00c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:06.386 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.383+0000 7f39f7610640 1 -- 172.21.15.120:0/1801315493 shutdown_connections 2023-12-19T05:39:06.386 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.383+0000 7f39f7610640 1 -- 172.21.15.120:0/1801315493 wait complete. 2023-12-19T05:39:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.384+0000 7f39f7610640 1 Processor -- start 2023-12-19T05:39:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.384+0000 7f39f7610640 1 -- start start 2023-12-19T05:39:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f7610640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f00b79b0 0x7f39f01e2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f7610640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39f00b8860 0x7f39f01e1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f7610640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39f014b230 0x7f39f01e1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f7610640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f01e1370 con 0x7f39f00b79b0 2023-12-19T05:39:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f7610640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f01e34c0 con 0x7f39f014b230 2023-12-19T05:39:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f7610640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f01e2b40 con 0x7f39f00b8860 2023-12-19T05:39:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f53ac640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f00b79b0 0x7f39f01e2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f53ac640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f00b79b0 0x7f39f01e2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45468/0 (socket says 172.21.15.120:45468) 2023-12-19T05:39:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f53ac640 1 -- 172.21.15.120:0/4047353007 learned_addr learned my addr 172.21.15.120:0/4047353007 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f4bab640 1 --2- 172.21.15.120:0/4047353007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39f00b8860 0x7f39f01e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f5bad640 1 --2- 172.21.15.120:0/4047353007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39f014b230 0x7f39f01e1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f53ac640 1 -- 172.21.15.120:0/4047353007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39f00b8860 msgr2=0x7f39f01e1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f53ac640 1 --2- 172.21.15.120:0/4047353007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39f00b8860 0x7f39f01e1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f53ac640 1 -- 172.21.15.120:0/4047353007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39f014b230 msgr2=0x7f39f01e1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f53ac640 1 --2- 172.21.15.120:0/4047353007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39f014b230 0x7f39f01e1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f53ac640 1 -- 172.21.15.120:0/4047353007 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e4009400 con 0x7f39f00b79b0 2023-12-19T05:39:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f53ac640 1 --2- 172.21.15.120:0/4047353007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f00b79b0 0x7f39f01e2f80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f39e4000c00 tx=0x7f39e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39e1ffb640 1 -- 172.21.15.120:0/4047353007 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e403aa60 con 0x7f39f00b79b0 2023-12-19T05:39:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39e1ffb640 1 -- 172.21.15.120:0/4047353007 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e403abe0 con 0x7f39f00b79b0 2023-12-19T05:39:06.390 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39f7610640 1 -- 172.21.15.120:0/4047353007 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f009def0 con 0x7f39f00b79b0 2023-12-19T05:39:06.391 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.385+0000 7f39e1ffb640 1 -- 172.21.15.120:0/4047353007 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e40443f0 con 0x7f39f00b79b0 2023-12-19T05:39:06.391 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.386+0000 7f39f7610640 1 -- 172.21.15.120:0/4047353007 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f01e0f90 con 0x7f39f00b79b0 2023-12-19T05:39:06.391 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.387+0000 7f39f7610640 1 -- 172.21.15.120:0/4047353007 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f01e15e0 con 0x7f39f00b79b0 2023-12-19T05:39:06.391 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.387+0000 7f39e1ffb640 1 -- 172.21.15.120:0/4047353007 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f39e404d450 con 0x7f39f00b79b0 2023-12-19T05:39:06.391 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.387+0000 7f39e1ffb640 1 --2- 172.21.15.120:0/4047353007 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f39d406a430 0x7f39d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.391 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.387+0000 7f39e1ffb640 1 -- 172.21.15.120:0/4047353007 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39e40aab20 con 0x7f39f00b79b0 2023-12-19T05:39:06.391 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.387+0000 7f39f4bab640 1 --2- 172.21.15.120:0/4047353007 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f39d406a430 0x7f39d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.391 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.388+0000 7f39f4bab640 1 --2- 172.21.15.120:0/4047353007 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f39d406a430 0x7f39d406c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f39f014aae0 tx=0x7f39ec007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.392 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.391+0000 7f39e1ffb640 1 -- 172.21.15.120:0/4047353007 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f39e4076230 con 0x7f39f00b79b0 2023-12-19T05:39:06.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.594+0000 7f39f7610640 1 -- 172.21.15.120:0/4047353007 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f39f004e080 con 0x7f39f00b79b0 2023-12-19T05:39:06.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.595+0000 7f39e1ffb640 1 -- 172.21.15.120:0/4047353007 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f39e4035020 con 0x7f39f00b79b0 2023-12-19T05:39:06.596 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:06.596 INFO:teuthology.orchestra.run.smithi120.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-19T05:39:06.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.596+0000 7f39f7610640 1 -- 172.21.15.120:0/4047353007 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f39d406a430 msgr2=0x7f39d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.597+0000 7f39f7610640 1 --2- 172.21.15.120:0/4047353007 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f39d406a430 0x7f39d406c8f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f39f014aae0 tx=0x7f39ec007b50 comp rx=0 tx=0).stop 2023-12-19T05:39:06.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.597+0000 7f39f7610640 1 -- 172.21.15.120:0/4047353007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f00b79b0 msgr2=0x7f39f01e2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.597+0000 7f39f7610640 1 --2- 172.21.15.120:0/4047353007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f00b79b0 0x7f39f01e2f80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f39e4000c00 tx=0x7f39e40046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.597+0000 7f39f7610640 1 -- 172.21.15.120:0/4047353007 shutdown_connections 2023-12-19T05:39:06.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.597+0000 7f39f7610640 1 --2- 172.21.15.120:0/4047353007 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f39d406a430 0x7f39d406c8f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.597+0000 7f39f7610640 1 --2- 172.21.15.120:0/4047353007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39f014b230 0x7f39f01e1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.597+0000 7f39f7610640 1 --2- 172.21.15.120:0/4047353007 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f39f00b8860 0x7f39f01e1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.597+0000 7f39f7610640 1 --2- 172.21.15.120:0/4047353007 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39f00b79b0 0x7f39f01e2f80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.597+0000 7f39f7610640 1 -- 172.21.15.120:0/4047353007 >> 172.21.15.120:0/4047353007 conn(0x7f39f00c0340 msgr2=0x7f39f00bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:06.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.597+0000 7f39f7610640 1 -- 172.21.15.120:0/4047353007 shutdown_connections 2023-12-19T05:39:06.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.597+0000 7f39f7610640 1 -- 172.21.15.120:0/4047353007 wait complete. 2023-12-19T05:39:06.608 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-19T05:39:06.608 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:06.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.706+0000 7efcbb8ad640 1 Processor -- start 2023-12-19T05:39:06.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.706+0000 7efcbb8ad640 1 -- start start 2023-12-19T05:39:06.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcbb8ad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb40b7d90 0x7efcb4144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcbb8ad640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb40b96b0 con 0x7efcb4145010 2023-12-19T05:39:06.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcbb8ad640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb40b81d0 con 0x7efcb40b79b0 2023-12-19T05:39:06.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcbb8ad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb414ae10 con 0x7efcb40b7d90 2023-12-19T05:39:06.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcb9e4a640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7efcb4145010 0x7efcb414b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49740/0 (socket says 172.21.15.120:49740) 2023-12-19T05:39:06.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcb9e4a640 1 -- 172.21.15.120:0/2384032920 learned_addr learned my addr 172.21.15.120:0/2384032920 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:06.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcabfff640 1 -- 172.21.15.120:0/2384032920 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105270018 0 0) 0x7efcb40b96b0 con 0x7efcb4145010 2023-12-19T05:39:06.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcabfff640 1 -- 172.21.15.120:0/2384032920 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efca0003520 con 0x7efcb4145010 2023-12-19T05:39:06.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcb8e48640 1 --2- 172.21.15.120:0/2384032920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb40b7d90 0x7efcb4144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.711 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcabfff640 1 -- 172.21.15.120:0/2384032920 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 414350236 0 0) 0x7efca0003520 con 0x7efcb4145010 2023-12-19T05:39:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcabfff640 1 -- 172.21.15.120:0/2384032920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb40b7d90 msgr2=0x7efcb4144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcabfff640 1 --2- 172.21.15.120:0/2384032920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb40b7d90 0x7efcb4144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcabfff640 1 -- 172.21.15.120:0/2384032920 >> v1:172.21.15.155:6789/0 conn(0x7efcb40b79b0 legacy=0x7efcb40b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcabfff640 1 -- 172.21.15.120:0/2384032920 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb40b90f0 con 0x7efcb4145010 2023-12-19T05:39:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcabfff640 1 -- 172.21.15.120:0/2384032920 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7efcac0019f0 con 0x7efcb4145010 2023-12-19T05:39:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcabfff640 1 -- 172.21.15.120:0/2384032920 >> v1:172.21.15.120:6789/0 conn(0x7efcb4145010 legacy=0x7efcb414b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcabfff640 1 --2- 172.21.15.120:0/2384032920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb40b7d90 0x7efca00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.707+0000 7efcabfff640 1 --2- 172.21.15.120:0/2384032920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca0003f20 0x7efca00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.708+0000 7efcabfff640 1 --2- 172.21.15.120:0/2384032920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efca0004d00 0x7efca0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.708+0000 7efcabfff640 1 -- 172.21.15.120:0/2384032920 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb414ae10 con 0x7efca0003f20 2023-12-19T05:39:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.708+0000 7efcabfff640 1 -- 172.21.15.120:0/2384032920 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca000ba60 con 0x7efca0004d00 2023-12-19T05:39:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.708+0000 7efcabfff640 1 -- 172.21.15.120:0/2384032920 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca000bc20 con 0x7efcb40b7d90 2023-12-19T05:39:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.708+0000 7efcb8e48640 1 --2- 172.21.15.120:0/2384032920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca0003f20 0x7efca00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.708+0000 7efcb9649640 1 --2- 172.21.15.120:0/2384032920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb40b7d90 0x7efca00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.708+0000 7efcb9e4a640 1 --2- 172.21.15.120:0/2384032920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efca0004d00 0x7efca0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.708+0000 7efcb8e48640 1 -- 172.21.15.120:0/2384032920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb40b7d90 msgr2=0x7efca00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:06.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.708+0000 7efcb8e48640 1 --2- 172.21.15.120:0/2384032920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb40b7d90 0x7efca00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.708+0000 7efcb8e48640 1 -- 172.21.15.120:0/2384032920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efca0004d00 msgr2=0x7efca0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:06.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.708+0000 7efcb8e48640 1 --2- 172.21.15.120:0/2384032920 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efca0004d00 0x7efca0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.708+0000 7efcb8e48640 1 -- 172.21.15.120:0/2384032920 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca0003520 con 0x7efca0003f20 2023-12-19T05:39:06.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.708+0000 7efcb9649640 1 --2- 172.21.15.120:0/2384032920 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb40b7d90 0x7efca00039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:06.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.709+0000 7efcb8e48640 1 --2- 172.21.15.120:0/2384032920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca0003f20 0x7efca00047c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efca4009ac0 tx=0x7efca00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97d4db5bcff6411 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.709+0000 7efcabfff640 1 -- 172.21.15.120:0/2384032920 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca402c6b0 con 0x7efca0003f20 2023-12-19T05:39:06.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.709+0000 7efcabfff640 1 -- 172.21.15.120:0/2384032920 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca402c810 con 0x7efca0003f20 2023-12-19T05:39:06.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.709+0000 7efcabfff640 1 -- 172.21.15.120:0/2384032920 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca402cba0 con 0x7efca0003f20 2023-12-19T05:39:06.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.709+0000 7efcbb8ad640 1 -- 172.21.15.120:0/2384032920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca0003f20 msgr2=0x7efca00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.709+0000 7efcbb8ad640 1 --2- 172.21.15.120:0/2384032920 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca0003f20 0x7efca00047c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efca4009ac0 tx=0x7efca00057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.709+0000 7efcb9e4a640 1 -- 172.21.15.120:0/2384032920 reap_dead start 2023-12-19T05:39:06.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.709+0000 7efcbb8ad640 1 -- 172.21.15.120:0/2384032920 shutdown_connections 2023-12-19T05:39:06.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.709+0000 7efcbb8ad640 1 -- 172.21.15.120:0/2384032920 >> 172.21.15.120:0/2384032920 conn(0x7efcb40c0340 msgr2=0x7efcb40c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:06.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.709+0000 7efcbb8ad640 1 -- 172.21.15.120:0/2384032920 shutdown_connections 2023-12-19T05:39:06.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.709+0000 7efcbb8ad640 1 -- 172.21.15.120:0/2384032920 wait complete. 2023-12-19T05:39:06.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.710+0000 7efcbb8ad640 1 Processor -- start 2023-12-19T05:39:06.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.710+0000 7efcbb8ad640 1 -- start start 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcbb8ad640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca0003f20 0x7efcb4148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcbb8ad640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb41e3020 0x7efcb41d45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcbb8ad640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb41d4b20 0x7efcb40b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcbb8ad640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb414a580 con 0x7efca0003f20 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcbb8ad640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb41485b0 con 0x7efcb41d4b20 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcbb8ad640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb41d52d0 con 0x7efcb41e3020 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcb9649640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca0003f20 0x7efcb4148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcb9649640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca0003f20 0x7efcb4148070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45484/0 (socket says 172.21.15.120:45484) 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcb9649640 1 -- 172.21.15.120:0/705464124 learned_addr learned my addr 172.21.15.120:0/705464124 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:06.718 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcb9e4a640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb41d4b20 0x7efcb40b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcb8e48640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb41e3020 0x7efcb41d45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcb9649640 1 -- 172.21.15.120:0/705464124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb41e3020 msgr2=0x7efcb41d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcb9649640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb41e3020 0x7efcb41d45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcb9649640 1 -- 172.21.15.120:0/705464124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb41d4b20 msgr2=0x7efcb40b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcb9649640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb41d4b20 0x7efcb40b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcb9649640 1 -- 172.21.15.120:0/705464124 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb41d0d20 con 0x7efca0003f20 2023-12-19T05:39:06.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcb9e4a640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb41d4b20 0x7efcb40b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:06.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efcb9649640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca0003f20 0x7efcb4148070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efcb000e630 tx=0x7efcb000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.711+0000 7efca9ffb640 1 -- 172.21.15.120:0/705464124 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb00052e0 con 0x7efca0003f20 2023-12-19T05:39:06.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.712+0000 7efca9ffb640 1 -- 172.21.15.120:0/705464124 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb0005440 con 0x7efca0003f20 2023-12-19T05:39:06.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.712+0000 7efcbb8ad640 1 -- 172.21.15.120:0/705464124 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb41d1000 con 0x7efca0003f20 2023-12-19T05:39:06.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.712+0000 7efca9ffb640 1 -- 172.21.15.120:0/705464124 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0003810 con 0x7efca0003f20 2023-12-19T05:39:06.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.712+0000 7efcbb8ad640 1 -- 172.21.15.120:0/705464124 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb41d4fa0 con 0x7efca0003f20 2023-12-19T05:39:06.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.713+0000 7efcbb8ad640 1 -- 172.21.15.120:0/705464124 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb41d0b80 con 0x7efca0003f20 2023-12-19T05:39:06.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.713+0000 7efca9ffb640 1 -- 172.21.15.120:0/705464124 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efcb0003970 con 0x7efca0003f20 2023-12-19T05:39:06.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.713+0000 7efca9ffb640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efc9806a430 0x7efc9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:06.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.714+0000 7efca9ffb640 1 -- 172.21.15.120:0/705464124 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcb0088770 con 0x7efca0003f20 2023-12-19T05:39:06.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.714+0000 7efcb8e48640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efc9806a430 0x7efc9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:06.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.714+0000 7efcb8e48640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efc9806a430 0x7efc9806c8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efca4036000 tx=0x7efca4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:06.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.718+0000 7efca9ffb640 1 -- 172.21.15.120:0/705464124 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efcb41d0b80 con 0x7efca0003f20 2023-12-19T05:39:06.888 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.887+0000 7efcbb8ad640 1 -- 172.21.15.120:0/705464124 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcb41d0b80 con 0x7efca0003f20 2023-12-19T05:39:06.889 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.888+0000 7efca9ffb640 1 -- 172.21.15.120:0/705464124 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7efcb41d0b80 con 0x7efca0003f20 2023-12-19T05:39:06.889 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:06.889 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:06.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.890+0000 7efcbb8ad640 1 -- 172.21.15.120:0/705464124 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efc9806a430 msgr2=0x7efc9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.890+0000 7efcbb8ad640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efc9806a430 0x7efc9806c8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efca4036000 tx=0x7efca4030000 comp rx=0 tx=0).stop 2023-12-19T05:39:06.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.890+0000 7efcbb8ad640 1 -- 172.21.15.120:0/705464124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca0003f20 msgr2=0x7efcb4148070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:06.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.890+0000 7efcbb8ad640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca0003f20 0x7efcb4148070 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efcb000e630 tx=0x7efcb000eaf0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.890+0000 7efcbb8ad640 1 -- 172.21.15.120:0/705464124 shutdown_connections 2023-12-19T05:39:06.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.890+0000 7efcbb8ad640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efc9806a430 0x7efc9806c8f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.890+0000 7efcbb8ad640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efcb41d4b20 0x7efcb40b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.890+0000 7efcbb8ad640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efcb41e3020 0x7efcb41d45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.890+0000 7efcbb8ad640 1 --2- 172.21.15.120:0/705464124 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efca0003f20 0x7efcb4148070 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:06.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.890+0000 7efcbb8ad640 1 -- 172.21.15.120:0/705464124 >> 172.21.15.120:0/705464124 conn(0x7efcb40c0340 msgr2=0x7efcb41490c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:06.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.890+0000 7efcbb8ad640 1 -- 172.21.15.120:0/705464124 shutdown_connections 2023-12-19T05:39:06.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:06.890+0000 7efcbb8ad640 1 -- 172.21.15.120:0/705464124 wait complete. 2023-12-19T05:39:06.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:45.976868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:38:56.035188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:38:57.050130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:06.902 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:07.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.003+0000 7f1270d3e640 1 Processor -- start 2023-12-19T05:39:07.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.003+0000 7f1270d3e640 1 -- start start 2023-12-19T05:39:07.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f1270d3e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f126c070f50 0x7f126c14e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f1270d3e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f126c071330 0x7f126c14e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f1270d3e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f126c071e30 con 0x7f126c0ba0d0 2023-12-19T05:39:07.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f1270d3e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126c06bbf0 con 0x7f126c070f50 2023-12-19T05:39:07.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f1270d3e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c06af40 con 0x7f126c071330 2023-12-19T05:39:07.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f126a59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f126c070f50 0x7f126c14e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f126ad9d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f126c071330 0x7f126c14e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f126a59c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f126c070f50 0x7f126c14e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59842/0 (socket says 172.21.15.120:59842) 2023-12-19T05:39:07.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f1263fff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f126c0ba0d0 0x7f126c14ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:39974/0 (socket says 172.21.15.120:39974) 2023-12-19T05:39:07.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f126a59c640 1 -- 172.21.15.120:0/2700028573 learned_addr learned my addr 172.21.15.120:0/2700028573 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:07.007 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f126ad9d640 1 -- 172.21.15.120:0/2700028573 >> v2:172.21.15.155:3300/0 conn(0x7f126c070f50 msgr2=0x7f126c14e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:07.007 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f126ad9d640 1 --2- 172.21.15.120:0/2700028573 >> v2:172.21.15.155:3300/0 conn(0x7f126c070f50 0x7f126c14e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f126ad9d640 1 -- 172.21.15.120:0/2700028573 >> v1:172.21.15.155:6789/0 conn(0x7f126c0ba0d0 legacy=0x7f126c14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f126ad9d640 1 -- 172.21.15.120:0/2700028573 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c06b220 con 0x7f126c071330 2023-12-19T05:39:07.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.004+0000 7f126a59c640 1 --2- 172.21.15.120:0/2700028573 >> v2:172.21.15.155:3300/0 conn(0x7f126c070f50 0x7f126c14e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:07.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.005+0000 7f126ad9d640 1 --2- 172.21.15.120:0/2700028573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f126c071330 0x7f126c14e650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1264009d90 tx=0x7f126402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=258a921b42d2b69c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.005+0000 7f1269d9b640 1 -- 172.21.15.120:0/2700028573 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126402cbc0 con 0x7f126c071330 2023-12-19T05:39:07.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.005+0000 7f1269d9b640 1 -- 172.21.15.120:0/2700028573 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126402cd20 con 0x7f126c071330 2023-12-19T05:39:07.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.005+0000 7f1269d9b640 1 -- 172.21.15.120:0/2700028573 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1264034660 con 0x7f126c071330 2023-12-19T05:39:07.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.006+0000 7f1270d3e640 1 -- 172.21.15.120:0/2700028573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f126c071330 msgr2=0x7f126c14e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.006+0000 7f1270d3e640 1 --2- 172.21.15.120:0/2700028573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f126c071330 0x7f126c14e650 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1264009d90 tx=0x7f126402be10 comp rx=0 tx=0).stop 2023-12-19T05:39:07.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.006+0000 7f1270d3e640 1 -- 172.21.15.120:0/2700028573 shutdown_connections 2023-12-19T05:39:07.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.006+0000 7f1270d3e640 1 --2- 172.21.15.120:0/2700028573 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f126c071330 0x7f126c14e650 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.006+0000 7f1270d3e640 1 --2- 172.21.15.120:0/2700028573 >> v2:172.21.15.155:3300/0 conn(0x7f126c070f50 0x7f126c14e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.006+0000 7f1270d3e640 1 -- 172.21.15.120:0/2700028573 >> 172.21.15.120:0/2700028573 conn(0x7f126c0be180 msgr2=0x7f126c0be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:07.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.006+0000 7f1270d3e640 1 -- 172.21.15.120:0/2700028573 shutdown_connections 2023-12-19T05:39:07.009 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.006+0000 7f1270d3e640 1 -- 172.21.15.120:0/2700028573 wait complete. 2023-12-19T05:39:07.010 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.007+0000 7f1270d3e640 1 Processor -- start 2023-12-19T05:39:07.011 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.007+0000 7f1270d3e640 1 -- start start 2023-12-19T05:39:07.011 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1270d3e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f126c070f50 0x7f126c14d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.011 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1270d3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c071330 0x7f126c1d7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.011 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1270d3e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f126c0ba0d0 0x7f126c1e3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.011 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1270d3e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c14d610 con 0x7f126c071330 2023-12-19T05:39:07.011 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1270d3e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c1d6b10 con 0x7f126c0ba0d0 2023-12-19T05:39:07.011 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1270d3e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126c1d7ad0 con 0x7f126c070f50 2023-12-19T05:39:07.011 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1263fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c071330 0x7f126c1d7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.011 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1263fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c071330 0x7f126c1d7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45490/0 (socket says 172.21.15.120:45490) 2023-12-19T05:39:07.011 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1263fff640 1 -- 172.21.15.120:0/2848100511 learned_addr learned my addr 172.21.15.120:0/2848100511 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:07.011 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f126a59c640 1 --2- 172.21.15.120:0/2848100511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f126c070f50 0x7f126c14d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.011 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f126ad9d640 1 --2- 172.21.15.120:0/2848100511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f126c0ba0d0 0x7f126c1e3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.011 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1263fff640 1 -- 172.21.15.120:0/2848100511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f126c070f50 msgr2=0x7f126c14d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.012 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1263fff640 1 --2- 172.21.15.120:0/2848100511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f126c070f50 0x7f126c14d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.012 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1263fff640 1 -- 172.21.15.120:0/2848100511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f126c0ba0d0 msgr2=0x7f126c1e3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.012 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1263fff640 1 --2- 172.21.15.120:0/2848100511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f126c0ba0d0 0x7f126c1e3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.012 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1263fff640 1 -- 172.21.15.120:0/2848100511 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c0094d0 con 0x7f126c071330 2023-12-19T05:39:07.012 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1263fff640 1 --2- 172.21.15.120:0/2848100511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c071330 0x7f126c1d7100 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f125400c3e0 tx=0x7f125400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.012 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1262ffd640 1 -- 172.21.15.120:0/2848100511 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540074e0 con 0x7f126c071330 2023-12-19T05:39:07.012 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1262ffd640 1 -- 172.21.15.120:0/2848100511 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1254007640 con 0x7f126c071330 2023-12-19T05:39:07.012 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1270d3e640 1 -- 172.21.15.120:0/2848100511 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1264009a70 con 0x7f126c071330 2023-12-19T05:39:07.012 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1262ffd640 1 -- 172.21.15.120:0/2848100511 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540049e0 con 0x7f126c071330 2023-12-19T05:39:07.012 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.008+0000 7f1270d3e640 1 -- 172.21.15.120:0/2848100511 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c1d6030 con 0x7f126c071330 2023-12-19T05:39:07.012 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.009+0000 7f1270d3e640 1 -- 172.21.15.120:0/2848100511 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c04e080 con 0x7f126c071330 2023-12-19T05:39:07.012 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.010+0000 7f1262ffd640 1 -- 172.21.15.120:0/2848100511 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1254004b40 con 0x7f126c071330 2023-12-19T05:39:07.013 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.010+0000 7f1262ffd640 1 --2- 172.21.15.120:0/2848100511 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f124c06a430 0x7f124c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.013 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.010+0000 7f126a59c640 1 --2- 172.21.15.120:0/2848100511 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f124c06a430 0x7f124c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.013 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.010+0000 7f1262ffd640 1 -- 172.21.15.120:0/2848100511 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12540880e0 con 0x7f126c071330 2023-12-19T05:39:07.013 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.011+0000 7f126a59c640 1 --2- 172.21.15.120:0/2848100511 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f124c06a430 0x7f124c06c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f125c006ca0 tx=0x7f125c009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.015+0000 7f1262ffd640 1 -- 172.21.15.120:0/2848100511 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1254053810 con 0x7f126c071330 2023-12-19T05:39:07.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.181+0000 7f1270d3e640 1 -- 172.21.15.120:0/2848100511 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f126c0bf020 con 0x7f126c071330 2023-12-19T05:39:07.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.181+0000 7f1262ffd640 1 -- 172.21.15.120:0/2848100511 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1254056e30 con 0x7f126c071330 2023-12-19T05:39:07.183 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2023-12-19T05:39:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.183+0000 7f1270d3e640 1 -- 172.21.15.120:0/2848100511 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f124c06a430 msgr2=0x7f124c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.183+0000 7f1270d3e640 1 --2- 172.21.15.120:0/2848100511 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f124c06a430 0x7f124c06c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f125c006ca0 tx=0x7f125c009240 comp rx=0 tx=0).stop 2023-12-19T05:39:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.183+0000 7f1270d3e640 1 -- 172.21.15.120:0/2848100511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c071330 msgr2=0x7f126c1d7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.183+0000 7f1270d3e640 1 --2- 172.21.15.120:0/2848100511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c071330 0x7f126c1d7100 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f125400c3e0 tx=0x7f125400c8a0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.183+0000 7f1270d3e640 1 -- 172.21.15.120:0/2848100511 shutdown_connections 2023-12-19T05:39:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.183+0000 7f1270d3e640 1 --2- 172.21.15.120:0/2848100511 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f124c06a430 0x7f124c06c8f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.183+0000 7f1270d3e640 1 --2- 172.21.15.120:0/2848100511 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f126c0ba0d0 0x7f126c1e3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.183+0000 7f1270d3e640 1 --2- 172.21.15.120:0/2848100511 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f126c071330 0x7f126c1d7100 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.183+0000 7f1270d3e640 1 --2- 172.21.15.120:0/2848100511 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f126c070f50 0x7f126c14d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.183+0000 7f1270d3e640 1 -- 172.21.15.120:0/2848100511 >> 172.21.15.120:0/2848100511 conn(0x7f126c0be180 msgr2=0x7f126c0b6490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:07.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.184+0000 7f1270d3e640 1 -- 172.21.15.120:0/2848100511 shutdown_connections 2023-12-19T05:39:07.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.184+0000 7f1270d3e640 1 -- 172.21.15.120:0/2848100511 wait complete. 2023-12-19T05:39:07.196 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:07.297 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.296+0000 7f73a3f88640 1 Processor -- start 2023-12-19T05:39:07.297 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.296+0000 7f73a3f88640 1 -- start start 2023-12-19T05:39:07.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a3f88640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f739c0ba0d0 0x7f739c156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a3f88640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739c071e30 con 0x7f739c070f50 2023-12-19T05:39:07.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a3f88640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f739c06af40 con 0x7f739c14e820 2023-12-19T05:39:07.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a3f88640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f739c06bbf0 con 0x7f739c0ba0d0 2023-12-19T05:39:07.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a1d24640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f739c070f50 0x7f739c14e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49756/0 (socket says 172.21.15.120:49756) 2023-12-19T05:39:07.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a1d24640 1 -- 172.21.15.120:0/619341175 learned_addr learned my addr 172.21.15.120:0/619341175 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:07.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 -- 172.21.15.120:0/619341175 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3190628810 0 0) 0x7f739c071e30 con 0x7f739c070f50 2023-12-19T05:39:07.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 -- 172.21.15.120:0/619341175 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7388003520 con 0x7f739c070f50 2023-12-19T05:39:07.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a2525640 1 --2- 172.21.15.120:0/619341175 >> v2:172.21.15.155:3300/0 conn(0x7f739c0ba0d0 0x7f739c156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 -- 172.21.15.120:0/619341175 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3466040076 0 0) 0x7f7388003520 con 0x7f739c070f50 2023-12-19T05:39:07.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 -- 172.21.15.120:0/619341175 >> v2:172.21.15.155:3300/0 conn(0x7f739c0ba0d0 msgr2=0x7f739c156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:07.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 --2- 172.21.15.120:0/619341175 >> v2:172.21.15.155:3300/0 conn(0x7f739c0ba0d0 0x7f739c156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 -- 172.21.15.120:0/619341175 >> v1:172.21.15.155:6789/0 conn(0x7f739c14e820 legacy=0x7f739c153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 -- 172.21.15.120:0/619341175 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c06b220 con 0x7f739c070f50 2023-12-19T05:39:07.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 -- 172.21.15.120:0/619341175 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f7398001670 con 0x7f739c070f50 2023-12-19T05:39:07.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 -- 172.21.15.120:0/619341175 >> v1:172.21.15.120:6789/0 conn(0x7f739c070f50 legacy=0x7f739c14e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 --2- 172.21.15.120:0/619341175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7388003970 0x7f7388003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 --2- 172.21.15.120:0/619341175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73880047c0 0x7f7388004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 --2- 172.21.15.120:0/619341175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7388005180 0x7f738800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 -- 172.21.15.120:0/619341175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738800c0f0 con 0x7f7388003970 2023-12-19T05:39:07.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 -- 172.21.15.120:0/619341175 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738800c260 con 0x7f73880047c0 2023-12-19T05:39:07.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a0d22640 1 -- 172.21.15.120:0/619341175 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738800c420 con 0x7f7388005180 2023-12-19T05:39:07.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a1d24640 1 --2- 172.21.15.120:0/619341175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7388003970 0x7f7388003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.297+0000 7f73a1523640 1 --2- 172.21.15.120:0/619341175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73880047c0 0x7f7388004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.298+0000 7f73a2525640 1 --2- 172.21.15.120:0/619341175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7388005180 0x7f738800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.298+0000 7f73a1d24640 1 -- 172.21.15.120:0/619341175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7388005180 msgr2=0x7f738800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:07.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.298+0000 7f73a1d24640 1 --2- 172.21.15.120:0/619341175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7388005180 0x7f738800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.298+0000 7f73a1d24640 1 -- 172.21.15.120:0/619341175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73880047c0 msgr2=0x7f7388004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:07.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.298+0000 7f73a1d24640 1 --2- 172.21.15.120:0/619341175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f73880047c0 0x7f7388004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.298+0000 7f73a1d24640 1 -- 172.21.15.120:0/619341175 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388003520 con 0x7f7388003970 2023-12-19T05:39:07.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.298+0000 7f73a2525640 1 --2- 172.21.15.120:0/619341175 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7388005180 0x7f738800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:07.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.298+0000 7f73a2525640 1 -- 172.21.15.120:0/619341175 reap_dead start 2023-12-19T05:39:07.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.298+0000 7f73a1d24640 1 --2- 172.21.15.120:0/619341175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7388003970 0x7f7388003d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f739800c240 tx=0x7f73880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2161b6a726b6e6d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.298+0000 7f73a0d22640 1 -- 172.21.15.120:0/619341175 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398005ad0 con 0x7f7388003970 2023-12-19T05:39:07.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.299+0000 7f73a0d22640 1 -- 172.21.15.120:0/619341175 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7398005c30 con 0x7f7388003970 2023-12-19T05:39:07.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.299+0000 7f73a0d22640 1 -- 172.21.15.120:0/619341175 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739802ca90 con 0x7f7388003970 2023-12-19T05:39:07.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.299+0000 7f73a3f88640 1 -- 172.21.15.120:0/619341175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7388003970 msgr2=0x7f7388003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.299+0000 7f73a3f88640 1 --2- 172.21.15.120:0/619341175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7388003970 0x7f7388003d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f739800c240 tx=0x7f73880057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.299+0000 7f73a3f88640 1 -- 172.21.15.120:0/619341175 shutdown_connections 2023-12-19T05:39:07.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.299+0000 7f73a3f88640 1 --2- 172.21.15.120:0/619341175 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7388003970 0x7f7388003d90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.299+0000 7f73a3f88640 1 -- 172.21.15.120:0/619341175 >> 172.21.15.120:0/619341175 conn(0x7f739c0be180 msgr2=0x7f739c0be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:07.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.299+0000 7f73a3f88640 1 -- 172.21.15.120:0/619341175 shutdown_connections 2023-12-19T05:39:07.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.299+0000 7f73a3f88640 1 -- 172.21.15.120:0/619341175 wait complete. 2023-12-19T05:39:07.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.300+0000 7f73a3f88640 1 Processor -- start 2023-12-19T05:39:07.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.300+0000 7f73a3f88640 1 -- start start 2023-12-19T05:39:07.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a3f88640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7388003970 0x7f739c13db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a3f88640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f739c14d280 0x7f739c0b6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a3f88640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739c0b5480 0x7f739c0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a3f88640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c13c250 con 0x7f739c0b5480 2023-12-19T05:39:07.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a3f88640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c1e3170 con 0x7f739c14d280 2023-12-19T05:39:07.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a3f88640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c13cf40 con 0x7f7388003970 2023-12-19T05:39:07.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a2525640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739c0b5480 0x7f739c0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a2525640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739c0b5480 0x7f739c0b58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45504/0 (socket says 172.21.15.120:45504) 2023-12-19T05:39:07.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a2525640 1 -- 172.21.15.120:0/2757535561 learned_addr learned my addr 172.21.15.120:0/2757535561 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:07.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a1d24640 1 --2- 172.21.15.120:0/2757535561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7388003970 0x7f739c13db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a2525640 1 -- 172.21.15.120:0/2757535561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7388003970 msgr2=0x7f739c13db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a2525640 1 --2- 172.21.15.120:0/2757535561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7388003970 0x7f739c13db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.313 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a1523640 1 --2- 172.21.15.120:0/2757535561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f739c14d280 0x7f739c0b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.313 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a2525640 1 -- 172.21.15.120:0/2757535561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f739c14d280 msgr2=0x7f739c0b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.313 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a2525640 1 --2- 172.21.15.120:0/2757535561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f739c14d280 0x7f739c0b6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.313 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a2525640 1 -- 172.21.15.120:0/2757535561 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c14d700 con 0x7f739c0b5480 2023-12-19T05:39:07.313 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73a2525640 1 --2- 172.21.15.120:0/2757535561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739c0b5480 0x7f739c0b58c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f739c0bbc10 tx=0x7f7394010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.313 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73927fc640 1 -- 172.21.15.120:0/2757535561 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739401b070 con 0x7f739c0b5480 2023-12-19T05:39:07.313 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.301+0000 7f73927fc640 1 -- 172.21.15.120:0/2757535561 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739400f040 con 0x7f739c0b5480 2023-12-19T05:39:07.313 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.302+0000 7f73927fc640 1 -- 172.21.15.120:0/2757535561 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739400e050 con 0x7f739c0b5480 2023-12-19T05:39:07.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.302+0000 7f73a3f88640 1 -- 172.21.15.120:0/2757535561 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f739c13d1b0 con 0x7f739c0b5480 2023-12-19T05:39:07.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.302+0000 7f73a3f88640 1 -- 172.21.15.120:0/2757535561 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739c1e36a0 con 0x7f739c0b5480 2023-12-19T05:39:07.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.302+0000 7f73a3f88640 1 -- 172.21.15.120:0/2757535561 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739c071680 con 0x7f739c0b5480 2023-12-19T05:39:07.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.303+0000 7f73927fc640 1 -- 172.21.15.120:0/2757535561 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7394015440 con 0x7f739c0b5480 2023-12-19T05:39:07.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.303+0000 7f73927fc640 1 --2- 172.21.15.120:0/2757535561 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f738006a430 0x7f738006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.303+0000 7f73927fc640 1 -- 172.21.15.120:0/2757535561 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7394088ab0 con 0x7f739c0b5480 2023-12-19T05:39:07.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.303+0000 7f73a1d24640 1 --2- 172.21.15.120:0/2757535561 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f738006a430 0x7f738006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.304+0000 7f73a1d24640 1 --2- 172.21.15.120:0/2757535561 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f738006a430 0x7f738006c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7398034000 tx=0x7f7398009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.307+0000 7f73927fc640 1 -- 172.21.15.120:0/2757535561 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7394054130 con 0x7f739c0b5480 2023-12-19T05:39:07.477 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.473+0000 7f73a3f88640 1 -- 172.21.15.120:0/2757535561 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f739c1e3bc0 con 0x7f739c0b5480 2023-12-19T05:39:07.477 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.473+0000 7f73927fc640 1 -- 172.21.15.120:0/2757535561 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f739c1e3bc0 con 0x7f739c0b5480 2023-12-19T05:39:07.478 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2023-12-19T05:39:07.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.475+0000 7f73a3f88640 1 -- 172.21.15.120:0/2757535561 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f738006a430 msgr2=0x7f738006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.475+0000 7f73a3f88640 1 --2- 172.21.15.120:0/2757535561 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f738006a430 0x7f738006c8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7398034000 tx=0x7f7398009030 comp rx=0 tx=0).stop 2023-12-19T05:39:07.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.475+0000 7f73a3f88640 1 -- 172.21.15.120:0/2757535561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739c0b5480 msgr2=0x7f739c0b58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.475+0000 7f73a3f88640 1 --2- 172.21.15.120:0/2757535561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739c0b5480 0x7f739c0b58c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f739c0bbc10 tx=0x7f7394010590 comp rx=0 tx=0).stop 2023-12-19T05:39:07.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.475+0000 7f73a3f88640 1 -- 172.21.15.120:0/2757535561 shutdown_connections 2023-12-19T05:39:07.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.475+0000 7f73a3f88640 1 --2- 172.21.15.120:0/2757535561 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f738006a430 0x7f738006c8f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.475+0000 7f73a3f88640 1 --2- 172.21.15.120:0/2757535561 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f739c0b5480 0x7f739c0b58c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.475+0000 7f73a3f88640 1 --2- 172.21.15.120:0/2757535561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f739c14d280 0x7f739c0b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.475+0000 7f73a3f88640 1 --2- 172.21.15.120:0/2757535561 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7388003970 0x7f739c13db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.475+0000 7f73a3f88640 1 -- 172.21.15.120:0/2757535561 >> 172.21.15.120:0/2757535561 conn(0x7f739c0be180 msgr2=0x7f739c0b8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:07.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.475+0000 7f73a3f88640 1 -- 172.21.15.120:0/2757535561 shutdown_connections 2023-12-19T05:39:07.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.475+0000 7f73a3f88640 1 -- 172.21.15.120:0/2757535561 wait complete. 2023-12-19T05:39:07.487 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:07.591 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.589+0000 7f18113d3640 1 Processor -- start 2023-12-19T05:39:07.591 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.589+0000 7f18113d3640 1 -- start start 2023-12-19T05:39:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.590+0000 7f18113d3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f180c069d00 0x7f180c14aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.590+0000 7f18113d3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f180c1533d0 0x7f180c1557c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.590+0000 7f18113d3640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c06ba10 con 0x7f180c0712b0 2023-12-19T05:39:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.590+0000 7f18113d3640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c145270 con 0x7f180c1533d0 2023-12-19T05:39:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.590+0000 7f18113d3640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c0b41f0 con 0x7f180c069d00 2023-12-19T05:39:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.590+0000 7f180b7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f180c1533d0 0x7f180c1557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.590+0000 7f180b7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f180c1533d0 0x7f180c1557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45506/0 (socket says 172.21.15.120:45506) 2023-12-19T05:39:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.590+0000 7f180b7fe640 1 -- 172.21.15.120:0/472352523 learned_addr learned my addr 172.21.15.120:0/472352523 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.590+0000 7f180affd640 1 --2- 172.21.15.120:0/472352523 >> v2:172.21.15.155:3300/0 conn(0x7f180c069d00 0x7f180c14aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.590+0000 7f180b7fe640 1 -- 172.21.15.120:0/472352523 >> v2:172.21.15.155:3300/0 conn(0x7f180c069d00 msgr2=0x7f180c14aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.590+0000 7f180b7fe640 1 --2- 172.21.15.120:0/472352523 >> v2:172.21.15.155:3300/0 conn(0x7f180c069d00 0x7f180c14aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.590+0000 7f180b7fe640 1 -- 172.21.15.120:0/472352523 >> v1:172.21.15.155:6789/0 conn(0x7f180c0712b0 legacy=0x7f180c06a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.590+0000 7f180b7fe640 1 -- 172.21.15.120:0/472352523 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c070e20 con 0x7f180c1533d0 2023-12-19T05:39:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.591+0000 7f180b7fe640 1 --2- 172.21.15.120:0/472352523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f180c1533d0 0x7f180c1557c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f180c0babe0 tx=0x7f180402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f308756f948dcc28 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.591+0000 7f1809ffb640 1 -- 172.21.15.120:0/472352523 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804031870 con 0x7f180c1533d0 2023-12-19T05:39:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.591+0000 7f1809ffb640 1 -- 172.21.15.120:0/472352523 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18040319d0 con 0x7f180c1533d0 2023-12-19T05:39:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.591+0000 7f1809ffb640 1 -- 172.21.15.120:0/472352523 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804031d60 con 0x7f180c1533d0 2023-12-19T05:39:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.592+0000 7f18113d3640 1 -- 172.21.15.120:0/472352523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f180c1533d0 msgr2=0x7f180c1557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.592+0000 7f18113d3640 1 --2- 172.21.15.120:0/472352523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f180c1533d0 0x7f180c1557c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f180c0babe0 tx=0x7f180402b910 comp rx=0 tx=0).stop 2023-12-19T05:39:07.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.592+0000 7f18113d3640 1 -- 172.21.15.120:0/472352523 shutdown_connections 2023-12-19T05:39:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.592+0000 7f18113d3640 1 --2- 172.21.15.120:0/472352523 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f180c1533d0 0x7f180c1557c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.592+0000 7f18113d3640 1 --2- 172.21.15.120:0/472352523 >> v2:172.21.15.155:3300/0 conn(0x7f180c069d00 0x7f180c14aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.592+0000 7f18113d3640 1 -- 172.21.15.120:0/472352523 >> 172.21.15.120:0/472352523 conn(0x7f180c0bd070 msgr2=0x7f180c0bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.592+0000 7f18113d3640 1 -- 172.21.15.120:0/472352523 shutdown_connections 2023-12-19T05:39:07.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.592+0000 7f18113d3640 1 -- 172.21.15.120:0/472352523 wait complete. 2023-12-19T05:39:07.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.593+0000 7f18113d3640 1 Processor -- start 2023-12-19T05:39:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.593+0000 7f18113d3640 1 -- start start 2023-12-19T05:39:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f18113d3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c069d00 0x7f180c13cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f18113d3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f180c0712b0 0x7f180c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f18113d3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f180c1533d0 0x7f180c1dff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f18113d3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c1e04a0 con 0x7f180c1533d0 2023-12-19T05:39:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f18113d3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c13c270 con 0x7f180c069d00 2023-12-19T05:39:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f18113d3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0b5ca0 con 0x7f180c0712b0 2023-12-19T05:39:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f180b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f180c1533d0 0x7f180c1dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f180b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f180c1533d0 0x7f180c1dff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45522/0 (socket says 172.21.15.120:45522) 2023-12-19T05:39:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f180b7fe640 1 -- 172.21.15.120:0/3286946952 learned_addr learned my addr 172.21.15.120:0/3286946952 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f180a7fc640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f180c0712b0 0x7f180c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f180affd640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c069d00 0x7f180c13cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.598 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f180b7fe640 1 -- 172.21.15.120:0/3286946952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f180c0712b0 msgr2=0x7f180c0b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f180b7fe640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f180c0712b0 0x7f180c0b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f180b7fe640 1 -- 172.21.15.120:0/3286946952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c069d00 msgr2=0x7f180c13cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f180b7fe640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c069d00 0x7f180c13cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f180b7fe640 1 -- 172.21.15.120:0/3286946952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18040094d0 con 0x7f180c1533d0 2023-12-19T05:39:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f180affd640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c069d00 0x7f180c13cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f180a7fc640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f180c0712b0 0x7f180c0b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f180b7fe640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f180c1533d0 0x7f180c1dff60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f18040090b0 tx=0x7f18040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f17f37fe640 1 -- 172.21.15.120:0/3286946952 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180403ac60 con 0x7f180c1533d0 2023-12-19T05:39:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f17f37fe640 1 -- 172.21.15.120:0/3286946952 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180403adc0 con 0x7f180c1533d0 2023-12-19T05:39:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f18113d3640 1 -- 172.21.15.120:0/3286946952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180c0b49b0 con 0x7f180c1533d0 2023-12-19T05:39:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.594+0000 7f17f37fe640 1 -- 172.21.15.120:0/3286946952 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804044630 con 0x7f180c1533d0 2023-12-19T05:39:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.595+0000 7f18113d3640 1 -- 172.21.15.120:0/3286946952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c0b43d0 con 0x7f180c1533d0 2023-12-19T05:39:07.599 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.596+0000 7f18113d3640 1 -- 172.21.15.120:0/3286946952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180c0b4b40 con 0x7f180c1533d0 2023-12-19T05:39:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.596+0000 7f17f37fe640 1 -- 172.21.15.120:0/3286946952 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1804044790 con 0x7f180c1533d0 2023-12-19T05:39:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.596+0000 7f17f37fe640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f17f806a430 0x7f17f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.596+0000 7f180affd640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f17f806a430 0x7f17f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.596+0000 7f17f37fe640 1 -- 172.21.15.120:0/3286946952 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f180402d040 con 0x7f180c1533d0 2023-12-19T05:39:07.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.597+0000 7f180affd640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f17f806a430 0x7f17f806c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009f50 tx=0x7f17fc00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.601+0000 7f17f37fe640 1 -- 172.21.15.120:0/3286946952 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1804076760 con 0x7f180c1533d0 2023-12-19T05:39:07.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.767+0000 7f18113d3640 1 -- 172.21.15.120:0/3286946952 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f180c04e080 con 0x7f180c1533d0 2023-12-19T05:39:07.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.768+0000 7f17f37fe640 1 -- 172.21.15.120:0/3286946952 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18040350a0 con 0x7f180c1533d0 2023-12-19T05:39:07.770 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2023-12-19T05:39:07.771 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.769+0000 7f18113d3640 1 -- 172.21.15.120:0/3286946952 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f17f806a430 msgr2=0x7f17f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.771 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.770+0000 7f18113d3640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f17f806a430 0x7f17f806c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f17fc009f50 tx=0x7f17fc00b040 comp rx=0 tx=0).stop 2023-12-19T05:39:07.771 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.770+0000 7f18113d3640 1 -- 172.21.15.120:0/3286946952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f180c1533d0 msgr2=0x7f180c1dff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.771 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.770+0000 7f18113d3640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f180c1533d0 0x7f180c1dff60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f18040090b0 tx=0x7f18040046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.771 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.770+0000 7f18113d3640 1 -- 172.21.15.120:0/3286946952 shutdown_connections 2023-12-19T05:39:07.771 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.770+0000 7f18113d3640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f17f806a430 0x7f17f806c8f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.771 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.770+0000 7f18113d3640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f180c1533d0 0x7f180c1dff60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.771 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.770+0000 7f18113d3640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f180c0712b0 0x7f180c0b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.770+0000 7f18113d3640 1 --2- 172.21.15.120:0/3286946952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f180c069d00 0x7f180c13cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.770+0000 7f18113d3640 1 -- 172.21.15.120:0/3286946952 >> 172.21.15.120:0/3286946952 conn(0x7f180c0bd070 msgr2=0x7f180c0bd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:07.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.770+0000 7f18113d3640 1 -- 172.21.15.120:0/3286946952 shutdown_connections 2023-12-19T05:39:07.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.770+0000 7f18113d3640 1 -- 172.21.15.120:0/3286946952 wait complete. 2023-12-19T05:39:07.782 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:39:07.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.879+0000 7f344219f640 1 Processor -- start 2023-12-19T05:39:07.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.879+0000 7f344219f640 1 -- start start 2023-12-19T05:39:07.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.879+0000 7f344219f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f343c0b79b0 0x7f343c0b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.879+0000 7f344219f640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c0b96b0 con 0x7f343c14b230 2023-12-19T05:39:07.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.879+0000 7f344219f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c0b90f0 con 0x7f343c0b8860 2023-12-19T05:39:07.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.879+0000 7f344219f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c14ae10 con 0x7f343c0b79b0 2023-12-19T05:39:07.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343bfff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f343c14b230 0x7f343c1553c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49758/0 (socket says 172.21.15.120:49758) 2023-12-19T05:39:07.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343bfff640 1 -- 172.21.15.120:0/3666992519 learned_addr learned my addr 172.21.15.120:0/3666992519 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:07.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343b7fe640 1 --2- 172.21.15.120:0/3666992519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f343c0b79b0 0x7f343c0b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831718530 0 0) 0x7f343c0b96b0 con 0x7f343c14b230 2023-12-19T05:39:07.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3424003520 con 0x7f343c14b230 2023-12-19T05:39:07.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321533793 0 0) 0x7f343c0b90f0 con 0x7f343c0b8860 2023-12-19T05:39:07.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f343c0b96b0 con 0x7f343c0b8860 2023-12-19T05:39:07.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3828992432 0 0) 0x7f3424003520 con 0x7f343c14b230 2023-12-19T05:39:07.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f343c0b79b0 msgr2=0x7f343c0b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:07.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 --2- 172.21.15.120:0/3666992519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f343c0b79b0 0x7f343c0b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 >> v1:172.21.15.155:6789/0 conn(0x7f343c0b8860 legacy=0x7f343c144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c0b93d0 con 0x7f343c14b230 2023-12-19T05:39:07.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f34340019f0 con 0x7f343c14b230 2023-12-19T05:39:07.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 >> v1:172.21.15.120:6789/0 conn(0x7f343c14b230 legacy=0x7f343c1553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 --2- 172.21.15.120:0/3666992519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f343c0b79b0 0x7f3424003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 --2- 172.21.15.120:0/3666992519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3424004090 0x7f34240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 --2- 172.21.15.120:0/3666992519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3424004d00 0x7f3424005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c14ae10 con 0x7f3424004d00 2023-12-19T05:39:07.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342400ba60 con 0x7f3424004090 2023-12-19T05:39:07.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342400bc20 con 0x7f343c0b79b0 2023-12-19T05:39:07.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343bfff640 1 --2- 172.21.15.120:0/3666992519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3424004d00 0x7f3424005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343affd640 1 --2- 172.21.15.120:0/3666992519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3424004090 0x7f34240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.880+0000 7f343b7fe640 1 --2- 172.21.15.120:0/3666992519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f343c0b79b0 0x7f3424003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.881+0000 7f343bfff640 1 -- 172.21.15.120:0/3666992519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f343c0b79b0 msgr2=0x7f3424003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:07.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.881+0000 7f343bfff640 1 --2- 172.21.15.120:0/3666992519 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f343c0b79b0 0x7f3424003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.881+0000 7f343bfff640 1 -- 172.21.15.120:0/3666992519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3424004090 msgr2=0x7f34240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:07.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.881+0000 7f343bfff640 1 --2- 172.21.15.120:0/3666992519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3424004090 0x7f34240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.881+0000 7f343bfff640 1 -- 172.21.15.120:0/3666992519 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3424003520 con 0x7f3424004d00 2023-12-19T05:39:07.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.881+0000 7f343bfff640 1 --2- 172.21.15.120:0/3666992519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3424004d00 0x7f3424005180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f343400a7a0 tx=0x7f34240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5964a8905b0997 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.881+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434034630 con 0x7f3424004d00 2023-12-19T05:39:07.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.881+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343402f070 con 0x7f3424004d00 2023-12-19T05:39:07.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.881+0000 7f343a7fc640 1 -- 172.21.15.120:0/3666992519 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434034a30 con 0x7f3424004d00 2023-12-19T05:39:07.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.882+0000 7f344219f640 1 -- 172.21.15.120:0/3666992519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3424004d00 msgr2=0x7f3424005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.882+0000 7f344219f640 1 --2- 172.21.15.120:0/3666992519 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3424004d00 0x7f3424005180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f343400a7a0 tx=0x7f34240057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.882+0000 7f343bfff640 1 -- 172.21.15.120:0/3666992519 reap_dead start 2023-12-19T05:39:07.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.882+0000 7f344219f640 1 -- 172.21.15.120:0/3666992519 shutdown_connections 2023-12-19T05:39:07.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.882+0000 7f344219f640 1 -- 172.21.15.120:0/3666992519 >> 172.21.15.120:0/3666992519 conn(0x7f343c0c0340 msgr2=0x7f343c0c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:07.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.882+0000 7f344219f640 1 -- 172.21.15.120:0/3666992519 shutdown_connections 2023-12-19T05:39:07.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.882+0000 7f344219f640 1 -- 172.21.15.120:0/3666992519 wait complete. 2023-12-19T05:39:07.889 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.883+0000 7f344219f640 1 Processor -- start 2023-12-19T05:39:07.889 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.883+0000 7f344219f640 1 -- start start 2023-12-19T05:39:07.889 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f344219f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3424004d00 0x7f343c1d4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.889 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f344219f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f343c1d69f0 0x7f343c1d6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.889 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f344219f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f343c144010 0x7f343c144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f344219f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c148260 con 0x7f3424004d00 2023-12-19T05:39:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f344219f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c1449b0 con 0x7f343c1d69f0 2023-12-19T05:39:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f344219f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c1d4b20 con 0x7f343c144010 2023-12-19T05:39:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f343b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3424004d00 0x7f343c1d4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f343b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3424004d00 0x7f343c1d4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45540/0 (socket says 172.21.15.120:45540) 2023-12-19T05:39:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f343b7fe640 1 -- 172.21.15.120:0/1157398202 learned_addr learned my addr 172.21.15.120:0/1157398202 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f343b7fe640 1 -- 172.21.15.120:0/1157398202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f343c144010 msgr2=0x7f343c144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f343b7fe640 1 --2- 172.21.15.120:0/1157398202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f343c144010 0x7f343c144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f343b7fe640 1 -- 172.21.15.120:0/1157398202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f343c1d69f0 msgr2=0x7f343c1d6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f343b7fe640 1 --2- 172.21.15.120:0/1157398202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f343c1d69f0 0x7f343c1d6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f343b7fe640 1 -- 172.21.15.120:0/1157398202 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c1d4e00 con 0x7f3424004d00 2023-12-19T05:39:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f343b7fe640 1 --2- 172.21.15.120:0/1157398202 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3424004d00 0x7f343c1d4070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f342c011920 tx=0x7f342c011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f3423fff640 1 -- 172.21.15.120:0/1157398202 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c00faf0 con 0x7f3424004d00 2023-12-19T05:39:07.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f3423fff640 1 -- 172.21.15.120:0/1157398202 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c00fc50 con 0x7f3424004d00 2023-12-19T05:39:07.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f344219f640 1 -- 172.21.15.120:0/1157398202 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c1d50e0 con 0x7f3424004d00 2023-12-19T05:39:07.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f3423fff640 1 -- 172.21.15.120:0/1157398202 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c014440 con 0x7f3424004d00 2023-12-19T05:39:07.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.884+0000 7f344219f640 1 -- 172.21.15.120:0/1157398202 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343c1d4790 con 0x7f3424004d00 2023-12-19T05:39:07.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.885+0000 7f344219f640 1 -- 172.21.15.120:0/1157398202 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343c1d4980 con 0x7f3424004d00 2023-12-19T05:39:07.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.886+0000 7f3423fff640 1 -- 172.21.15.120:0/1157398202 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f342c01d400 con 0x7f3424004d00 2023-12-19T05:39:07.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.886+0000 7f3423fff640 1 --2- 172.21.15.120:0/1157398202 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f342806a430 0x7f342806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:07.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.886+0000 7f3423fff640 1 -- 172.21.15.120:0/1157398202 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f342c088f40 con 0x7f3424004d00 2023-12-19T05:39:07.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.886+0000 7f343affd640 1 --2- 172.21.15.120:0/1157398202 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f342806a430 0x7f342806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:07.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.886+0000 7f343affd640 1 --2- 172.21.15.120:0/1157398202 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f342806a430 0x7f342806c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f34300079a0 tx=0x7f3430009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:07.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:07.890+0000 7f3423fff640 1 -- 172.21.15.120:0/1157398202 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f343c1d4980 con 0x7f3424004d00 2023-12-19T05:39:08.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.092+0000 7f344219f640 1 -- 172.21.15.120:0/1157398202 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f343c1d4790 con 0x7f3424004d00 2023-12-19T05:39:08.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.092+0000 7f3423fff640 1 -- 172.21.15.120:0/1157398202 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3892 (secure 0 0 0) 0x7f343c1d4790 con 0x7f3424004d00 2023-12-19T05:39:08.094 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:08.094 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/753508604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":753508604},{"type":"v1","addr":"172.21.15.155:6833","nonce":753508604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/3314096579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":3314096579},{"type":"v1","addr":"172.21.15.120:6836","nonce":3314096579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:38:58.081682+0000","modified":"2023-12-19T05:39:00.753884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/1608902018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":1608902018},{"type":"v1","addr":"172.21.15.120:6837","nonce":1608902018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:39:08.094 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2023-12-19T05:39:08.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.094+0000 7f344219f640 1 -- 172.21.15.120:0/1157398202 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f342806a430 msgr2=0x7f342806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.094+0000 7f344219f640 1 --2- 172.21.15.120:0/1157398202 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f342806a430 0x7f342806c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f34300079a0 tx=0x7f3430009040 comp rx=0 tx=0).stop 2023-12-19T05:39:08.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.094+0000 7f344219f640 1 -- 172.21.15.120:0/1157398202 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3424004d00 msgr2=0x7f343c1d4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.094+0000 7f344219f640 1 --2- 172.21.15.120:0/1157398202 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3424004d00 0x7f343c1d4070 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f342c011920 tx=0x7f342c011de0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.094+0000 7f344219f640 1 -- 172.21.15.120:0/1157398202 shutdown_connections 2023-12-19T05:39:08.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.094+0000 7f344219f640 1 --2- 172.21.15.120:0/1157398202 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f342806a430 0x7f342806c8f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.094+0000 7f344219f640 1 --2- 172.21.15.120:0/1157398202 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f343c144010 0x7f343c144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.094+0000 7f344219f640 1 --2- 172.21.15.120:0/1157398202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f343c1d69f0 0x7f343c1d6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.094+0000 7f344219f640 1 --2- 172.21.15.120:0/1157398202 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3424004d00 0x7f343c1d4070 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.094+0000 7f344219f640 1 -- 172.21.15.120:0/1157398202 >> 172.21.15.120:0/1157398202 conn(0x7f343c0c0340 msgr2=0x7f343c0bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:08.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.094+0000 7f344219f640 1 -- 172.21.15.120:0/1157398202 shutdown_connections 2023-12-19T05:39:08.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.094+0000 7f344219f640 1 -- 172.21.15.120:0/1157398202 wait complete. 2023-12-19T05:39:08.106 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:08.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.203+0000 7f6e24870640 1 Processor -- start 2023-12-19T05:39:08.204 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.203+0000 7f6e24870640 1 -- start start 2023-12-19T05:39:08.206 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.204+0000 7f6e24870640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e200b79b0 0x7f6e200b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.206 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.204+0000 7f6e24870640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6e2014b230 0x7f6e2014b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.204+0000 7f6e24870640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e200b96b0 con 0x7f6e200b8860 2023-12-19T05:39:08.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.204+0000 7f6e24870640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2014ae10 con 0x7f6e2014b230 2023-12-19T05:39:08.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.204+0000 7f6e24870640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200bacc0 con 0x7f6e200b79b0 2023-12-19T05:39:08.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.204+0000 7f6e1ed9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6e2014b230 0x7f6e2014b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.204+0000 7f6e1e59c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e200b79b0 0x7f6e200b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.204+0000 7f6e1dd9b640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f6e200b8860 0x7f6e20144ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:40012/0 (socket says 172.21.15.120:40012) 2023-12-19T05:39:08.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.204+0000 7f6e1ed9d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6e2014b230 0x7f6e2014b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59938/0 (socket says 172.21.15.120:59938) 2023-12-19T05:39:08.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.204+0000 7f6e1dd9b640 1 -- 172.21.15.120:0/1014048247 learned_addr learned my addr 172.21.15.120:0/1014048247 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:08.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.204+0000 7f6e1d59a640 1 -- 172.21.15.120:0/1014048247 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971294954 0 0) 0x7f6e200b96b0 con 0x7f6e200b8860 2023-12-19T05:39:08.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.204+0000 7f6e1d59a640 1 -- 172.21.15.120:0/1014048247 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e08003520 con 0x7f6e200b8860 2023-12-19T05:39:08.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.204+0000 7f6e1ed9d640 1 -- 172.21.15.120:0/1014048247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e200b79b0 msgr2=0x7f6e200b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:08.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.204+0000 7f6e1ed9d640 1 --2- 172.21.15.120:0/1014048247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e200b79b0 0x7f6e200b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.205+0000 7f6e1ed9d640 1 -- 172.21.15.120:0/1014048247 >> v1:172.21.15.155:6789/0 conn(0x7f6e200b8860 legacy=0x7f6e20144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.208 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.205+0000 7f6e1ed9d640 1 -- 172.21.15.120:0/1014048247 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e200b90f0 con 0x7f6e2014b230 2023-12-19T05:39:08.208 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.205+0000 7f6e1e59c640 1 --2- 172.21.15.120:0/1014048247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e200b79b0 0x7f6e200b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:08.208 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.205+0000 7f6e1ed9d640 1 --2- 172.21.15.120:0/1014048247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e2014b230 0x7f6e2014b6c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009d90 tx=0x7f6e1802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27f0de274d4ed88a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:08.208 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.205+0000 7f6e1d59a640 1 -- 172.21.15.120:0/1014048247 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1802cc50 con 0x7f6e2014b230 2023-12-19T05:39:08.208 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.205+0000 7f6e1d59a640 1 -- 172.21.15.120:0/1014048247 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e1802cdb0 con 0x7f6e2014b230 2023-12-19T05:39:08.208 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.205+0000 7f6e1d59a640 1 -- 172.21.15.120:0/1014048247 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e18034640 con 0x7f6e2014b230 2023-12-19T05:39:08.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.206+0000 7f6e24870640 1 -- 172.21.15.120:0/1014048247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e2014b230 msgr2=0x7f6e2014b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.206+0000 7f6e24870640 1 --2- 172.21.15.120:0/1014048247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e2014b230 0x7f6e2014b6c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009d90 tx=0x7f6e1802bea0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.206+0000 7f6e24870640 1 -- 172.21.15.120:0/1014048247 shutdown_connections 2023-12-19T05:39:08.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.206+0000 7f6e24870640 1 --2- 172.21.15.120:0/1014048247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e2014b230 0x7f6e2014b6c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.206+0000 7f6e24870640 1 --2- 172.21.15.120:0/1014048247 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e200b79b0 0x7f6e200b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.206+0000 7f6e24870640 1 -- 172.21.15.120:0/1014048247 >> 172.21.15.120:0/1014048247 conn(0x7f6e200c0340 msgr2=0x7f6e200c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:08.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.206+0000 7f6e24870640 1 -- 172.21.15.120:0/1014048247 shutdown_connections 2023-12-19T05:39:08.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.206+0000 7f6e24870640 1 -- 172.21.15.120:0/1014048247 wait complete. 2023-12-19T05:39:08.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.207+0000 7f6e24870640 1 Processor -- start 2023-12-19T05:39:08.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.207+0000 7f6e24870640 1 -- start start 2023-12-19T05:39:08.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e24870640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e200b79b0 0x7f6e2009d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e24870640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e200b8860 0x7f6e2009def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e24870640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e2014b230 0x7f6e20099d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e24870640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2009d540 con 0x7f6e200b8860 2023-12-19T05:39:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e24870640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2009e430 con 0x7f6e2014b230 2023-12-19T05:39:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e24870640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e200995b0 con 0x7f6e200b79b0 2023-12-19T05:39:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e1dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e200b8860 0x7f6e2009def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e1dd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e200b8860 0x7f6e2009def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45556/0 (socket says 172.21.15.120:45556) 2023-12-19T05:39:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e1dd9b640 1 -- 172.21.15.120:0/4047003790 learned_addr learned my addr 172.21.15.120:0/4047003790 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e1e59c640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e200b79b0 0x7f6e2009d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e1ed9d640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e2014b230 0x7f6e20099d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e1dd9b640 1 -- 172.21.15.120:0/4047003790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e200b79b0 msgr2=0x7f6e2009d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e1dd9b640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e200b79b0 0x7f6e2009d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e1dd9b640 1 -- 172.21.15.120:0/4047003790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e2014b230 msgr2=0x7f6e20099d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e1dd9b640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e2014b230 0x7f6e20099d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e1dd9b640 1 -- 172.21.15.120:0/4047003790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e10009400 con 0x7f6e200b8860 2023-12-19T05:39:08.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e1e59c640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e200b79b0 0x7f6e2009d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:08.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e1dd9b640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e200b8860 0x7f6e2009def0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400c430 tx=0x7f6e1400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:08.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e0effd640 1 -- 172.21.15.120:0/4047003790 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e14005ce0 con 0x7f6e200b8860 2023-12-19T05:39:08.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e0effd640 1 -- 172.21.15.120:0/4047003790 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e14005e40 con 0x7f6e200b8860 2023-12-19T05:39:08.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.208+0000 7f6e0effd640 1 -- 172.21.15.120:0/4047003790 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e140072f0 con 0x7f6e200b8860 2023-12-19T05:39:08.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.209+0000 7f6e24870640 1 -- 172.21.15.120:0/4047003790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e18009a70 con 0x7f6e200b8860 2023-12-19T05:39:08.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.209+0000 7f6e24870640 1 -- 172.21.15.120:0/4047003790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2009b2d0 con 0x7f6e200b8860 2023-12-19T05:39:08.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.210+0000 7f6e24870640 1 -- 172.21.15.120:0/4047003790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e20149080 con 0x7f6e200b8860 2023-12-19T05:39:08.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.210+0000 7f6e0effd640 1 -- 172.21.15.120:0/4047003790 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6e14007450 con 0x7f6e200b8860 2023-12-19T05:39:08.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.210+0000 7f6e0effd640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6e0006a430 0x7f6e0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.210+0000 7f6e0effd640 1 -- 172.21.15.120:0/4047003790 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e14087fe0 con 0x7f6e200b8860 2023-12-19T05:39:08.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.210+0000 7f6e1e59c640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6e0006a430 0x7f6e0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.211+0000 7f6e1e59c640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6e0006a430 0x7f6e0006c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009c50 tx=0x7f6e10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:08.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.214+0000 7f6e0effd640 1 -- 172.21.15.120:0/4047003790 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6e140535d0 con 0x7f6e200b8860 2023-12-19T05:39:08.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.384+0000 7f6e24870640 1 -- 172.21.15.120:0/4047003790 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e2004e080 con 0x7f6e200b8860 2023-12-19T05:39:08.386 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.385+0000 7f6e0effd640 1 -- 172.21.15.120:0/4047003790 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f6e14056bf0 con 0x7f6e200b8860 2023-12-19T05:39:08.387 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:08.387 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:08.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.387+0000 7f6e24870640 1 -- 172.21.15.120:0/4047003790 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6e0006a430 msgr2=0x7f6e0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.387+0000 7f6e24870640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6e0006a430 0x7f6e0006c8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009c50 tx=0x7f6e10008040 comp rx=0 tx=0).stop 2023-12-19T05:39:08.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.387+0000 7f6e24870640 1 -- 172.21.15.120:0/4047003790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e200b8860 msgr2=0x7f6e2009def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.387+0000 7f6e24870640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e200b8860 0x7f6e2009def0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6e1400c430 tx=0x7f6e1400c8f0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.387+0000 7f6e24870640 1 -- 172.21.15.120:0/4047003790 shutdown_connections 2023-12-19T05:39:08.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.387+0000 7f6e24870640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6e0006a430 0x7f6e0006c8f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.387+0000 7f6e24870640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e2014b230 0x7f6e20099d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.387+0000 7f6e24870640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6e200b8860 0x7f6e2009def0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.387+0000 7f6e24870640 1 --2- 172.21.15.120:0/4047003790 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6e200b79b0 0x7f6e2009d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.387+0000 7f6e24870640 1 -- 172.21.15.120:0/4047003790 >> 172.21.15.120:0/4047003790 conn(0x7f6e200c0340 msgr2=0x7f6e20148970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:08.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.387+0000 7f6e24870640 1 -- 172.21.15.120:0/4047003790 shutdown_connections 2023-12-19T05:39:08.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.387+0000 7f6e24870640 1 -- 172.21.15.120:0/4047003790 wait complete. 2023-12-19T05:39:08.399 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:45.976868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:38:56.035188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:38:57.050130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:08.400 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:08.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.499+0000 7fc69b28f640 1 Processor -- start 2023-12-19T05:39:08.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.500+0000 7fc69b28f640 1 -- start start 2023-12-19T05:39:08.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.500+0000 7fc69b28f640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc6940bad20 0x7fc6940b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.500+0000 7fc69b28f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc694142df0 0x7fc694153270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.500+0000 7fc69b28f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6940b56d0 con 0x7fc694142980 2023-12-19T05:39:08.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.500+0000 7fc69b28f640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6940b6070 con 0x7fc6940bad20 2023-12-19T05:39:08.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.500+0000 7fc69b28f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6940b59b0 con 0x7fc694142df0 2023-12-19T05:39:08.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.500+0000 7fc69982c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc694142df0 0x7fc694153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.500+0000 7fc69902b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc6940bad20 0x7fc6940b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.501+0000 7fc69902b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fc6940bad20 0x7fc6940b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:59964/0 (socket says 172.21.15.120:59964) 2023-12-19T05:39:08.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.501+0000 7fc69902b640 1 -- 172.21.15.120:0/2905951682 learned_addr learned my addr 172.21.15.120:0/2905951682 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:08.503 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.501+0000 7fc69882a640 1 --1- 172.21.15.120:0/2905951682 >> v1:172.21.15.155:6789/0 conn(0x7fc694142980 0x7fc6940b96d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:40028/0 (socket says 172.21.15.120:40028) 2023-12-19T05:39:08.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.501+0000 7fc69902b640 1 -- 172.21.15.120:0/2905951682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc694142df0 msgr2=0x7fc694153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:08.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.501+0000 7fc69902b640 1 --2- 172.21.15.120:0/2905951682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc694142df0 0x7fc694153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.501+0000 7fc69902b640 1 -- 172.21.15.120:0/2905951682 >> v1:172.21.15.155:6789/0 conn(0x7fc694142980 legacy=0x7fc6940b96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.501+0000 7fc69902b640 1 -- 172.21.15.120:0/2905951682 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6940b5c90 con 0x7fc6940bad20 2023-12-19T05:39:08.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.501+0000 7fc68bfff640 1 -- 172.21.15.120:0/2905951682 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109744120 0 0) 0x7fc6940b56d0 con 0x7fc694142980 2023-12-19T05:39:08.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.501+0000 7fc69982c640 1 --2- 172.21.15.120:0/2905951682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc694142df0 0x7fc694153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:08.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.502+0000 7fc69902b640 1 --2- 172.21.15.120:0/2905951682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6940bad20 0x7fc6940b4d50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc690009870 tx=0x7fc69002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60610d8005f8121b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:08.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.502+0000 7fc68bfff640 1 -- 172.21.15.120:0/2905951682 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc690030840 con 0x7fc6940bad20 2023-12-19T05:39:08.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.502+0000 7fc68bfff640 1 -- 172.21.15.120:0/2905951682 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6900309a0 con 0x7fc6940bad20 2023-12-19T05:39:08.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.502+0000 7fc68bfff640 1 -- 172.21.15.120:0/2905951682 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc690030d30 con 0x7fc6940bad20 2023-12-19T05:39:08.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.502+0000 7fc69b28f640 1 -- 172.21.15.120:0/2905951682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6940bad20 msgr2=0x7fc6940b4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.502+0000 7fc69b28f640 1 --2- 172.21.15.120:0/2905951682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6940bad20 0x7fc6940b4d50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc690009870 tx=0x7fc69002b980 comp rx=0 tx=0).stop 2023-12-19T05:39:08.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.502+0000 7fc69b28f640 1 -- 172.21.15.120:0/2905951682 shutdown_connections 2023-12-19T05:39:08.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.502+0000 7fc69b28f640 1 --2- 172.21.15.120:0/2905951682 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc694142df0 0x7fc694153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.502+0000 7fc69b28f640 1 --2- 172.21.15.120:0/2905951682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6940bad20 0x7fc6940b4d50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.502+0000 7fc69b28f640 1 -- 172.21.15.120:0/2905951682 >> 172.21.15.120:0/2905951682 conn(0x7fc694069d00 msgr2=0x7fc69406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:08.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.502+0000 7fc69b28f640 1 -- 172.21.15.120:0/2905951682 shutdown_connections 2023-12-19T05:39:08.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.502+0000 7fc69b28f640 1 -- 172.21.15.120:0/2905951682 wait complete. 2023-12-19T05:39:08.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.503+0000 7fc69b28f640 1 Processor -- start 2023-12-19T05:39:08.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.503+0000 7fc69b28f640 1 -- start start 2023-12-19T05:39:08.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69b28f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6940bad20 0x7fc6941390c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69b28f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc694142980 0x7fc69413af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69b28f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc694142df0 0x7fc694139bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69b28f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc694139600 con 0x7fc694142980 2023-12-19T05:39:08.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69b28f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc694144ea0 con 0x7fc6940bad20 2023-12-19T05:39:08.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69b28f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc694135040 con 0x7fc694142df0 2023-12-19T05:39:08.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69882a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc694142980 0x7fc69413af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69882a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc694142980 0x7fc69413af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45570/0 (socket says 172.21.15.120:45570) 2023-12-19T05:39:08.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69882a640 1 -- 172.21.15.120:0/3541523089 learned_addr learned my addr 172.21.15.120:0/3541523089 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:08.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69982c640 1 --2- 172.21.15.120:0/3541523089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc694142df0 0x7fc694139bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69902b640 1 --2- 172.21.15.120:0/3541523089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6940bad20 0x7fc6941390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69882a640 1 -- 172.21.15.120:0/3541523089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc694142df0 msgr2=0x7fc694139bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69882a640 1 --2- 172.21.15.120:0/3541523089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc694142df0 0x7fc694139bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69882a640 1 -- 172.21.15.120:0/3541523089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6940bad20 msgr2=0x7fc6941390c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.504+0000 7fc69882a640 1 --2- 172.21.15.120:0/3541523089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6940bad20 0x7fc6941390c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.505+0000 7fc69882a640 1 -- 172.21.15.120:0/3541523089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c009a70 con 0x7fc694142980 2023-12-19T05:39:08.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.505+0000 7fc69882a640 1 --2- 172.21.15.120:0/3541523089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc694142980 0x7fc69413af30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc68400c4d0 tx=0x7fc68400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:08.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.505+0000 7fc689ffb640 1 -- 172.21.15.120:0/3541523089 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6840074e0 con 0x7fc694142980 2023-12-19T05:39:08.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.505+0000 7fc689ffb640 1 -- 172.21.15.120:0/3541523089 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc684007640 con 0x7fc694142980 2023-12-19T05:39:08.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.505+0000 7fc69b28f640 1 -- 172.21.15.120:0/3541523089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6900094d0 con 0x7fc694142980 2023-12-19T05:39:08.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.505+0000 7fc689ffb640 1 -- 172.21.15.120:0/3541523089 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc684004a20 con 0x7fc694142980 2023-12-19T05:39:08.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.505+0000 7fc69b28f640 1 -- 172.21.15.120:0/3541523089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc694141e10 con 0x7fc694142980 2023-12-19T05:39:08.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.506+0000 7fc69b28f640 1 -- 172.21.15.120:0/3541523089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc69404e080 con 0x7fc694142980 2023-12-19T05:39:08.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.506+0000 7fc689ffb640 1 -- 172.21.15.120:0/3541523089 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc684004b80 con 0x7fc694142980 2023-12-19T05:39:08.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.507+0000 7fc689ffb640 1 --2- 172.21.15.120:0/3541523089 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc67806a430 0x7fc67806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.507+0000 7fc69902b640 1 --2- 172.21.15.120:0/3541523089 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc67806a430 0x7fc67806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.507+0000 7fc689ffb640 1 -- 172.21.15.120:0/3541523089 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6840886d0 con 0x7fc694142980 2023-12-19T05:39:08.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.507+0000 7fc69902b640 1 --2- 172.21.15.120:0/3541523089 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc67806a430 0x7fc67806c8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc690036000 tx=0x7fc690008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:08.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.511+0000 7fc689ffb640 1 -- 172.21.15.120:0/3541523089 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc684053cd0 con 0x7fc694142980 2023-12-19T05:39:08.684 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.683+0000 7fc69b28f640 1 -- 172.21.15.120:0/3541523089 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc694139910 con 0x7fc694142980 2023-12-19T05:39:08.685 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.684+0000 7fc689ffb640 1 -- 172.21.15.120:0/3541523089 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc6840572f0 con 0x7fc694142980 2023-12-19T05:39:08.685 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2023-12-19T05:39:08.687 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.686+0000 7fc69b28f640 1 -- 172.21.15.120:0/3541523089 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc67806a430 msgr2=0x7fc67806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.686+0000 7fc69b28f640 1 --2- 172.21.15.120:0/3541523089 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc67806a430 0x7fc67806c8f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc690036000 tx=0x7fc690008030 comp rx=0 tx=0).stop 2023-12-19T05:39:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.686+0000 7fc69b28f640 1 -- 172.21.15.120:0/3541523089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc694142980 msgr2=0x7fc69413af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.686+0000 7fc69b28f640 1 --2- 172.21.15.120:0/3541523089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc694142980 0x7fc69413af30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc68400c4d0 tx=0x7fc68400c8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.686+0000 7fc69b28f640 1 -- 172.21.15.120:0/3541523089 shutdown_connections 2023-12-19T05:39:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.686+0000 7fc69b28f640 1 --2- 172.21.15.120:0/3541523089 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc67806a430 0x7fc67806c8f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.686+0000 7fc69b28f640 1 --2- 172.21.15.120:0/3541523089 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc694142df0 0x7fc694139bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.686+0000 7fc69b28f640 1 --2- 172.21.15.120:0/3541523089 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc694142980 0x7fc69413af30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.686+0000 7fc69b28f640 1 --2- 172.21.15.120:0/3541523089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6940bad20 0x7fc6941390c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.686+0000 7fc69b28f640 1 -- 172.21.15.120:0/3541523089 >> 172.21.15.120:0/3541523089 conn(0x7fc694069d00 msgr2=0x7fc6940ba040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.686+0000 7fc69b28f640 1 -- 172.21.15.120:0/3541523089 shutdown_connections 2023-12-19T05:39:08.688 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.686+0000 7fc69b28f640 1 -- 172.21.15.120:0/3541523089 wait complete. 2023-12-19T05:39:08.698 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:08.799 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.798+0000 7f999154e640 1 Processor -- start 2023-12-19T05:39:08.800 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.798+0000 7f999154e640 1 -- start start 2023-12-19T05:39:08.803 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.799+0000 7f999154e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998c06af80 0x7f998c0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.799+0000 7f999154e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c0b69e0 con 0x7f998c147ef0 2023-12-19T05:39:08.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.799+0000 7f999154e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c0b4750 con 0x7f998c141570 2023-12-19T05:39:08.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.799+0000 7f999154e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0b9020 con 0x7f998c06af80 2023-12-19T05:39:08.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.799+0000 7f998b7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f998c147ef0 0x7f998c151f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49762/0 (socket says 172.21.15.120:49762) 2023-12-19T05:39:08.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.799+0000 7f998b7fe640 1 -- 172.21.15.120:0/3796504841 learned_addr learned my addr 172.21.15.120:0/3796504841 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:08.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.799+0000 7f998a7fc640 1 -- 172.21.15.120:0/3796504841 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859012710 0 0) 0x7f998c0b69e0 con 0x7f998c147ef0 2023-12-19T05:39:08.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998affd640 1 --2- 172.21.15.120:0/3796504841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998c06af80 0x7f998c0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998a7fc640 1 -- 172.21.15.120:0/3796504841 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9978003520 con 0x7f998c147ef0 2023-12-19T05:39:08.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998a7fc640 1 -- 172.21.15.120:0/3796504841 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4104098279 0 0) 0x7f9978003520 con 0x7f998c147ef0 2023-12-19T05:39:08.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998a7fc640 1 -- 172.21.15.120:0/3796504841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998c06af80 msgr2=0x7f998c0b8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:08.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998a7fc640 1 --2- 172.21.15.120:0/3796504841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998c06af80 0x7f998c0b8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998a7fc640 1 -- 172.21.15.120:0/3796504841 >> v1:172.21.15.155:6789/0 conn(0x7f998c141570 legacy=0x7f998c1477e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998a7fc640 1 -- 172.21.15.120:0/3796504841 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c14b040 con 0x7f998c147ef0 2023-12-19T05:39:08.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998a7fc640 1 -- 172.21.15.120:0/3796504841 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f99840019f0 con 0x7f998c147ef0 2023-12-19T05:39:08.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998a7fc640 1 -- 172.21.15.120:0/3796504841 >> v1:172.21.15.120:6789/0 conn(0x7f998c147ef0 legacy=0x7f998c151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998a7fc640 1 --2- 172.21.15.120:0/3796504841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99780039a0 0x7f9978003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998a7fc640 1 --2- 172.21.15.120:0/3796504841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998c06af80 0x7f99780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998a7fc640 1 --2- 172.21.15.120:0/3796504841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9978004d00 0x7f9978005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998a7fc640 1 -- 172.21.15.120:0/3796504841 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0b9020 con 0x7f99780039a0 2023-12-19T05:39:08.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998a7fc640 1 -- 172.21.15.120:0/3796504841 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997800bab0 con 0x7f9978004d00 2023-12-19T05:39:08.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998a7fc640 1 -- 172.21.15.120:0/3796504841 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997800bc70 con 0x7f998c06af80 2023-12-19T05:39:08.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998affd640 1 --2- 172.21.15.120:0/3796504841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99780039a0 0x7f9978003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f9983fff640 1 --2- 172.21.15.120:0/3796504841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998c06af80 0x7f99780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998b7fe640 1 --2- 172.21.15.120:0/3796504841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9978004d00 0x7f9978005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998affd640 1 -- 172.21.15.120:0/3796504841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998c06af80 msgr2=0x7f99780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:08.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998affd640 1 --2- 172.21.15.120:0/3796504841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998c06af80 0x7f99780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998affd640 1 -- 172.21.15.120:0/3796504841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9978004d00 msgr2=0x7f9978005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:08.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998affd640 1 --2- 172.21.15.120:0/3796504841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9978004d00 0x7f9978005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998affd640 1 -- 172.21.15.120:0/3796504841 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9978003520 con 0x7f99780039a0 2023-12-19T05:39:08.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f9983fff640 1 --2- 172.21.15.120:0/3796504841 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f998c06af80 0x7f99780047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:08.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.800+0000 7f998b7fe640 1 --2- 172.21.15.120:0/3796504841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9978004d00 0x7f9978005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:08.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.801+0000 7f998affd640 1 --2- 172.21.15.120:0/3796504841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99780039a0 0x7f9978003dc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f997c009ab0 tx=0x7f99780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ce141e17deda51 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:08.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.801+0000 7f998a7fc640 1 -- 172.21.15.120:0/3796504841 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c005990 con 0x7f99780039a0 2023-12-19T05:39:08.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.801+0000 7f998a7fc640 1 -- 172.21.15.120:0/3796504841 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997c005af0 con 0x7f99780039a0 2023-12-19T05:39:08.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.801+0000 7f998a7fc640 1 -- 172.21.15.120:0/3796504841 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c005ea0 con 0x7f99780039a0 2023-12-19T05:39:08.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.802+0000 7f999154e640 1 -- 172.21.15.120:0/3796504841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99780039a0 msgr2=0x7f9978003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.802+0000 7f999154e640 1 --2- 172.21.15.120:0/3796504841 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f99780039a0 0x7f9978003dc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f997c009ab0 tx=0x7f99780057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.807 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.802+0000 7f998b7fe640 1 -- 172.21.15.120:0/3796504841 reap_dead start 2023-12-19T05:39:08.807 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.802+0000 7f999154e640 1 -- 172.21.15.120:0/3796504841 shutdown_connections 2023-12-19T05:39:08.807 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.802+0000 7f999154e640 1 -- 172.21.15.120:0/3796504841 >> 172.21.15.120:0/3796504841 conn(0x7f998c0b91e0 msgr2=0x7f998c0b95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:08.807 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.802+0000 7f999154e640 1 -- 172.21.15.120:0/3796504841 shutdown_connections 2023-12-19T05:39:08.807 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.802+0000 7f999154e640 1 -- 172.21.15.120:0/3796504841 wait complete. 2023-12-19T05:39:08.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.803+0000 7f999154e640 1 Processor -- start 2023-12-19T05:39:08.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.803+0000 7f999154e640 1 -- start start 2023-12-19T05:39:08.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.803+0000 7f999154e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99780039a0 0x7f998c1464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.803+0000 7f999154e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f998c144190 0x7f998c143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.803+0000 7f999154e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f998c143660 0x7f998c13dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.803+0000 7f999154e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c1469f0 con 0x7f998c144190 2023-12-19T05:39:08.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.803+0000 7f999154e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c0a7950 con 0x7f998c143660 2023-12-19T05:39:08.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.803+0000 7f999154e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c143f40 con 0x7f99780039a0 2023-12-19T05:39:08.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.803+0000 7f9983fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f998c144190 0x7f998c143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.803+0000 7f9983fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f998c144190 0x7f998c143120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45588/0 (socket says 172.21.15.120:45588) 2023-12-19T05:39:08.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.803+0000 7f9983fff640 1 -- 172.21.15.120:0/664798958 learned_addr learned my addr 172.21.15.120:0/664798958 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:08.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.804+0000 7f998b7fe640 1 --2- 172.21.15.120:0/664798958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f998c143660 0x7f998c13dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.804+0000 7f9983fff640 1 -- 172.21.15.120:0/664798958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99780039a0 msgr2=0x7f998c1464b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.804+0000 7f9983fff640 1 --2- 172.21.15.120:0/664798958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99780039a0 0x7f998c1464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.804+0000 7f9983fff640 1 -- 172.21.15.120:0/664798958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f998c143660 msgr2=0x7f998c13dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.804+0000 7f9983fff640 1 --2- 172.21.15.120:0/664798958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f998c143660 0x7f998c13dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.804+0000 7f9983fff640 1 -- 172.21.15.120:0/664798958 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c0b3870 con 0x7f998c144190 2023-12-19T05:39:08.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.804+0000 7f998b7fe640 1 --2- 172.21.15.120:0/664798958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f998c143660 0x7f998c13dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:08.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.804+0000 7f9983fff640 1 --2- 172.21.15.120:0/664798958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f998c144190 0x7f998c143120 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f997400e630 tx=0x7f997400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:08.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.804+0000 7f99837fe640 1 -- 172.21.15.120:0/664798958 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99740052e0 con 0x7f998c144190 2023-12-19T05:39:08.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.804+0000 7f99837fe640 1 -- 172.21.15.120:0/664798958 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9974005440 con 0x7f998c144190 2023-12-19T05:39:08.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.804+0000 7f99837fe640 1 -- 172.21.15.120:0/664798958 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9974003810 con 0x7f998c144190 2023-12-19T05:39:08.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.804+0000 7f999154e640 1 -- 172.21.15.120:0/664798958 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998c0a8ce0 con 0x7f998c144190 2023-12-19T05:39:08.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.804+0000 7f999154e640 1 -- 172.21.15.120:0/664798958 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c0b3350 con 0x7f998c144190 2023-12-19T05:39:08.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.805+0000 7f999154e640 1 -- 172.21.15.120:0/664798958 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998c067030 con 0x7f998c144190 2023-12-19T05:39:08.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.805+0000 7f99837fe640 1 -- 172.21.15.120:0/664798958 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9974003970 con 0x7f998c144190 2023-12-19T05:39:08.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.806+0000 7f99837fe640 1 --2- 172.21.15.120:0/664798958 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f996c06a460 0x7f996c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:08.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.806+0000 7f99837fe640 1 -- 172.21.15.120:0/664798958 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99740886a0 con 0x7f998c144190 2023-12-19T05:39:08.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.806+0000 7f998affd640 1 --2- 172.21.15.120:0/664798958 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f996c06a460 0x7f996c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:08.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.806+0000 7f998affd640 1 --2- 172.21.15.120:0/664798958 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f996c06a460 0x7f996c06c920 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f997c035000 tx=0x7f997c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:08.812 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.810+0000 7f99837fe640 1 -- 172.21.15.120:0/664798958 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9974053d20 con 0x7f998c144190 2023-12-19T05:39:08.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.975+0000 7f999154e640 1 -- 172.21.15.120:0/664798958 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f998c04e080 con 0x7f998c144190 2023-12-19T05:39:08.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.975+0000 7f99837fe640 1 -- 172.21.15.120:0/664798958 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9974057340 con 0x7f998c144190 2023-12-19T05:39:08.977 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2023-12-19T05:39:08.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.977+0000 7f999154e640 1 -- 172.21.15.120:0/664798958 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f996c06a460 msgr2=0x7f996c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.977+0000 7f999154e640 1 --2- 172.21.15.120:0/664798958 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f996c06a460 0x7f996c06c920 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f997c035000 tx=0x7f997c02e000 comp rx=0 tx=0).stop 2023-12-19T05:39:08.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.977+0000 7f999154e640 1 -- 172.21.15.120:0/664798958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f998c144190 msgr2=0x7f998c143120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:08.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.977+0000 7f999154e640 1 --2- 172.21.15.120:0/664798958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f998c144190 0x7f998c143120 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f997400e630 tx=0x7f997400eaf0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.977+0000 7f999154e640 1 -- 172.21.15.120:0/664798958 shutdown_connections 2023-12-19T05:39:08.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.977+0000 7f999154e640 1 --2- 172.21.15.120:0/664798958 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f996c06a460 0x7f996c06c920 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.977+0000 7f999154e640 1 --2- 172.21.15.120:0/664798958 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f998c143660 0x7f998c13dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.977+0000 7f999154e640 1 --2- 172.21.15.120:0/664798958 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f998c144190 0x7f998c143120 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.977+0000 7f999154e640 1 --2- 172.21.15.120:0/664798958 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f99780039a0 0x7f998c1464b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:08.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.977+0000 7f999154e640 1 -- 172.21.15.120:0/664798958 >> 172.21.15.120:0/664798958 conn(0x7f998c0b91e0 msgr2=0x7f998c070b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:08.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.977+0000 7f999154e640 1 -- 172.21.15.120:0/664798958 shutdown_connections 2023-12-19T05:39:08.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:08.977+0000 7f999154e640 1 -- 172.21.15.120:0/664798958 wait complete. 2023-12-19T05:39:08.989 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:09.091 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.090+0000 7f16482ca640 1 Processor -- start 2023-12-19T05:39:09.091 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.090+0000 7f16482ca640 1 -- start start 2023-12-19T05:39:09.092 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.091+0000 7f16482ca640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1640144d70 0x7f16400b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.092 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.091+0000 7f16482ca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16400bc7e0 0x7f16400bcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.092 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.091+0000 7f16482ca640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1640145150 con 0x7f164014df70 2023-12-19T05:39:09.092 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.091+0000 7f16482ca640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16400b9f00 con 0x7f1640144d70 2023-12-19T05:39:09.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.091+0000 7f16482ca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16400b84b0 con 0x7f16400bc7e0 2023-12-19T05:39:09.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.091+0000 7f1646066640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1640144d70 0x7f16400b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.091+0000 7f1646066640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f1640144d70 0x7f16400b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45596/0 (socket says 172.21.15.120:45596) 2023-12-19T05:39:09.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.091+0000 7f1645865640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f164014df70 0x7f16400b8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49766/0 (socket says 172.21.15.120:49766) 2023-12-19T05:39:09.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.091+0000 7f1646066640 1 -- 172.21.15.120:0/566275470 learned_addr learned my addr 172.21.15.120:0/566275470 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:09.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.091+0000 7f1646066640 1 -- 172.21.15.120:0/566275470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16400bc7e0 msgr2=0x7f16400bcc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:09.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.091+0000 7f1646066640 1 --2- 172.21.15.120:0/566275470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16400bc7e0 0x7f16400bcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.091+0000 7f1646066640 1 -- 172.21.15.120:0/566275470 >> v1:172.21.15.120:6789/0 conn(0x7f164014df70 legacy=0x7f16400b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.091+0000 7f1645064640 1 -- 172.21.15.120:0/566275470 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845806557 0 0) 0x7f1640145150 con 0x7f164014df70 2023-12-19T05:39:09.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.091+0000 7f1646066640 1 -- 172.21.15.120:0/566275470 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16400b9080 con 0x7f1640144d70 2023-12-19T05:39:09.094 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.092+0000 7f1646066640 1 --2- 172.21.15.120:0/566275470 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1640144d70 0x7f16400b7f70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f163c009870 tx=0x7f163c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917c520cabee7de3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.092+0000 7f1645064640 1 -- 172.21.15.120:0/566275470 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c02f840 con 0x7f1640144d70 2023-12-19T05:39:09.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.092+0000 7f1645064640 1 -- 172.21.15.120:0/566275470 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c02f9a0 con 0x7f1640144d70 2023-12-19T05:39:09.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.092+0000 7f1645064640 1 -- 172.21.15.120:0/566275470 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c02fd30 con 0x7f1640144d70 2023-12-19T05:39:09.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.092+0000 7f16482ca640 1 -- 172.21.15.120:0/566275470 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1640144d70 msgr2=0x7f16400b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.092+0000 7f16482ca640 1 --2- 172.21.15.120:0/566275470 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1640144d70 0x7f16400b7f70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f163c009870 tx=0x7f163c02ba20 comp rx=0 tx=0).stop 2023-12-19T05:39:09.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.092+0000 7f16482ca640 1 -- 172.21.15.120:0/566275470 shutdown_connections 2023-12-19T05:39:09.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.092+0000 7f16482ca640 1 --2- 172.21.15.120:0/566275470 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f16400bc7e0 0x7f16400bcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.092+0000 7f16482ca640 1 --2- 172.21.15.120:0/566275470 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1640144d70 0x7f16400b7f70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.092+0000 7f16482ca640 1 -- 172.21.15.120:0/566275470 >> 172.21.15.120:0/566275470 conn(0x7f1640071430 msgr2=0x7f1640071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:09.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.092+0000 7f16482ca640 1 -- 172.21.15.120:0/566275470 shutdown_connections 2023-12-19T05:39:09.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.092+0000 7f16482ca640 1 -- 172.21.15.120:0/566275470 wait complete. 2023-12-19T05:39:09.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.093+0000 7f16482ca640 1 Processor -- start 2023-12-19T05:39:09.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.093+0000 7f16482ca640 1 -- start start 2023-12-19T05:39:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f16482ca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16400bc7e0 0x7f16400bea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f16482ca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1640144d70 0x7f164014d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f16482ca640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f164014df70 0x7f16400accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f16482ca640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164014db90 con 0x7f164014df70 2023-12-19T05:39:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f16482ca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16400bfc50 con 0x7f16400bc7e0 2023-12-19T05:39:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f16482ca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16401440d0 con 0x7f1640144d70 2023-12-19T05:39:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f1646867640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f164014df70 0x7f16400accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f1646867640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f164014df70 0x7f16400accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45598/0 (socket says 172.21.15.120:45598) 2023-12-19T05:39:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f1646867640 1 -- 172.21.15.120:0/2491179767 learned_addr learned my addr 172.21.15.120:0/2491179767 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f1645865640 1 --2- 172.21.15.120:0/2491179767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1640144d70 0x7f164014d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f1646867640 1 -- 172.21.15.120:0/2491179767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1640144d70 msgr2=0x7f164014d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f1646867640 1 --2- 172.21.15.120:0/2491179767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1640144d70 0x7f164014d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f1646867640 1 -- 172.21.15.120:0/2491179767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16400bc7e0 msgr2=0x7f16400bea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f1646066640 1 --2- 172.21.15.120:0/2491179767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16400bc7e0 0x7f16400bea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f1646867640 1 --2- 172.21.15.120:0/2491179767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16400bc7e0 0x7f16400bea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.094+0000 7f1646867640 1 -- 172.21.15.120:0/2491179767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c0094d0 con 0x7f164014df70 2023-12-19T05:39:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.095+0000 7f1646867640 1 --2- 172.21.15.120:0/2491179767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f164014df70 0x7f16400accd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f163800b970 tx=0x7f163800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.095+0000 7f1636ffd640 1 -- 172.21.15.120:0/2491179767 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163800cb40 con 0x7f164014df70 2023-12-19T05:39:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.095+0000 7f1636ffd640 1 -- 172.21.15.120:0/2491179767 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163800ccc0 con 0x7f164014df70 2023-12-19T05:39:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.095+0000 7f1636ffd640 1 -- 172.21.15.120:0/2491179767 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1638014680 con 0x7f164014df70 2023-12-19T05:39:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.095+0000 7f16482ca640 1 -- 172.21.15.120:0/2491179767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16400c05c0 con 0x7f164014df70 2023-12-19T05:39:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.095+0000 7f16482ca640 1 -- 172.21.15.120:0/2491179767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16400c0b80 con 0x7f164014df70 2023-12-19T05:39:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.096+0000 7f16482ca640 1 -- 172.21.15.120:0/2491179767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1640073970 con 0x7f164014df70 2023-12-19T05:39:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.096+0000 7f1636ffd640 1 -- 172.21.15.120:0/2491179767 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f163801d3b0 con 0x7f164014df70 2023-12-19T05:39:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.097+0000 7f1636ffd640 1 --2- 172.21.15.120:0/2491179767 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f162406a430 0x7f162406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.097+0000 7f1636ffd640 1 -- 172.21.15.120:0/2491179767 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16380888f0 con 0x7f164014df70 2023-12-19T05:39:09.099 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.097+0000 7f1646066640 1 --2- 172.21.15.120:0/2491179767 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f162406a430 0x7f162406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.100 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.097+0000 7f1646066640 1 --2- 172.21.15.120:0/2491179767 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f162406a430 0x7f162406c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f163c036000 tx=0x7f163c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.101+0000 7f1636ffd640 1 -- 172.21.15.120:0/2491179767 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f16380578e0 con 0x7f164014df70 2023-12-19T05:39:09.267 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.266+0000 7f16482ca640 1 -- 172.21.15.120:0/2491179767 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f16400bfeb0 con 0x7f164014df70 2023-12-19T05:39:09.267 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.266+0000 7f1636ffd640 1 -- 172.21.15.120:0/2491179767 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1638019070 con 0x7f164014df70 2023-12-19T05:39:09.268 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2023-12-19T05:39:09.270 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.268+0000 7f16482ca640 1 -- 172.21.15.120:0/2491179767 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f162406a430 msgr2=0x7f162406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.270 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.268+0000 7f16482ca640 1 --2- 172.21.15.120:0/2491179767 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f162406a430 0x7f162406c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f163c036000 tx=0x7f163c008030 comp rx=0 tx=0).stop 2023-12-19T05:39:09.270 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.268+0000 7f16482ca640 1 -- 172.21.15.120:0/2491179767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f164014df70 msgr2=0x7f16400accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.270 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.268+0000 7f16482ca640 1 --2- 172.21.15.120:0/2491179767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f164014df70 0x7f16400accd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f163800b970 tx=0x7f163800be30 comp rx=0 tx=0).stop 2023-12-19T05:39:09.270 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.268+0000 7f16482ca640 1 -- 172.21.15.120:0/2491179767 shutdown_connections 2023-12-19T05:39:09.270 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.268+0000 7f16482ca640 1 --2- 172.21.15.120:0/2491179767 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f162406a430 0x7f162406c8f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.270 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.268+0000 7f16482ca640 1 --2- 172.21.15.120:0/2491179767 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f164014df70 0x7f16400accd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.270 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.268+0000 7f16482ca640 1 --2- 172.21.15.120:0/2491179767 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1640144d70 0x7f164014d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.270 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.268+0000 7f16482ca640 1 --2- 172.21.15.120:0/2491179767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16400bc7e0 0x7f16400bea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.270 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.268+0000 7f16482ca640 1 -- 172.21.15.120:0/2491179767 >> 172.21.15.120:0/2491179767 conn(0x7f1640071430 msgr2=0x7f16400b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:09.271 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.268+0000 7f16482ca640 1 -- 172.21.15.120:0/2491179767 shutdown_connections 2023-12-19T05:39:09.271 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.268+0000 7f16482ca640 1 -- 172.21.15.120:0/2491179767 wait complete. 2023-12-19T05:39:09.280 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:39:09.380 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.378+0000 7f7cbf927640 1 Processor -- start 2023-12-19T05:39:09.380 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.378+0000 7f7cbf927640 1 -- start start 2023-12-19T05:39:09.382 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.379+0000 7f7cbf927640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7cb806da70 0x7f7cb81429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.382 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.379+0000 7f7cbf927640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f7cb8142ee0 0x7f7cb80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.382 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.379+0000 7f7cbf927640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb806e690 con 0x7f7cb80b4e30 2023-12-19T05:39:09.382 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.379+0000 7f7cbf927640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb806ebc0 con 0x7f7cb806da70 2023-12-19T05:39:09.383 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.379+0000 7f7cbf927640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb80b3db0 con 0x7f7cb8142ee0 2023-12-19T05:39:09.383 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.379+0000 7f7cbd6c3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7cb806da70 0x7f7cb81429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.383 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.379+0000 7f7cbd6c3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f7cb806da70 0x7f7cb81429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45608/0 (socket says 172.21.15.120:45608) 2023-12-19T05:39:09.383 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.379+0000 7f7cbd6c3640 1 -- 172.21.15.120:0/1639092290 learned_addr learned my addr 172.21.15.120:0/1639092290 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:09.383 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.379+0000 7f7cbd6c3640 1 -- 172.21.15.120:0/1639092290 >> v2:172.21.15.155:3300/0 conn(0x7f7cb8142ee0 msgr2=0x7f7cb80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:09.383 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.379+0000 7f7cbcec2640 1 --2- 172.21.15.120:0/1639092290 >> v2:172.21.15.155:3300/0 conn(0x7f7cb8142ee0 0x7f7cb80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.383 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.379+0000 7f7cbd6c3640 1 --2- 172.21.15.120:0/1639092290 >> v2:172.21.15.155:3300/0 conn(0x7f7cb8142ee0 0x7f7cb80b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.383 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.380+0000 7f7cbd6c3640 1 -- 172.21.15.120:0/1639092290 >> v1:172.21.15.155:6789/0 conn(0x7f7cb80b4e30 legacy=0x7f7cb814bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:09.383 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.380+0000 7f7cbd6c3640 1 -- 172.21.15.120:0/1639092290 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb80b9f60 con 0x7f7cb806da70 2023-12-19T05:39:09.383 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.380+0000 7f7cbcec2640 1 --2- 172.21.15.120:0/1639092290 >> v2:172.21.15.155:3300/0 conn(0x7f7cb8142ee0 0x7f7cb80b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:09.383 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.380+0000 7f7cbd6c3640 1 --2- 172.21.15.120:0/1639092290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cb806da70 0x7f7cb81429a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7cb806d0d0 tx=0x7f7cb402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de62e42ee35d7730 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.383 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.380+0000 7f7caffff640 1 -- 172.21.15.120:0/1639092290 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb402c9f0 con 0x7f7cb806da70 2023-12-19T05:39:09.383 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.380+0000 7f7caffff640 1 -- 172.21.15.120:0/1639092290 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb402cb50 con 0x7f7cb806da70 2023-12-19T05:39:09.384 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.380+0000 7f7caffff640 1 -- 172.21.15.120:0/1639092290 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb40343f0 con 0x7f7cb806da70 2023-12-19T05:39:09.384 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.381+0000 7f7cbf927640 1 -- 172.21.15.120:0/1639092290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cb806da70 msgr2=0x7f7cb81429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.384 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.381+0000 7f7cbf927640 1 --2- 172.21.15.120:0/1639092290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cb806da70 0x7f7cb81429a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7cb806d0d0 tx=0x7f7cb402be50 comp rx=0 tx=0).stop 2023-12-19T05:39:09.384 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.381+0000 7f7cbf927640 1 -- 172.21.15.120:0/1639092290 shutdown_connections 2023-12-19T05:39:09.384 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.381+0000 7f7cbf927640 1 --2- 172.21.15.120:0/1639092290 >> v2:172.21.15.155:3300/0 conn(0x7f7cb8142ee0 0x7f7cb80b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.384 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.381+0000 7f7cbf927640 1 --2- 172.21.15.120:0/1639092290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cb806da70 0x7f7cb81429a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.384 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.381+0000 7f7cbf927640 1 -- 172.21.15.120:0/1639092290 >> 172.21.15.120:0/1639092290 conn(0x7f7cb80bac10 msgr2=0x7f7cb80bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:09.384 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.381+0000 7f7cbf927640 1 -- 172.21.15.120:0/1639092290 shutdown_connections 2023-12-19T05:39:09.384 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.381+0000 7f7cbf927640 1 -- 172.21.15.120:0/1639092290 wait complete. 2023-12-19T05:39:09.387 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.382+0000 7f7cbf927640 1 Processor -- start 2023-12-19T05:39:09.387 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.382+0000 7f7cbf927640 1 -- start start 2023-12-19T05:39:09.387 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbf927640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb806da70 0x7f7cb813aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.387 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbf927640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb80b4e30 0x7f7cb8140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.387 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbf927640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cb8142ee0 0x7f7cb81417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.387 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbf927640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb813afe0 con 0x7f7cb8142ee0 2023-12-19T05:39:09.387 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbf927640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb81461d0 con 0x7f7cb806da70 2023-12-19T05:39:09.387 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbf927640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb806c110 con 0x7f7cb80b4e30 2023-12-19T05:39:09.387 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbdec4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cb8142ee0 0x7f7cb81417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.387 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbdec4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cb8142ee0 0x7f7cb81417e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45614/0 (socket says 172.21.15.120:45614) 2023-12-19T05:39:09.388 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbdec4640 1 -- 172.21.15.120:0/1344386780 learned_addr learned my addr 172.21.15.120:0/1344386780 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:09.388 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbd6c3640 1 --2- 172.21.15.120:0/1344386780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb806da70 0x7f7cb813aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.388 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbcec2640 1 --2- 172.21.15.120:0/1344386780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb80b4e30 0x7f7cb8140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.388 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbdec4640 1 -- 172.21.15.120:0/1344386780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb80b4e30 msgr2=0x7f7cb8140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.388 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbdec4640 1 --2- 172.21.15.120:0/1344386780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb80b4e30 0x7f7cb8140a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.388 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbdec4640 1 -- 172.21.15.120:0/1344386780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb806da70 msgr2=0x7f7cb813aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.388 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbdec4640 1 --2- 172.21.15.120:0/1344386780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb806da70 0x7f7cb813aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.388 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbdec4640 1 -- 172.21.15.120:0/1344386780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb4009b30 con 0x7f7cb8142ee0 2023-12-19T05:39:09.388 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbdec4640 1 --2- 172.21.15.120:0/1344386780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cb8142ee0 0x7f7cb81417e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000c440 tx=0x7f7cb000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.388 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cadffb640 1 -- 172.21.15.120:0/1344386780 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0011790 con 0x7f7cb8142ee0 2023-12-19T05:39:09.388 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cadffb640 1 -- 172.21.15.120:0/1344386780 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb00118f0 con 0x7f7cb8142ee0 2023-12-19T05:39:09.388 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cbf927640 1 -- 172.21.15.120:0/1344386780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb8142210 con 0x7f7cb8142ee0 2023-12-19T05:39:09.388 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.383+0000 7f7cadffb640 1 -- 172.21.15.120:0/1344386780 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0011ca0 con 0x7f7cb8142ee0 2023-12-19T05:39:09.388 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.384+0000 7f7cbf927640 1 -- 172.21.15.120:0/1344386780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb806be30 con 0x7f7cb8142ee0 2023-12-19T05:39:09.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.385+0000 7f7cbf927640 1 -- 172.21.15.120:0/1344386780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb8066dd0 con 0x7f7cb8142ee0 2023-12-19T05:39:09.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.385+0000 7f7cadffb640 1 -- 172.21.15.120:0/1344386780 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7cb001c460 con 0x7f7cb8142ee0 2023-12-19T05:39:09.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.385+0000 7f7cadffb640 1 --2- 172.21.15.120:0/1344386780 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f7c9c06a430 0x7f7c9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.385+0000 7f7cadffb640 1 -- 172.21.15.120:0/1344386780 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cb00885f0 con 0x7f7cb8142ee0 2023-12-19T05:39:09.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.385+0000 7f7cbd6c3640 1 --2- 172.21.15.120:0/1344386780 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f7c9c06a430 0x7f7c9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.389 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.385+0000 7f7cbd6c3640 1 --2- 172.21.15.120:0/1344386780 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f7c9c06a430 0x7f7c9c06c8f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4035000 tx=0x7f7cb4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.390 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.389+0000 7f7cadffb640 1 -- 172.21.15.120:0/1344386780 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f7cb0053d20 con 0x7f7cb8142ee0 2023-12-19T05:39:09.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.592+0000 7f7cbf927640 1 -- 172.21.15.120:0/1344386780 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cb804e080 con 0x7f7cb8142ee0 2023-12-19T05:39:09.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.592+0000 7f7cadffb640 1 -- 172.21.15.120:0/1344386780 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3892 (secure 0 0 0) 0x7f7cb0057340 con 0x7f7cb8142ee0 2023-12-19T05:39:09.594 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:09.594 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/753508604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":753508604},{"type":"v1","addr":"172.21.15.155:6833","nonce":753508604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/3314096579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":3314096579},{"type":"v1","addr":"172.21.15.120:6836","nonce":3314096579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:38:58.081682+0000","modified":"2023-12-19T05:39:00.753884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/1608902018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":1608902018},{"type":"v1","addr":"172.21.15.120:6837","nonce":1608902018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:39:09.594 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2023-12-19T05:39:09.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.595+0000 7f7cbf927640 1 -- 172.21.15.120:0/1344386780 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f7c9c06a430 msgr2=0x7f7c9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.595+0000 7f7cbf927640 1 --2- 172.21.15.120:0/1344386780 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f7c9c06a430 0x7f7c9c06c8f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4035000 tx=0x7f7cb4030000 comp rx=0 tx=0).stop 2023-12-19T05:39:09.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.595+0000 7f7cbf927640 1 -- 172.21.15.120:0/1344386780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cb8142ee0 msgr2=0x7f7cb81417e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.595+0000 7f7cbf927640 1 --2- 172.21.15.120:0/1344386780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cb8142ee0 0x7f7cb81417e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000c440 tx=0x7f7cb000c900 comp rx=0 tx=0).stop 2023-12-19T05:39:09.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.595+0000 7f7cbf927640 1 -- 172.21.15.120:0/1344386780 shutdown_connections 2023-12-19T05:39:09.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.595+0000 7f7cbf927640 1 --2- 172.21.15.120:0/1344386780 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f7c9c06a430 0x7f7c9c06c8f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.595+0000 7f7cbf927640 1 --2- 172.21.15.120:0/1344386780 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f7cb8142ee0 0x7f7cb81417e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.595+0000 7f7cbf927640 1 --2- 172.21.15.120:0/1344386780 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f7cb80b4e30 0x7f7cb8140a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.595+0000 7f7cbf927640 1 --2- 172.21.15.120:0/1344386780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7cb806da70 0x7f7cb813aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.595+0000 7f7cbf927640 1 -- 172.21.15.120:0/1344386780 >> 172.21.15.120:0/1344386780 conn(0x7f7cb80bac10 msgr2=0x7f7cb80baff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:09.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.595+0000 7f7cbf927640 1 -- 172.21.15.120:0/1344386780 shutdown_connections 2023-12-19T05:39:09.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.595+0000 7f7cbf927640 1 -- 172.21.15.120:0/1344386780 wait complete. 2023-12-19T05:39:09.606 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:09.706 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.704+0000 7f974e0ec640 1 Processor -- start 2023-12-19T05:39:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.704+0000 7f974e0ec640 1 -- start start 2023-12-19T05:39:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.705+0000 7f974e0ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9748144d60 0x7f974806d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.705+0000 7f974e0ec640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f97481532f0 0x7f97481556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.705+0000 7f974e0ec640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97480bbb60 con 0x7f974806ae10 2023-12-19T05:39:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.705+0000 7f974e0ec640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974806b980 con 0x7f97481532f0 2023-12-19T05:39:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.705+0000 7f974e0ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974814aa40 con 0x7f9748144d60 2023-12-19T05:39:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.705+0000 7f9747fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f97481532f0 0x7f97481556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.705+0000 7f9747fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f97481532f0 0x7f97481556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45618/0 (socket says 172.21.15.120:45618) 2023-12-19T05:39:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.705+0000 7f9747fff640 1 -- 172.21.15.120:0/2671529351 learned_addr learned my addr 172.21.15.120:0/2671529351 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.705+0000 7f97477fe640 1 --2- 172.21.15.120:0/2671529351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9748144d60 0x7f974806d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.705+0000 7f9747fff640 1 -- 172.21.15.120:0/2671529351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9748144d60 msgr2=0x7f974806d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:09.707 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.705+0000 7f9747fff640 1 --2- 172.21.15.120:0/2671529351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9748144d60 0x7f974806d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.708 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.705+0000 7f9747fff640 1 -- 172.21.15.120:0/2671529351 >> v1:172.21.15.155:6789/0 conn(0x7f974806ae10 legacy=0x7f974814b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:09.708 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.705+0000 7f9747fff640 1 -- 172.21.15.120:0/2671529351 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97480b8b10 con 0x7f97481532f0 2023-12-19T05:39:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.706+0000 7f9747fff640 1 --2- 172.21.15.120:0/2671529351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97481532f0 0x7f97481556e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9740009e50 tx=0x7f974002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd57062de354b66a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.706+0000 7f97467fc640 1 -- 172.21.15.120:0/2671529351 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974002cb00 con 0x7f97481532f0 2023-12-19T05:39:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.706+0000 7f97467fc640 1 -- 172.21.15.120:0/2671529351 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974002cc60 con 0x7f97481532f0 2023-12-19T05:39:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.706+0000 7f97467fc640 1 -- 172.21.15.120:0/2671529351 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97400343f0 con 0x7f97481532f0 2023-12-19T05:39:09.709 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.707+0000 7f974e0ec640 1 -- 172.21.15.120:0/2671529351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97481532f0 msgr2=0x7f97481556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.707+0000 7f974e0ec640 1 --2- 172.21.15.120:0/2671529351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97481532f0 0x7f97481556e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9740009e50 tx=0x7f974002bf60 comp rx=0 tx=0).stop 2023-12-19T05:39:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.707+0000 7f974e0ec640 1 -- 172.21.15.120:0/2671529351 shutdown_connections 2023-12-19T05:39:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.707+0000 7f974e0ec640 1 --2- 172.21.15.120:0/2671529351 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f97481532f0 0x7f97481556e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.707+0000 7f974e0ec640 1 --2- 172.21.15.120:0/2671529351 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9748144d60 0x7f974806d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.707+0000 7f974e0ec640 1 -- 172.21.15.120:0/2671529351 >> 172.21.15.120:0/2671529351 conn(0x7f97480bac10 msgr2=0x7f97480bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.707+0000 7f974e0ec640 1 -- 172.21.15.120:0/2671529351 shutdown_connections 2023-12-19T05:39:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.707+0000 7f974e0ec640 1 -- 172.21.15.120:0/2671529351 wait complete. 2023-12-19T05:39:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.708+0000 7f974e0ec640 1 Processor -- start 2023-12-19T05:39:09.710 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.708+0000 7f974e0ec640 1 -- start start 2023-12-19T05:39:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f974e0ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974806ae10 0x7f9748071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f974e0ec640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9748144d60 0x7f97481467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f974e0ec640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97481532f0 0x7f97481e3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f974e0ec640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748071640 con 0x7f9748144d60 2023-12-19T05:39:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f974e0ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748146d30 con 0x7f974806ae10 2023-12-19T05:39:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f974e0ec640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9748147dd0 con 0x7f97481532f0 2023-12-19T05:39:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f9746ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9748144d60 0x7f97481467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f9746ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9748144d60 0x7f97481467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45620/0 (socket says 172.21.15.120:45620) 2023-12-19T05:39:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f9746ffd640 1 -- 172.21.15.120:0/1001247711 learned_addr learned my addr 172.21.15.120:0/1001247711 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f97477fe640 1 --2- 172.21.15.120:0/1001247711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974806ae10 0x7f9748071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.713 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f9747fff640 1 --2- 172.21.15.120:0/1001247711 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97481532f0 0x7f97481e3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f9746ffd640 1 -- 172.21.15.120:0/1001247711 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97481532f0 msgr2=0x7f97481e3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f9746ffd640 1 --2- 172.21.15.120:0/1001247711 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97481532f0 0x7f97481e3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f9746ffd640 1 -- 172.21.15.120:0/1001247711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974806ae10 msgr2=0x7f9748071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f9746ffd640 1 --2- 172.21.15.120:0/1001247711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974806ae10 0x7f9748071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f9746ffd640 1 -- 172.21.15.120:0/1001247711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9740009b30 con 0x7f9748144d60 2023-12-19T05:39:09.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f9746ffd640 1 --2- 172.21.15.120:0/1001247711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9748144d60 0x7f97481467f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f973c00c430 tx=0x7f973c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f972ffff640 1 -- 172.21.15.120:0/1001247711 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c011790 con 0x7f9748144d60 2023-12-19T05:39:09.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f972ffff640 1 -- 172.21.15.120:0/1001247711 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c0118f0 con 0x7f9748144d60 2023-12-19T05:39:09.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f974e0ec640 1 -- 172.21.15.120:0/1001247711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9748147af0 con 0x7f9748144d60 2023-12-19T05:39:09.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f972ffff640 1 -- 172.21.15.120:0/1001247711 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c011ce0 con 0x7f9748144d60 2023-12-19T05:39:09.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.709+0000 7f974e0ec640 1 -- 172.21.15.120:0/1001247711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9748145830 con 0x7f9748144d60 2023-12-19T05:39:09.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.710+0000 7f974e0ec640 1 -- 172.21.15.120:0/1001247711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974804e080 con 0x7f9748144d60 2023-12-19T05:39:09.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.711+0000 7f972ffff640 1 -- 172.21.15.120:0/1001247711 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f973c01c460 con 0x7f9748144d60 2023-12-19T05:39:09.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.711+0000 7f972ffff640 1 --2- 172.21.15.120:0/1001247711 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f973406a430 0x7f973406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:09.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.711+0000 7f972ffff640 1 -- 172.21.15.120:0/1001247711 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f973c088770 con 0x7f9748144d60 2023-12-19T05:39:09.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.711+0000 7f97477fe640 1 --2- 172.21.15.120:0/1001247711 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f973406a430 0x7f973406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:09.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.711+0000 7f97477fe640 1 --2- 172.21.15.120:0/1001247711 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f973406a430 0x7f973406c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9738006fd0 tx=0x7f9738008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:09.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.715+0000 7f972ffff640 1 -- 172.21.15.120:0/1001247711 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f973c053e10 con 0x7f9748144d60 2023-12-19T05:39:09.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.884+0000 7f974e0ec640 1 -- 172.21.15.120:0/1001247711 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f974806e540 con 0x7f9748144d60 2023-12-19T05:39:09.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.885+0000 7f972ffff640 1 -- 172.21.15.120:0/1001247711 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f973c057430 con 0x7f9748144d60 2023-12-19T05:39:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:09.887 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:09.889 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.887+0000 7f974e0ec640 1 -- 172.21.15.120:0/1001247711 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f973406a430 msgr2=0x7f973406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.887+0000 7f974e0ec640 1 --2- 172.21.15.120:0/1001247711 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f973406a430 0x7f973406c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9738006fd0 tx=0x7f9738008040 comp rx=0 tx=0).stop 2023-12-19T05:39:09.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.887+0000 7f974e0ec640 1 -- 172.21.15.120:0/1001247711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9748144d60 msgr2=0x7f97481467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:09.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.887+0000 7f974e0ec640 1 --2- 172.21.15.120:0/1001247711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9748144d60 0x7f97481467f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f973c00c430 tx=0x7f973c00c8f0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.887+0000 7f974e0ec640 1 -- 172.21.15.120:0/1001247711 shutdown_connections 2023-12-19T05:39:09.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.887+0000 7f974e0ec640 1 --2- 172.21.15.120:0/1001247711 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f973406a430 0x7f973406c8f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.887+0000 7f974e0ec640 1 --2- 172.21.15.120:0/1001247711 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f97481532f0 0x7f97481e3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.887+0000 7f974e0ec640 1 --2- 172.21.15.120:0/1001247711 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9748144d60 0x7f97481467f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.887+0000 7f974e0ec640 1 --2- 172.21.15.120:0/1001247711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f974806ae10 0x7f9748071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:09.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.887+0000 7f974e0ec640 1 -- 172.21.15.120:0/1001247711 >> 172.21.15.120:0/1001247711 conn(0x7f97480bac10 msgr2=0x7f9748149db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:09.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.888+0000 7f974e0ec640 1 -- 172.21.15.120:0/1001247711 shutdown_connections 2023-12-19T05:39:09.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.888+0000 7f974e0ec640 1 -- 172.21.15.120:0/1001247711 wait complete. 2023-12-19T05:39:09.900 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:39:09.999 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.998+0000 7fc1cb147640 1 Processor -- start 2023-12-19T05:39:09.999 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.998+0000 7fc1cb147640 1 -- start start 2023-12-19T05:39:10.001 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.999+0000 7fc1cb147640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc1c406ae10 0x7fc1c414b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.001 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.999+0000 7fc1cb147640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c40bbb60 con 0x7fc1c4144d60 2023-12-19T05:39:10.001 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.999+0000 7fc1cb147640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c414aa40 con 0x7fc1c414b700 2023-12-19T05:39:10.001 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.999+0000 7fc1cb147640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c406b980 con 0x7fc1c406ae10 2023-12-19T05:39:10.001 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.999+0000 7fc1bbfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc1c406ae10 0x7fc1c414b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.001 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.999+0000 7fc1c8ee3640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc1c4144d60 0x7fc1c406d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49782/0 (socket says 172.21.15.120:49782) 2023-12-19T05:39:10.001 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.999+0000 7fc1bbfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc1c406ae10 0x7fc1c414b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45628/0 (socket says 172.21.15.120:45628) 2023-12-19T05:39:10.001 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.999+0000 7fc1c8ee3640 1 -- 172.21.15.120:0/2367523496 learned_addr learned my addr 172.21.15.120:0/2367523496 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:10.001 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.999+0000 7fc1bbfff640 1 -- 172.21.15.120:0/2367523496 >> v1:172.21.15.155:6789/0 conn(0x7fc1c414b700 legacy=0x7fc1c4155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:10.002 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.999+0000 7fc1bbfff640 1 -- 172.21.15.120:0/2367523496 >> v1:172.21.15.120:6789/0 conn(0x7fc1c4144d60 legacy=0x7fc1c406d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.002 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.999+0000 7fc1bbfff640 1 -- 172.21.15.120:0/2367523496 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c40b8b10 con 0x7fc1c406ae10 2023-12-19T05:39:10.002 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:09.999+0000 7fc1bb7fe640 1 -- 172.21.15.120:0/2367523496 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376744992 0 0) 0x7fc1c40bbb60 con 0x7fc1c4144d60 2023-12-19T05:39:10.002 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.000+0000 7fc1bbfff640 1 --2- 172.21.15.120:0/2367523496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1c406ae10 0x7fc1c414b1c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc1c414abd0 tx=0x7fc1b402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff129cae41ac129 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:10.002 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.000+0000 7fc1bb7fe640 1 -- 172.21.15.120:0/2367523496 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4030610 con 0x7fc1c406ae10 2023-12-19T05:39:10.002 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.000+0000 7fc1bb7fe640 1 -- 172.21.15.120:0/2367523496 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b4030770 con 0x7fc1c406ae10 2023-12-19T05:39:10.002 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.000+0000 7fc1bb7fe640 1 -- 172.21.15.120:0/2367523496 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b4030b00 con 0x7fc1c406ae10 2023-12-19T05:39:10.004 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.000+0000 7fc1cb147640 1 -- 172.21.15.120:0/2367523496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1c406ae10 msgr2=0x7fc1c414b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.004 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.000+0000 7fc1cb147640 1 --2- 172.21.15.120:0/2367523496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1c406ae10 0x7fc1c414b1c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc1c414abd0 tx=0x7fc1b402b960 comp rx=0 tx=0).stop 2023-12-19T05:39:10.004 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.000+0000 7fc1cb147640 1 -- 172.21.15.120:0/2367523496 shutdown_connections 2023-12-19T05:39:10.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.000+0000 7fc1cb147640 1 --2- 172.21.15.120:0/2367523496 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1c406ae10 0x7fc1c414b1c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.000+0000 7fc1cb147640 1 -- 172.21.15.120:0/2367523496 >> 172.21.15.120:0/2367523496 conn(0x7fc1c40bac10 msgr2=0x7fc1c40bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:10.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.000+0000 7fc1cb147640 1 -- 172.21.15.120:0/2367523496 shutdown_connections 2023-12-19T05:39:10.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.000+0000 7fc1cb147640 1 -- 172.21.15.120:0/2367523496 wait complete. 2023-12-19T05:39:10.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.001+0000 7fc1cb147640 1 Processor -- start 2023-12-19T05:39:10.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.001+0000 7fc1cb147640 1 -- start start 2023-12-19T05:39:10.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.002+0000 7fc1cb147640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1c406ae10 0x7fc1c413b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.002+0000 7fc1cb147640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1c4144d60 0x7fc1c40a32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.002+0000 7fc1cb147640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1c414b700 0x7fc1c40a1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.002+0000 7fc1cb147640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c413ba90 con 0x7fc1c414b700 2023-12-19T05:39:10.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.002+0000 7fc1cb147640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c413dd80 con 0x7fc1c4144d60 2023-12-19T05:39:10.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.002+0000 7fc1cb147640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c413c040 con 0x7fc1c406ae10 2023-12-19T05:39:10.005 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.002+0000 7fc1c96e4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1c414b700 0x7fc1c40a1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.002+0000 7fc1c96e4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1c414b700 0x7fc1c40a1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45638/0 (socket says 172.21.15.120:45638) 2023-12-19T05:39:10.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.002+0000 7fc1c96e4640 1 -- 172.21.15.120:0/4120561919 learned_addr learned my addr 172.21.15.120:0/4120561919 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:10.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.002+0000 7fc1c8ee3640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1c406ae10 0x7fc1c413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.002+0000 7fc1bbfff640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1c4144d60 0x7fc1c40a32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.003+0000 7fc1c96e4640 1 -- 172.21.15.120:0/4120561919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1c406ae10 msgr2=0x7fc1c413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.003+0000 7fc1c96e4640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1c406ae10 0x7fc1c413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.003+0000 7fc1c96e4640 1 -- 172.21.15.120:0/4120561919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1c4144d60 msgr2=0x7fc1c40a32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.003+0000 7fc1c96e4640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1c4144d60 0x7fc1c40a32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.003+0000 7fc1c96e4640 1 -- 172.21.15.120:0/4120561919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b4009400 con 0x7fc1c414b700 2023-12-19T05:39:10.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.003+0000 7fc1bbfff640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1c4144d60 0x7fc1c40a32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:10.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.003+0000 7fc1c96e4640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1c414b700 0x7fc1c40a1220 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00c780 tx=0x7fc1bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:10.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.003+0000 7fc1b97fa640 1 -- 172.21.15.120:0/4120561919 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc004b60 con 0x7fc1c414b700 2023-12-19T05:39:10.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.003+0000 7fc1b97fa640 1 -- 172.21.15.120:0/4120561919 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc00ce90 con 0x7fc1c414b700 2023-12-19T05:39:10.006 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.003+0000 7fc1cb147640 1 -- 172.21.15.120:0/4120561919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c413c320 con 0x7fc1c414b700 2023-12-19T05:39:10.007 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.003+0000 7fc1b97fa640 1 -- 172.21.15.120:0/4120561919 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc00a850 con 0x7fc1c414b700 2023-12-19T05:39:10.007 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.003+0000 7fc1cb147640 1 -- 172.21.15.120:0/4120561919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c413bc80 con 0x7fc1c414b700 2023-12-19T05:39:10.007 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.004+0000 7fc1cb147640 1 -- 172.21.15.120:0/4120561919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c413c560 con 0x7fc1c414b700 2023-12-19T05:39:10.007 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.004+0000 7fc1b97fa640 1 -- 172.21.15.120:0/4120561919 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc1bc00a9b0 con 0x7fc1c414b700 2023-12-19T05:39:10.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.005+0000 7fc1b97fa640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc1b006a430 0x7fc1b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.005+0000 7fc1b97fa640 1 -- 172.21.15.120:0/4120561919 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1bc088a60 con 0x7fc1c414b700 2023-12-19T05:39:10.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.005+0000 7fc1c8ee3640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc1b006a430 0x7fc1b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.008 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.005+0000 7fc1c8ee3640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc1b006a430 0x7fc1b006c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0007fd0 tx=0x7fc1c0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:10.010 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.009+0000 7fc1b97fa640 1 -- 172.21.15.120:0/4120561919 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc1bc054050 con 0x7fc1c414b700 2023-12-19T05:39:10.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.210+0000 7fc1cb147640 1 -- 172.21.15.120:0/4120561919 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1c4141930 con 0x7fc1c414b700 2023-12-19T05:39:10.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.211+0000 7fc1b97fa640 1 -- 172.21.15.120:0/4120561919 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3892 (secure 0 0 0) 0x7fc1bc057670 con 0x7fc1c414b700 2023-12-19T05:39:10.212 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:10.213 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/753508604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":753508604},{"type":"v1","addr":"172.21.15.155:6833","nonce":753508604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/3314096579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":3314096579},{"type":"v1","addr":"172.21.15.120:6836","nonce":3314096579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:38:58.081682+0000","modified":"2023-12-19T05:39:00.753884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/1608902018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":1608902018},{"type":"v1","addr":"172.21.15.120:6837","nonce":1608902018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:39:10.213 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2023-12-19T05:39:10.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.213+0000 7fc1cb147640 1 -- 172.21.15.120:0/4120561919 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc1b006a430 msgr2=0x7fc1b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.213+0000 7fc1cb147640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc1b006a430 0x7fc1b006c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0007fd0 tx=0x7fc1c0009040 comp rx=0 tx=0).stop 2023-12-19T05:39:10.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.213+0000 7fc1cb147640 1 -- 172.21.15.120:0/4120561919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1c414b700 msgr2=0x7fc1c40a1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.213+0000 7fc1cb147640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1c414b700 0x7fc1c40a1220 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00c780 tx=0x7fc1bc00cc40 comp rx=0 tx=0).stop 2023-12-19T05:39:10.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.213+0000 7fc1cb147640 1 -- 172.21.15.120:0/4120561919 shutdown_connections 2023-12-19T05:39:10.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.213+0000 7fc1cb147640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc1b006a430 0x7fc1b006c8f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.213+0000 7fc1cb147640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc1c414b700 0x7fc1c40a1220 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.213+0000 7fc1cb147640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1c4144d60 0x7fc1c40a32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.213+0000 7fc1cb147640 1 --2- 172.21.15.120:0/4120561919 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc1c406ae10 0x7fc1c413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.213+0000 7fc1cb147640 1 -- 172.21.15.120:0/4120561919 >> 172.21.15.120:0/4120561919 conn(0x7fc1c40bac10 msgr2=0x7fc1c4141220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:10.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.213+0000 7fc1cb147640 1 -- 172.21.15.120:0/4120561919 shutdown_connections 2023-12-19T05:39:10.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.213+0000 7fc1cb147640 1 -- 172.21.15.120:0/4120561919 wait complete. 2023-12-19T05:39:10.528 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T05:38:58.081682+0000', 'modified': '2023-12-19T05:39:00.753884+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6837/1608902018', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6835', 'nonce': 1608902018}, {'type': 'v1', 'addr': '172.21.15.120:6837', 'nonce': 1608902018}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T05:39:10.528 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T05:39:10.528 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-19T05:39:10.629 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.628+0000 7ff6215c4640 1 Processor -- start 2023-12-19T05:39:10.629 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.628+0000 7ff6215c4640 1 -- start start 2023-12-19T05:39:10.631 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.629+0000 7ff6215c4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff61c0b8790 0x7ff61c14b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.629+0000 7ff6215c4640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61c0b6e20 con 0x7ff61c0b7750 2023-12-19T05:39:10.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.629+0000 7ff6215c4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61c0bc720 con 0x7ff61c0b8e90 2023-12-19T05:39:10.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.629+0000 7ff6215c4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61c0bacd0 con 0x7ff61c0b8790 2023-12-19T05:39:10.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.629+0000 7ff61a7fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff61c0b8790 0x7ff61c14b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.629+0000 7ff61b7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ff61c0b7750 0x7ff61c1553e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:49786/0 (socket says 172.21.15.120:49786) 2023-12-19T05:39:10.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.629+0000 7ff61b7fe640 1 -- 172.21.15.120:0/2148436930 learned_addr learned my addr 172.21.15.120:0/2148436930 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:10.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.629+0000 7ff61a7fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ff61c0b8790 0x7ff61c14b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45650/0 (socket says 172.21.15.120:45650) 2023-12-19T05:39:10.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.629+0000 7ff61a7fc640 1 -- 172.21.15.120:0/2148436930 >> v1:172.21.15.155:6789/0 conn(0x7ff61c0b8e90 legacy=0x7ff61c144ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.629+0000 7ff61a7fc640 1 -- 172.21.15.120:0/2148436930 >> v1:172.21.15.120:6789/0 conn(0x7ff61c0b7750 legacy=0x7ff61c1553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.629+0000 7ff61a7fc640 1 -- 172.21.15.120:0/2148436930 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c0bc9c0 con 0x7ff61c0b8790 2023-12-19T05:39:10.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.629+0000 7ff619ffb640 1 -- 172.21.15.120:0/2148436930 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705850816 0 0) 0x7ff61c0b6e20 con 0x7ff61c0b7750 2023-12-19T05:39:10.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.630+0000 7ff61a7fc640 1 --2- 172.21.15.120:0/2148436930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff61c0b8790 0x7ff61c14b270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff6100097a0 tx=0x7ff61002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d2b3f5750275ce server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:10.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.630+0000 7ff619ffb640 1 -- 172.21.15.120:0/2148436930 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610030610 con 0x7ff61c0b8790 2023-12-19T05:39:10.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.630+0000 7ff619ffb640 1 -- 172.21.15.120:0/2148436930 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff610030770 con 0x7ff61c0b8790 2023-12-19T05:39:10.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.630+0000 7ff619ffb640 1 -- 172.21.15.120:0/2148436930 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610030b00 con 0x7ff61c0b8790 2023-12-19T05:39:10.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.630+0000 7ff6215c4640 1 -- 172.21.15.120:0/2148436930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff61c0b8790 msgr2=0x7ff61c14b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.630+0000 7ff6215c4640 1 --2- 172.21.15.120:0/2148436930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff61c0b8790 0x7ff61c14b270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff6100097a0 tx=0x7ff61002b960 comp rx=0 tx=0).stop 2023-12-19T05:39:10.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.630+0000 7ff6215c4640 1 -- 172.21.15.120:0/2148436930 shutdown_connections 2023-12-19T05:39:10.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.630+0000 7ff6215c4640 1 --2- 172.21.15.120:0/2148436930 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff61c0b8790 0x7ff61c14b270 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.630+0000 7ff6215c4640 1 -- 172.21.15.120:0/2148436930 >> 172.21.15.120:0/2148436930 conn(0x7ff61c0c0350 msgr2=0x7ff61c0c0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:10.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.630+0000 7ff6215c4640 1 -- 172.21.15.120:0/2148436930 shutdown_connections 2023-12-19T05:39:10.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.630+0000 7ff6215c4640 1 -- 172.21.15.120:0/2148436930 wait complete. 2023-12-19T05:39:10.645 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.632+0000 7ff6215c4640 1 Processor -- start 2023-12-19T05:39:10.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.632+0000 7ff6215c4640 1 -- start start 2023-12-19T05:39:10.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.632+0000 7ff6215c4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff61c0b7750 0x7ff61c1456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.632+0000 7ff6215c4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0b8790 0x7ff61c147c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.632+0000 7ff6215c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff61c0b8e90 0x7ff61c0bf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.632+0000 7ff6215c4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c1465f0 con 0x7ff61c0b8e90 2023-12-19T05:39:10.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.632+0000 7ff6215c4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c0bf930 con 0x7ff61c0b7750 2023-12-19T05:39:10.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.632+0000 7ff6215c4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c1481c0 con 0x7ff61c0b8790 2023-12-19T05:39:10.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.632+0000 7ff61b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff61c0b8e90 0x7ff61c0bf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.632+0000 7ff61b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff61c0b8e90 0x7ff61c0bf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45654/0 (socket says 172.21.15.120:45654) 2023-12-19T05:39:10.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.632+0000 7ff61b7fe640 1 -- 172.21.15.120:0/3047538707 learned_addr learned my addr 172.21.15.120:0/3047538707 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:10.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.632+0000 7ff61a7fc640 1 --2- 172.21.15.120:0/3047538707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0b8790 0x7ff61c147c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.632+0000 7ff61affd640 1 --2- 172.21.15.120:0/3047538707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff61c0b7750 0x7ff61c1456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.633+0000 7ff61b7fe640 1 -- 172.21.15.120:0/3047538707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0b8790 msgr2=0x7ff61c147c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.633+0000 7ff61b7fe640 1 --2- 172.21.15.120:0/3047538707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0b8790 0x7ff61c147c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.647 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.633+0000 7ff61b7fe640 1 -- 172.21.15.120:0/3047538707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff61c0b7750 msgr2=0x7ff61c1456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.647 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.633+0000 7ff61b7fe640 1 --2- 172.21.15.120:0/3047538707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff61c0b7750 0x7ff61c1456c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.647 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.633+0000 7ff61b7fe640 1 -- 172.21.15.120:0/3047538707 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff610009400 con 0x7ff61c0b8e90 2023-12-19T05:39:10.647 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.633+0000 7ff61b7fe640 1 --2- 172.21.15.120:0/3047538707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff61c0b8e90 0x7ff61c0bf3f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff61400c7e0 tx=0x7ff61400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:10.647 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.633+0000 7ff6037fe640 1 -- 172.21.15.120:0/3047538707 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61400a5e0 con 0x7ff61c0b8e90 2023-12-19T05:39:10.647 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.633+0000 7ff6037fe640 1 -- 172.21.15.120:0/3047538707 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61400a760 con 0x7ff61c0b8e90 2023-12-19T05:39:10.647 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.633+0000 7ff6215c4640 1 -- 172.21.15.120:0/3047538707 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61c1477f0 con 0x7ff61c0b8e90 2023-12-19T05:39:10.647 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.633+0000 7ff6037fe640 1 -- 172.21.15.120:0/3047538707 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61400ab10 con 0x7ff61c0b8e90 2023-12-19T05:39:10.647 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.633+0000 7ff6215c4640 1 -- 172.21.15.120:0/3047538707 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c14de00 con 0x7ff61c0b8e90 2023-12-19T05:39:10.647 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.634+0000 7ff6037fe640 1 -- 172.21.15.120:0/3047538707 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff61400ac70 con 0x7ff61c0b8e90 2023-12-19T05:39:10.647 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.635+0000 7ff6037fe640 1 --2- 172.21.15.120:0/3047538707 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff60806a430 0x7ff60806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.635+0000 7ff61affd640 1 --2- 172.21.15.120:0/3047538707 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff60806a430 0x7ff60806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.635+0000 7ff6037fe640 1 -- 172.21.15.120:0/3047538707 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6140880b0 con 0x7ff61c0b8e90 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.635+0000 7ff61affd640 1 --2- 172.21.15.120:0/3047538707 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff60806a430 0x7ff60806c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff60c007fd0 tx=0x7ff60c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.636+0000 7ff624209740 1 Processor -- start 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.636+0000 7ff624209740 1 -- start start 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff624209740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e2135b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff624209740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e213af0 0x55735e2447c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff624209740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e245180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff624209740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735e183030 con 0x55735e244d00 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff624209740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735e1807c0 con 0x55735e24f420 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff624209740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55735e17c0b0 con 0x55735e213af0 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff61b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e245180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff61b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e245180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45664/0 (socket says 172.21.15.120:45664) 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff61b7fe640 1 -- 172.21.15.120:0/530052835 learned_addr learned my addr 172.21.15.120:0/530052835 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:10.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff61affd640 1 --2- 172.21.15.120:0/530052835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e2135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff61a7fc640 1 --2- 172.21.15.120:0/530052835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e213af0 0x55735e2447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff61b7fe640 1 -- 172.21.15.120:0/530052835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e213af0 msgr2=0x55735e2447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:10.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff61b7fe640 1 --2- 172.21.15.120:0/530052835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e213af0 0x55735e2447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff61b7fe640 1 -- 172.21.15.120:0/530052835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 msgr2=0x55735e2135b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:10.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff61b7fe640 1 --2- 172.21.15.120:0/530052835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e2135b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff61b7fe640 1 -- 172.21.15.120:0/530052835 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55735e136bc0 con 0x55735e244d00 2023-12-19T05:39:10.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff61affd640 1 --2- 172.21.15.120:0/530052835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e2135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:10.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff61b7fe640 1 --2- 172.21.15.120:0/530052835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e245180 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff614053870 tx=0x7ff614001890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d953fffd4e4a2731 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:10.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff600ff9640 1 -- 172.21.15.120:0/530052835 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61405b0f0 con 0x55735e244d00 2023-12-19T05:39:10.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff600ff9640 1 -- 172.21.15.120:0/530052835 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61405f2a0 con 0x55735e244d00 2023-12-19T05:39:10.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.637+0000 7ff600ff9640 1 -- 172.21.15.120:0/530052835 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61405d070 con 0x55735e244d00 2023-12-19T05:39:10.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.638+0000 7ff624209740 1 -- 172.21.15.120:0/530052835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 msgr2=0x55735e245180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.638+0000 7ff624209740 1 --2- 172.21.15.120:0/530052835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e245180 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff614053870 tx=0x7ff614001890 comp rx=0 tx=0).stop 2023-12-19T05:39:10.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.638+0000 7ff624209740 1 -- 172.21.15.120:0/530052835 shutdown_connections 2023-12-19T05:39:10.650 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.638+0000 7ff624209740 1 --2- 172.21.15.120:0/530052835 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e245180 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.650 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.638+0000 7ff624209740 1 --2- 172.21.15.120:0/530052835 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e213af0 0x55735e2447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.650 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.638+0000 7ff624209740 1 --2- 172.21.15.120:0/530052835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e2135b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.650 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.638+0000 7ff624209740 1 -- 172.21.15.120:0/530052835 >> 172.21.15.120:0/530052835 conn(0x55735e214f80 msgr2=0x55735e24eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:10.650 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.638+0000 7ff624209740 1 -- 172.21.15.120:0/530052835 shutdown_connections 2023-12-19T05:39:10.650 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.638+0000 7ff624209740 1 -- 172.21.15.120:0/530052835 wait complete. 2023-12-19T05:39:10.650 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.638+0000 7ff624209740 1 -- start start 2023-12-19T05:39:10.650 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.638+0000 7ff624209740 1 Processor -- start 2023-12-19T05:39:10.650 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff624209740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e247b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.650 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff624209740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e2463e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.650 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff624209740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e23b750 0x55735e23bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.650 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff624209740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735e13a7c0 con 0x55735e244d00 2023-12-19T05:39:10.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff624209740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735e13a460 con 0x55735e24f420 2023-12-19T05:39:10.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff624209740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55735e1001b0 con 0x55735e23b750 2023-12-19T05:39:10.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff61affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e247b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff624209740 10 client.0 _ll_register_callbacks cb 0x55735e1036d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:39:10.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff61affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e247b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45668/0 (socket says 172.21.15.120:45668) 2023-12-19T05:39:10.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff61affd640 1 -- 172.21.15.120:0/1892638619 learned_addr learned my addr 172.21.15.120:0/1892638619 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:10.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff61a7fc640 1 --2- 172.21.15.120:0/1892638619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e2463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff61b7fe640 1 --2- 172.21.15.120:0/1892638619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e23b750 0x55735e23bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff61affd640 1 -- 172.21.15.120:0/1892638619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e23b750 msgr2=0x55735e23bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:10.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff61affd640 1 --2- 172.21.15.120:0/1892638619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e23b750 0x55735e23bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.651 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff61affd640 1 -- 172.21.15.120:0/1892638619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 msgr2=0x55735e2463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:10.652 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff61affd640 1 --2- 172.21.15.120:0/1892638619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e2463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.652 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.639+0000 7ff61affd640 1 -- 172.21.15.120:0/1892638619 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c14de00 con 0x55735e244d00 2023-12-19T05:39:10.652 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff61affd640 1 --2- 172.21.15.120:0/1892638619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e247b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff60c014730 tx=0x7ff60c0010d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c681124d6fd4d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:10.652 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff5f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2023-12-19T05:39:10.652 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff5f9ffb640 1 -- 172.21.15.120:0/1892638619 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0136b0 con 0x55735e244d00 2023-12-19T05:39:10.652 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff5f9ffb640 1 -- 172.21.15.120:0/1892638619 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff60c013810 con 0x55735e244d00 2023-12-19T05:39:10.652 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff624209740 1 -- 172.21.15.120:0/1892638619 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55735e16d9e0 con 0x55735e244d00 2023-12-19T05:39:10.653 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff5f9ffb640 1 -- 172.21.15.120:0/1892638619 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff60c0139d0 con 0x55735e244d00 2023-12-19T05:39:10.653 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff624209740 10 client.4674 fetch_fsmap learned FSMap version 7 2023-12-19T05:39:10.653 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff624209740 1 -- 172.21.15.120:0/1892638619 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55735e17a730 con 0x55735e244d00 2023-12-19T05:39:10.653 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff5f9ffb640 1 -- 172.21.15.120:0/1892638619 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55735e16d9e0 con 0x55735e244d00 2023-12-19T05:39:10.653 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff5f9ffb640 1 -- 172.21.15.120:0/1892638619 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 7) v1 ==== 2561+0+0 (secure 0 0 0) 0x7ff60c012070 con 0x55735e244d00 2023-12-19T05:39:10.653 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff624209740 10 client.4674 fetch_fsmap finished waiting for FSMap version 7 2023-12-19T05:39:10.654 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff624209740 10 client.4674 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T05:39:10.654 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff624209740 20 client.4674 populate_metadata read hostname 'smithi120' 2023-12-19T05:39:10.654 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff624209740 1 --2- 172.21.15.120:0/1892638619 >> [v2:172.21.15.120:6835/1608902018,v1:172.21.15.120:6837/1608902018] conn(0x55735e25b620 0x55735e25ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.654 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff624209740 4 client.4674 mds_command: new command op to 4278 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T05:39:10.654 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff624209740 1 -- 172.21.15.120:0/1892638619 --> [v2:172.21.15.120:6835/1608902018,v1:172.21.15.120:6837/1608902018] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55735e175130 con 0x55735e25b620 2023-12-19T05:39:10.654 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.640+0000 7ff61a7fc640 1 --2- 172.21.15.120:0/1892638619 >> [v2:172.21.15.120:6835/1608902018,v1:172.21.15.120:6837/1608902018] conn(0x55735e25b620 0x55735e25ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.655 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff5f9ffb640 10 client.4674 ms_handle_connect on v2:172.21.15.120:6835/1608902018 2023-12-19T05:39:10.655 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff61a7fc640 1 --2- 172.21.15.120:0/1892638619 >> [v2:172.21.15.120:6835/1608902018,v1:172.21.15.120:6837/1608902018] conn(0x55735e25b620 0x55735e25ba00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cc99620fa18a7b8 server_cookie=f3b306c68e3b54fd in_seq=0 out_seq=0 2023-12-19T05:39:10.655 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff5f9ffb640 1 -- 172.21.15.120:0/1892638619 <== mds.0 v2:172.21.15.120:6835/1608902018 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55735e175130 con 0x55735e25b620 2023-12-19T05:39:10.655 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff5f9ffb640 10 client.4674 handle_command_reply: tid=0 2023-12-19T05:39:10.655 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff624209740 1 client.4674 shutdown 2023-12-19T05:39:10.655 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff624209740 1 -- 172.21.15.120:0/1892638619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 msgr2=0x55735e247b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.656 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff624209740 1 --2- 172.21.15.120:0/1892638619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e247b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff60c014730 tx=0x7ff60c0010d0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.656 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff624209740 1 -- 172.21.15.120:0/1892638619 shutdown_connections 2023-12-19T05:39:10.656 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff624209740 1 --2- 172.21.15.120:0/1892638619 >> [v2:172.21.15.120:6835/1608902018,v1:172.21.15.120:6837/1608902018] conn(0x55735e25b620 0x55735e25ba00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.656 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff624209740 1 --2- 172.21.15.120:0/1892638619 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e23b750 0x55735e23bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.656 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff624209740 1 --2- 172.21.15.120:0/1892638619 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e2463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.656 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff5f9ffb640 0 client.4674 ms_handle_reset on v2:172.21.15.120:6835/1608902018 2023-12-19T05:39:10.656 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff624209740 1 --2- 172.21.15.120:0/1892638619 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e247b10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.657 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff624209740 1 -- 172.21.15.120:0/1892638619 >> 172.21.15.120:0/1892638619 conn(0x55735e213af0 msgr2=0x55735e213f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:10.657 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff624209740 1 -- 172.21.15.120:0/1892638619 shutdown_connections 2023-12-19T05:39:10.657 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff624209740 1 -- 172.21.15.120:0/1892638619 wait complete. 2023-12-19T05:39:10.657 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.641+0000 7ff624209740 20 client.4674 trim_cache size 0 max 16384 2023-12-19T05:39:10.665 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.656+0000 7ff624209740 1 Processor -- start 2023-12-19T05:39:10.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.656+0000 7ff624209740 1 -- start start 2023-12-19T05:39:10.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff624209740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e23b750 0x55735e2ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff624209740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e2ac180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff624209740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e24a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff624209740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735e26df40 con 0x55735e244d00 2023-12-19T05:39:10.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff624209740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735e23cb50 con 0x55735e24f420 2023-12-19T05:39:10.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff624209740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55735e25f000 con 0x55735e23b750 2023-12-19T05:39:10.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff61a7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e2ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff61a7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e2ac180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45670/0 (socket says 172.21.15.120:45670) 2023-12-19T05:39:10.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff61a7fc640 1 -- 172.21.15.120:0/2159234176 learned_addr learned my addr 172.21.15.120:0/2159234176 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:10.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff61a7fc640 1 -- 172.21.15.120:0/2159234176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e23b750 msgr2=0x55735e2ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:10.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff61b7fe640 1 --2- 172.21.15.120:0/2159234176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e24a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff61a7fc640 1 --2- 172.21.15.120:0/2159234176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e23b750 0x55735e2ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff61a7fc640 1 -- 172.21.15.120:0/2159234176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 msgr2=0x55735e24a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:10.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff61a7fc640 1 --2- 172.21.15.120:0/2159234176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e24a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff61a7fc640 1 -- 172.21.15.120:0/2159234176 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55735e11cb60 con 0x55735e244d00 2023-12-19T05:39:10.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff61b7fe640 1 --2- 172.21.15.120:0/2159234176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e24a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:10.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff61a7fc640 1 --2- 172.21.15.120:0/2159234176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e2ac180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff6100098c0 tx=0x7ff610030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6c74a3b70d15ff server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:10.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff6017fa640 1 -- 172.21.15.120:0/2159234176 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61003e040 con 0x55735e244d00 2023-12-19T05:39:10.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff6017fa640 1 -- 172.21.15.120:0/2159234176 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff610049430 con 0x55735e244d00 2023-12-19T05:39:10.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.657+0000 7ff6017fa640 1 -- 172.21.15.120:0/2159234176 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610030cd0 con 0x55735e244d00 2023-12-19T05:39:10.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.658+0000 7ff624209740 1 -- 172.21.15.120:0/2159234176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 msgr2=0x55735e2ac180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.658+0000 7ff624209740 1 --2- 172.21.15.120:0/2159234176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e2ac180 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff6100098c0 tx=0x7ff610030000 comp rx=0 tx=0).stop 2023-12-19T05:39:10.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.658+0000 7ff624209740 1 -- 172.21.15.120:0/2159234176 shutdown_connections 2023-12-19T05:39:10.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.658+0000 7ff624209740 1 --2- 172.21.15.120:0/2159234176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e24a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.658+0000 7ff624209740 1 --2- 172.21.15.120:0/2159234176 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e244d00 0x55735e2ac180 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.658+0000 7ff624209740 1 --2- 172.21.15.120:0/2159234176 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e23b750 0x55735e2ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.658+0000 7ff624209740 1 -- 172.21.15.120:0/2159234176 >> 172.21.15.120:0/2159234176 conn(0x55735e213af0 msgr2=0x55735e20e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:10.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.658+0000 7ff624209740 1 -- 172.21.15.120:0/2159234176 shutdown_connections 2023-12-19T05:39:10.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.658+0000 7ff624209740 1 -- 172.21.15.120:0/2159234176 wait complete. 2023-12-19T05:39:10.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.658+0000 7ff624209740 1 -- start start 2023-12-19T05:39:10.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.658+0000 7ff624209740 1 Processor -- start 2023-12-19T05:39:10.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff624209740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e23b750 0x55735e2618c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff624209740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e244d00 0x55735e2aa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff624209740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e2aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff624209740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735e258e90 con 0x55735e23b750 2023-12-19T05:39:10.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff624209740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x55735e258390 con 0x55735e24f420 2023-12-19T05:39:10.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff624209740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x55735e2189b0 con 0x55735e244d00 2023-12-19T05:39:10.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff624209740 10 client.0 _ll_register_callbacks cb 0x7ff610009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:39:10.669 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff61affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e23b750 0x55735e2618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.669 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff61affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e23b750 0x55735e2618c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45674/0 (socket says 172.21.15.120:45674) 2023-12-19T05:39:10.669 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff61affd640 1 -- 172.21.15.120:0/1540551411 learned_addr learned my addr 172.21.15.120:0/1540551411 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:10.669 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff61b7fe640 1 --2- 172.21.15.120:0/1540551411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e2aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.669 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff61a7fc640 1 --2- 172.21.15.120:0/1540551411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e244d00 0x55735e2aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.669 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff61affd640 1 -- 172.21.15.120:0/1540551411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e244d00 msgr2=0x55735e2aa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:10.669 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff61affd640 1 --2- 172.21.15.120:0/1540551411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e244d00 0x55735e2aa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.669 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff61affd640 1 -- 172.21.15.120:0/1540551411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 msgr2=0x55735e2aaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:10.669 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff61affd640 1 --2- 172.21.15.120:0/1540551411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e2aaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.669 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff61affd640 1 -- 172.21.15.120:0/1540551411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c0bc9c0 con 0x55735e23b750 2023-12-19T05:39:10.669 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff61b7fe640 1 --2- 172.21.15.120:0/1540551411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e2aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:10.670 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff61affd640 1 --2- 172.21.15.120:0/1540551411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e23b750 0x55735e2618c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff60c000fa0 tx=0x7ff60c007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=482520be5a7e0185 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:10.670 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.659+0000 7ff5f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2023-12-19T05:39:10.670 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff5f9ffb640 1 -- 172.21.15.120:0/1540551411 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0138b0 con 0x55735e23b750 2023-12-19T05:39:10.670 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff5f9ffb640 1 -- 172.21.15.120:0/1540551411 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff60c013a10 con 0x55735e23b750 2023-12-19T05:39:10.670 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff624209740 1 -- 172.21.15.120:0/1540551411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55735e174e50 con 0x55735e23b750 2023-12-19T05:39:10.670 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff5f9ffb640 1 -- 172.21.15.120:0/1540551411 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff60c013e80 con 0x55735e23b750 2023-12-19T05:39:10.670 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff624209740 10 client.4680 fetch_fsmap learned FSMap version 7 2023-12-19T05:39:10.670 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff624209740 1 -- 172.21.15.120:0/1540551411 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55735e142270 con 0x55735e23b750 2023-12-19T05:39:10.670 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff5f9ffb640 1 -- 172.21.15.120:0/1540551411 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55735e174e50 con 0x55735e23b750 2023-12-19T05:39:10.670 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff5f9ffb640 1 -- 172.21.15.120:0/1540551411 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 7) v1 ==== 2561+0+0 (secure 0 0 0) 0x7ff60c044470 con 0x55735e23b750 2023-12-19T05:39:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff624209740 10 client.4680 fetch_fsmap finished waiting for FSMap version 7 2023-12-19T05:39:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff624209740 10 client.4680 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T05:39:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff624209740 20 client.4680 populate_metadata read hostname 'smithi120' 2023-12-19T05:39:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff624209740 1 --2- 172.21.15.120:0/1540551411 >> [v2:172.21.15.120:6835/1608902018,v1:172.21.15.120:6837/1608902018] conn(0x55735e2ac230 0x55735e23f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff624209740 4 client.4680 mds_command: new command op to 4278 tid=0[{"prefix": "status"}] 2023-12-19T05:39:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff624209740 1 -- 172.21.15.120:0/1540551411 --> [v2:172.21.15.120:6835/1608902018,v1:172.21.15.120:6837/1608902018] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55735de816c0 con 0x55735e2ac230 2023-12-19T05:39:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff61a7fc640 1 --2- 172.21.15.120:0/1540551411 >> [v2:172.21.15.120:6835/1608902018,v1:172.21.15.120:6837/1608902018] conn(0x55735e2ac230 0x55735e23f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff61a7fc640 1 --2- 172.21.15.120:0/1540551411 >> [v2:172.21.15.120:6835/1608902018,v1:172.21.15.120:6837/1608902018] conn(0x55735e2ac230 0x55735e23f3c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21ad13764cfda7f3 server_cookie=2f49cb0e6e3dd17f in_seq=0 out_seq=0 2023-12-19T05:39:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff5f9ffb640 10 client.4680 ms_handle_connect on v2:172.21.15.120:6835/1608902018 2023-12-19T05:39:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff5f9ffb640 1 -- 172.21.15.120:0/1540551411 <== mds.0 v2:172.21.15.120:6835/1608902018 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+317 (crc 0 0 0) 0x55735de816c0 con 0x55735e2ac230 2023-12-19T05:39:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.660+0000 7ff5f9ffb640 10 client.4680 handle_command_reply: tid=0 2023-12-19T05:39:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff624209740 1 client.4680 shutdown 2023-12-19T05:39:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff624209740 1 -- 172.21.15.120:0/1540551411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e23b750 msgr2=0x55735e2618c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.671 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff624209740 1 --2- 172.21.15.120:0/1540551411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e23b750 0x55735e2618c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff60c000fa0 tx=0x7ff60c007e20 comp rx=0 tx=0).stop 2023-12-19T05:39:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff624209740 1 -- 172.21.15.120:0/1540551411 shutdown_connections 2023-12-19T05:39:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff624209740 1 --2- 172.21.15.120:0/1540551411 >> [v2:172.21.15.120:6835/1608902018,v1:172.21.15.120:6837/1608902018] conn(0x55735e2ac230 0x55735e23f3c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff624209740 1 --2- 172.21.15.120:0/1540551411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55735e24f420 0x55735e2aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff624209740 1 --2- 172.21.15.120:0/1540551411 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x55735e244d00 0x55735e2aa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff5f9ffb640 0 client.4680 ms_handle_reset on v2:172.21.15.120:6835/1608902018 2023-12-19T05:39:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff624209740 1 --2- 172.21.15.120:0/1540551411 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x55735e23b750 0x55735e2618c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff624209740 1 -- 172.21.15.120:0/1540551411 >> 172.21.15.120:0/1540551411 conn(0x55735e213af0 msgr2=0x55735e24b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff624209740 1 -- 172.21.15.120:0/1540551411 shutdown_connections 2023-12-19T05:39:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff624209740 1 -- 172.21.15.120:0/1540551411 wait complete. 2023-12-19T05:39:10.672 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff624209740 20 client.4680 trim_cache size 0 max 16384 2023-12-19T05:39:10.673 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2023-12-19T05:39:10.673 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "90961127-a1a1-4949-bae3-e6c73f63cc7e", 2023-12-19T05:39:10.673 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2023-12-19T05:39:10.673 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4278, 2023-12-19T05:39:10.673 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2023-12-19T05:39:10.673 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2023-12-19T05:39:10.673 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2023-12-19T05:39:10.673 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 12.578312385, 2023-12-19T05:39:10.673 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 7, 2023-12-19T05:39:10.673 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 20, 2023-12-19T05:39:10.673 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 20, 2023-12-19T05:39:10.674 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 18.97394774 2023-12-19T05:39:10.674 INFO:teuthology.orchestra.run.smithi120.stdout:} 2023-12-19T05:39:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff6215c4640 1 -- 172.21.15.120:0/3047538707 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff60806a430 msgr2=0x7ff60806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff6215c4640 1 --2- 172.21.15.120:0/3047538707 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff60806a430 0x7ff60806c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff60c007fd0 tx=0x7ff60c009040 comp rx=0 tx=0).stop 2023-12-19T05:39:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff6215c4640 1 -- 172.21.15.120:0/3047538707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff61c0b8e90 msgr2=0x7ff61c0bf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff6215c4640 1 --2- 172.21.15.120:0/3047538707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff61c0b8e90 0x7ff61c0bf3f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff61400c7e0 tx=0x7ff61400cca0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff6215c4640 1 -- 172.21.15.120:0/3047538707 shutdown_connections 2023-12-19T05:39:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff6215c4640 1 --2- 172.21.15.120:0/3047538707 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff60806a430 0x7ff60806c8f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff6215c4640 1 --2- 172.21.15.120:0/3047538707 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff61c0b8e90 0x7ff61c0bf3f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.675 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff6215c4640 1 --2- 172.21.15.120:0/3047538707 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff61c0b8790 0x7ff61c147c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff6215c4640 1 --2- 172.21.15.120:0/3047538707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff61c0b7750 0x7ff61c1456c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff6215c4640 1 -- 172.21.15.120:0/3047538707 >> 172.21.15.120:0/3047538707 conn(0x7ff61c0c0350 msgr2=0x7ff61c0b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff6215c4640 1 -- 172.21.15.120:0/3047538707 shutdown_connections 2023-12-19T05:39:10.676 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.661+0000 7ff6215c4640 1 -- 172.21.15.120:0/3047538707 wait complete. 2023-12-19T05:39:10.676 INFO:teuthology.run_tasks:Running task kclient... 2023-12-19T05:39:10.700 INFO:tasks.kclient:Mounting kernel clients... 2023-12-19T05:39:10.700 INFO:tasks.kclient:config is {'client.0': {}} 2023-12-19T05:39:10.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:10.701 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-12-19T05:39:10.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:10.762 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link delete ceph-brx 2023-12-19T05:39:10.863 INFO:teuthology.orchestra.run.smithi188.stderr:Cannot find device "ceph-brx" 2023-12-19T05:39:10.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T05:39:10.867 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-19T05:39:10.867 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T05:39:10.867 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:39:10.868 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:39:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.966+0000 7f68b1fa4640 1 Processor -- start 2023-12-19T05:39:10.967 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.966+0000 7f68b1fa4640 1 -- start start 2023-12-19T05:39:10.969 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.966+0000 7f68b1fa4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f68ac0b7960 0x7f68ac0bb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.966+0000 7f68b1fa4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68ac14a9d0 0x7f68ac0b8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.966+0000 7f68b1fa4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f68ac140da0 0x7f68ac141210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.966+0000 7f68b1fa4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ac0bb2f0 con 0x7f68ac140da0 2023-12-19T05:39:10.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.966+0000 7f68b1fa4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ac0bbc50 con 0x7f68ac0b7960 2023-12-19T05:39:10.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.966+0000 7f68b1fa4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac0bac70 con 0x7f68ac14a9d0 2023-12-19T05:39:10.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.967+0000 7f68abfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f68ac140da0 0x7f68ac141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.967+0000 7f68abfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f68ac140da0 0x7f68ac141210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45684/0 (socket says 172.21.15.120:45684) 2023-12-19T05:39:10.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.967+0000 7f68abfff640 1 -- 172.21.15.120:0/1646601290 learned_addr learned my addr 172.21.15.120:0/1646601290 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:10.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.967+0000 7f68ab7fe640 1 --2- 172.21.15.120:0/1646601290 >> v2:172.21.15.155:3300/0 conn(0x7f68ac0b7960 0x7f68ac0bb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.967+0000 7f68aaffd640 1 --2- 172.21.15.120:0/1646601290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68ac14a9d0 0x7f68ac0b8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.967+0000 7f68abfff640 1 -- 172.21.15.120:0/1646601290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68ac14a9d0 msgr2=0x7f68ac0b8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:10.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.967+0000 7f68abfff640 1 --2- 172.21.15.120:0/1646601290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68ac14a9d0 0x7f68ac0b8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.967+0000 7f68abfff640 1 -- 172.21.15.120:0/1646601290 >> v2:172.21.15.155:3300/0 conn(0x7f68ac0b7960 msgr2=0x7f68ac0bb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:10.970 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.967+0000 7f68abfff640 1 --2- 172.21.15.120:0/1646601290 >> v2:172.21.15.155:3300/0 conn(0x7f68ac0b7960 0x7f68ac0bb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.967+0000 7f68abfff640 1 -- 172.21.15.120:0/1646601290 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac0bbe10 con 0x7f68ac140da0 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.967+0000 7f68ab7fe640 1 --2- 172.21.15.120:0/1646601290 >> v2:172.21.15.155:3300/0 conn(0x7f68ac0b7960 0x7f68ac0bb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.967+0000 7f68abfff640 1 --2- 172.21.15.120:0/1646601290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68ac140da0 0x7f68ac141210 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f68ac071da0 tx=0x7f68a402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a1e56a59359e61 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.968+0000 7f68aa7fc640 1 -- 172.21.15.120:0/1646601290 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a402ca70 con 0x7f68ac140da0 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.968+0000 7f68aa7fc640 1 -- 172.21.15.120:0/1646601290 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a402cbd0 con 0x7f68ac140da0 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.968+0000 7f68aa7fc640 1 -- 172.21.15.120:0/1646601290 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a40343f0 con 0x7f68ac140da0 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.968+0000 7f68b1fa4640 1 -- 172.21.15.120:0/1646601290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68ac140da0 msgr2=0x7f68ac141210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.968+0000 7f68b1fa4640 1 --2- 172.21.15.120:0/1646601290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68ac140da0 0x7f68ac141210 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f68ac071da0 tx=0x7f68a402bed0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.968+0000 7f68b1fa4640 1 -- 172.21.15.120:0/1646601290 shutdown_connections 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.968+0000 7f68b1fa4640 1 --2- 172.21.15.120:0/1646601290 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68ac140da0 0x7f68ac141210 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.968+0000 7f68b1fa4640 1 --2- 172.21.15.120:0/1646601290 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68ac14a9d0 0x7f68ac0b8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.968+0000 7f68b1fa4640 1 --2- 172.21.15.120:0/1646601290 >> v2:172.21.15.155:3300/0 conn(0x7f68ac0b7960 0x7f68ac0bb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.968+0000 7f68b1fa4640 1 -- 172.21.15.120:0/1646601290 >> 172.21.15.120:0/1646601290 conn(0x7f68ac0b6b50 msgr2=0x7f68ac071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.968+0000 7f68b1fa4640 1 -- 172.21.15.120:0/1646601290 shutdown_connections 2023-12-19T05:39:10.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.968+0000 7f68b1fa4640 1 -- 172.21.15.120:0/1646601290 wait complete. 2023-12-19T05:39:10.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.969+0000 7f68b1fa4640 1 Processor -- start 2023-12-19T05:39:10.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.969+0000 7f68b1fa4640 1 -- start start 2023-12-19T05:39:10.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68b1fa4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68ac0b7960 0x7f68ac1dff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68b1fa4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68ac140da0 0x7f68ac1423c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68b1fa4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68ac14a9d0 0x7f68ac142900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68b1fa4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac1dfb10 con 0x7f68ac140da0 2023-12-19T05:39:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68b1fa4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac1df790 con 0x7f68ac0b7960 2023-12-19T05:39:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68b1fa4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac1437a0 con 0x7f68ac14a9d0 2023-12-19T05:39:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68aaffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68ac140da0 0x7f68ac1423c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68aaffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68ac140da0 0x7f68ac1423c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:45692/0 (socket says 172.21.15.120:45692) 2023-12-19T05:39:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68aaffd640 1 -- 172.21.15.120:0/4129884884 learned_addr learned my addr 172.21.15.120:0/4129884884 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68abfff640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68ac14a9d0 0x7f68ac142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68ab7fe640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68ac0b7960 0x7f68ac1dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68aaffd640 1 -- 172.21.15.120:0/4129884884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68ac14a9d0 msgr2=0x7f68ac142900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68aaffd640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68ac14a9d0 0x7f68ac142900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68aaffd640 1 -- 172.21.15.120:0/4129884884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68ac0b7960 msgr2=0x7f68ac1dff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68aaffd640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68ac0b7960 0x7f68ac1dff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68aaffd640 1 -- 172.21.15.120:0/4129884884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a4009b30 con 0x7f68ac140da0 2023-12-19T05:39:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.970+0000 7f68abfff640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68ac14a9d0 0x7f68ac142900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:10.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.971+0000 7f68aaffd640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68ac140da0 0x7f68ac1423c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f68a000d5f0 tx=0x7f68a000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:10.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.971+0000 7f6893fff640 1 -- 172.21.15.120:0/4129884884 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a00125f0 con 0x7f68ac140da0 2023-12-19T05:39:10.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.971+0000 7f68b1fa4640 1 -- 172.21.15.120:0/4129884884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ac149fe0 con 0x7f68ac140da0 2023-12-19T05:39:10.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.971+0000 7f6893fff640 1 -- 172.21.15.120:0/4129884884 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a0012750 con 0x7f68ac140da0 2023-12-19T05:39:10.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.971+0000 7f6893fff640 1 -- 172.21.15.120:0/4129884884 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a0012b00 con 0x7f68ac140da0 2023-12-19T05:39:10.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.971+0000 7f68b1fa4640 1 -- 172.21.15.120:0/4129884884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ac0bf000 con 0x7f68ac140da0 2023-12-19T05:39:10.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.972+0000 7f68b1fa4640 1 -- 172.21.15.120:0/4129884884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ac04e080 con 0x7f68ac140da0 2023-12-19T05:39:10.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.972+0000 7f6893fff640 1 -- 172.21.15.120:0/4129884884 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f68a0012c60 con 0x7f68ac140da0 2023-12-19T05:39:10.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.972+0000 7f6893fff640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f689806a460 0x7f689806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:10.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.973+0000 7f68ab7fe640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f689806a460 0x7f689806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:10.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.973+0000 7f6893fff640 1 -- 172.21.15.120:0/4129884884 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68a0088d60 con 0x7f68ac140da0 2023-12-19T05:39:10.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.973+0000 7f68ab7fe640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f689806a460 0x7f689806c920 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f689c009950 tx=0x7f689c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:10.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:10.977+0000 7f6893fff640 1 -- 172.21.15.120:0/4129884884 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f68a00542d0 con 0x7f68ac140da0 2023-12-19T05:39:11.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:11.177+0000 7f68b1fa4640 1 -- 172.21.15.120:0/4129884884 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f68ac0bf6d0 con 0x7f68ac140da0 2023-12-19T05:39:11.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:11.177+0000 7f6893fff640 1 -- 172.21.15.120:0/4129884884 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f68a00578f0 con 0x7f68ac140da0 2023-12-19T05:39:11.180 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:39:11.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:11.179+0000 7f68b1fa4640 1 -- 172.21.15.120:0/4129884884 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f689806a460 msgr2=0x7f689806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:11.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:11.179+0000 7f68b1fa4640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f689806a460 0x7f689806c920 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f689c009950 tx=0x7f689c008040 comp rx=0 tx=0).stop 2023-12-19T05:39:11.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:11.179+0000 7f68b1fa4640 1 -- 172.21.15.120:0/4129884884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68ac140da0 msgr2=0x7f68ac1423c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:11.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:11.179+0000 7f68b1fa4640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68ac140da0 0x7f68ac1423c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f68a000d5f0 tx=0x7f68a000dab0 comp rx=0 tx=0).stop 2023-12-19T05:39:11.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:11.179+0000 7f68b1fa4640 1 -- 172.21.15.120:0/4129884884 shutdown_connections 2023-12-19T05:39:11.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:11.179+0000 7f68b1fa4640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f689806a460 0x7f689806c920 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:11.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:11.179+0000 7f68b1fa4640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f68ac14a9d0 0x7f68ac142900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:11.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:11.179+0000 7f68b1fa4640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f68ac140da0 0x7f68ac1423c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:11.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:11.179+0000 7f68b1fa4640 1 --2- 172.21.15.120:0/4129884884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68ac0b7960 0x7f68ac1dff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:11.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:11.179+0000 7f68b1fa4640 1 -- 172.21.15.120:0/4129884884 >> 172.21.15.120:0/4129884884 conn(0x7f68ac0b6b50 msgr2=0x7f68ac0c0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:11.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:11.179+0000 7f68b1fa4640 1 -- 172.21.15.120:0/4129884884 shutdown_connections 2023-12-19T05:39:11.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:11.179+0000 7f68b1fa4640 1 -- 172.21.15.120:0/4129884884 wait complete. 2023-12-19T05:39:11.192 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T05:39:11.193 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:39:11.193 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi188.front.sepia.ceph.com 2023-12-19T05:39:11.193 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T05:39:11.193 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:39:11.193 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T05:39:11.193 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T05:39:11.193 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:39:11.193 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:39:11.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:11.193 DEBUG:teuthology.orchestra.run.smithi188:> ip addr 2023-12-19T05:39:11.253 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:39:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:39:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:39:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2023-12-19T05:39:11.253 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:11.254 INFO:teuthology.orchestra.run.smithi188.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:48 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f0 2023-12-19T05:39:11.254 INFO:teuthology.orchestra.run.smithi188.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:49 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f1 2023-12-19T05:39:11.254 INFO:teuthology.orchestra.run.smithi188.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:38 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:11.254 INFO:teuthology.orchestra.run.smithi188.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:39:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:39 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: inet 172.21.15.188/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T05:39:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft 42369sec preferred_lft 42369sec 2023-12-19T05:39:11.254 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::ec4:7aff:fe88:8039/64 scope link 2023-12-19T05:39:11.255 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:11.256 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T05:39:11.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:11.256 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-12-19T05:39:11.256 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-12-19T05:39:11.256 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link add name ceph-brx type bridge 2023-12-19T05:39:11.256 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip addr flush dev ceph-brx 2023-12-19T05:39:11.256 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set ceph-brx up 2023-12-19T05:39:11.257 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T05:39:11.257 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-12-19T05:39:11.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:11.724 DEBUG:teuthology.orchestra.run.smithi188:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:39:11.800 INFO:teuthology.orchestra.run.smithi188.stdout:1 2023-12-19T05:39:11.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:11.804 DEBUG:teuthology.orchestra.run.smithi188:> route 2023-12-19T05:39:11.867 INFO:teuthology.orchestra.run.smithi188.stdout:Kernel IP routing table 2023-12-19T05:39:11.867 INFO:teuthology.orchestra.run.smithi188.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:39:11.867 INFO:teuthology.orchestra.run.smithi188.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T05:39:11.867 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T05:39:11.867 INFO:teuthology.orchestra.run.smithi188.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:39:11.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:11.868 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-12-19T05:39:11.868 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-12-19T05:39:11.868 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T05:39:11.868 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T05:39:11.868 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T05:39:11.868 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-12-19T05:39:12.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:12.651 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-12-19T05:39:12.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:12.708 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list-id 2023-12-19T05:39:12.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:12.762 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-12-19T05:39:12.762 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-12-19T05:39:12.762 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:39:12.762 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-19T05:39:12.762 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-12-19T05:39:12.904 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-19T05:39:12.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:12.905 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-12-19T05:39:12.905 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-12-19T05:39:12.905 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-19T05:39:12.905 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T05:39:12.905 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-19T05:39:12.906 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-19T05:39:12.906 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-19T05:39:12.906 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-12-19T05:39:13.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:13.195 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-12-19T05:39:13.195 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-12-19T05:39:13.195 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set brx.0 up 2023-12-19T05:39:13.195 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T05:39:13.195 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-12-19T05:39:13.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:39:13.356 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T05:39:13.405 INFO:teuthology.orchestra.run.smithi188.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:39:13.405 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:39:13.405 DEBUG:teuthology.orchestra.run.smithi188:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:39:13.502 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-19T05:39:13.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:13.503 DEBUG:teuthology.orchestra.run.smithi188:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T05:39:13.650 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T05:39:13.651 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T05:39:13.651 INFO:teuthology.orchestra.run.smithi188.stdout:invalid new device string format 2023-12-19T05:39:14.107 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T05:39:14.107 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T05:39:14.107 INFO:teuthology.orchestra.run.smithi188.stdout:invalid new device string format 2023-12-19T05:39:14.107 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-12-19T05:39:14.107 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T05:39:14.139 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T05:39:14.139 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T05:39:14.139 INFO:teuthology.orchestra.run.smithi188.stdout:invalid new device string format 2023-12-19T05:39:14.139 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-12-19T05:39:14.139 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T05:39:14.139 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.120:6789,172.21.15.155:6789,172.21.15.155:6790" 2023-12-19T05:39:14.139 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.120:6789,172.21.15.155:6789,172.21.15.155:6790:/ 2023-12-19T05:39:14.139 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=90961127-a1a1-4949-bae3-e6c73f63cc7e" will pass to kernel 2023-12-19T05:39:14.146 INFO:teuthology.orchestra.run.smithi188.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T05:39:14.146 INFO:teuthology.orchestra.run.smithi188.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:39:14.146 INFO:teuthology.orchestra.run.smithi188.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:39:14.146 INFO:teuthology.orchestra.run.smithi188.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:39:14.146 INFO:teuthology.orchestra.run.smithi188.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:39:14.152 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:39:14.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:14.152 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:39:14.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:14.244 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:14.307 INFO:teuthology.orchestra.run.smithi188.stdout:client4689 2023-12-19T05:39:14.307 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:39:14.307 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:14.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:14.364 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:14.426 INFO:teuthology.orchestra.run.smithi188.stdout:client4689 2023-12-19T05:39:14.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:14.426 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:14.491 INFO:teuthology.orchestra.run.smithi188.stdout:client4689 2023-12-19T05:39:14.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:14.491 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/90961127-a1a1-4949-bae3-e6c73f63cc7e.client4689/status') 2023-12-19T05:39:14.582 INFO:teuthology.orchestra.run.smithi188.stdout:instance: client.4689 (3)172.21.15.188:0/548742107 2023-12-19T05:39:14.582 INFO:teuthology.orchestra.run.smithi188.stdout:blocklisted: false 2023-12-19T05:39:14.582 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records in 2023-12-19T05:39:14.582 INFO:teuthology.orchestra.run.smithi188.stderr:0+1 records out 2023-12-19T05:39:14.582 INFO:teuthology.orchestra.run.smithi188.stderr:70 bytes copied, 5.9174e-05 s, 1.2 MB/s 2023-12-19T05:39:14.586 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-19T05:39:14.603 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:14.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.712+0000 7f677ffd9640 1 Processor -- start 2023-12-19T05:39:14.714 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.712+0000 7f677ffd9640 1 -- start start 2023-12-19T05:39:14.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.712+0000 7f677ffd9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f677806a390 0x7f67781416d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.712+0000 7f677ffd9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f67780b2e50 0x7f677814abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.712+0000 7f677ffd9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f67780b80a0 0x7f677814b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.712+0000 7f677ffd9640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6778071a60 con 0x7f67780b80a0 2023-12-19T05:39:14.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.712+0000 7f677ffd9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67780715d0 con 0x7f67780b2e50 2023-12-19T05:39:14.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.712+0000 7f677ffd9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6778070ca0 con 0x7f677806a390 2023-12-19T05:39:14.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.713+0000 7f677e576640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f67780b80a0 0x7f677814b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.713+0000 7f677e576640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f67780b80a0 0x7f677814b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47350/0 (socket says 172.21.15.120:47350) 2023-12-19T05:39:14.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.713+0000 7f677e576640 1 -- 172.21.15.120:0/3386202198 learned_addr learned my addr 172.21.15.120:0/3386202198 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:14.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.713+0000 7f677dd75640 1 --2- 172.21.15.120:0/3386202198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f677806a390 0x7f67781416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.716 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.713+0000 7f677d574640 1 --2- 172.21.15.120:0/3386202198 >> v2:172.21.15.155:3300/0 conn(0x7f67780b2e50 0x7f677814abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.713+0000 7f677e576640 1 -- 172.21.15.120:0/3386202198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f677806a390 msgr2=0x7f67781416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:14.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.713+0000 7f677e576640 1 --2- 172.21.15.120:0/3386202198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f677806a390 0x7f67781416d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.713+0000 7f677e576640 1 -- 172.21.15.120:0/3386202198 >> v2:172.21.15.155:3300/0 conn(0x7f67780b2e50 msgr2=0x7f677814abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:14.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.713+0000 7f677e576640 1 --2- 172.21.15.120:0/3386202198 >> v2:172.21.15.155:3300/0 conn(0x7f67780b2e50 0x7f677814abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.713+0000 7f677e576640 1 -- 172.21.15.120:0/3386202198 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6778070f80 con 0x7f67780b80a0 2023-12-19T05:39:14.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.713+0000 7f677dd75640 1 --2- 172.21.15.120:0/3386202198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f677806a390 0x7f67781416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:14.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.713+0000 7f677d574640 1 --2- 172.21.15.120:0/3386202198 >> v2:172.21.15.155:3300/0 conn(0x7f67780b2e50 0x7f677814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:14.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.714+0000 7f677e576640 1 --2- 172.21.15.120:0/3386202198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67780b80a0 0x7f677814b120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f677806aea0 tx=0x7f677002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c402018bb2b655 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:14.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.714+0000 7f677cd73640 1 -- 172.21.15.120:0/3386202198 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677002ca70 con 0x7f67780b80a0 2023-12-19T05:39:14.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.714+0000 7f677cd73640 1 -- 172.21.15.120:0/3386202198 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677002cbd0 con 0x7f67780b80a0 2023-12-19T05:39:14.717 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.714+0000 7f677cd73640 1 -- 172.21.15.120:0/3386202198 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67700343f0 con 0x7f67780b80a0 2023-12-19T05:39:14.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.714+0000 7f677ffd9640 1 -- 172.21.15.120:0/3386202198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67780b80a0 msgr2=0x7f677814b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.714+0000 7f677ffd9640 1 --2- 172.21.15.120:0/3386202198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67780b80a0 0x7f677814b120 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f677806aea0 tx=0x7f677002bed0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.719 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.714+0000 7f677ffd9640 1 -- 172.21.15.120:0/3386202198 shutdown_connections 2023-12-19T05:39:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.714+0000 7f677ffd9640 1 --2- 172.21.15.120:0/3386202198 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f67780b80a0 0x7f677814b120 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.714+0000 7f677ffd9640 1 --2- 172.21.15.120:0/3386202198 >> v2:172.21.15.155:3300/0 conn(0x7f67780b2e50 0x7f677814abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.714+0000 7f677ffd9640 1 --2- 172.21.15.120:0/3386202198 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f677806a390 0x7f67781416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.714+0000 7f677ffd9640 1 -- 172.21.15.120:0/3386202198 >> 172.21.15.120:0/3386202198 conn(0x7f67780b8dd0 msgr2=0x7f67780b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.714+0000 7f677ffd9640 1 -- 172.21.15.120:0/3386202198 shutdown_connections 2023-12-19T05:39:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.715+0000 7f677ffd9640 1 -- 172.21.15.120:0/3386202198 wait complete. 2023-12-19T05:39:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.715+0000 7f677ffd9640 1 Processor -- start 2023-12-19T05:39:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.716+0000 7f677ffd9640 1 -- start start 2023-12-19T05:39:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.716+0000 7f677ffd9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f677806a390 0x7f6778147940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.716+0000 7f677ffd9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67780b2e50 0x7f67781dd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.716+0000 7f677ffd9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67780b80a0 0x7f677813b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.716+0000 7f677ffd9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6778147e80 con 0x7f677806a390 2023-12-19T05:39:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.716+0000 7f677ffd9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6778142150 con 0x7f67780b80a0 2023-12-19T05:39:14.720 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.716+0000 7f677ffd9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67781425e0 con 0x7f67780b2e50 2023-12-19T05:39:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.716+0000 7f677dd75640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f677806a390 0x7f6778147940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.716+0000 7f677dd75640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f677806a390 0x7f6778147940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47354/0 (socket says 172.21.15.120:47354) 2023-12-19T05:39:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.716+0000 7f677dd75640 1 -- 172.21.15.120:0/1767807356 learned_addr learned my addr 172.21.15.120:0/1767807356 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.716+0000 7f677dd75640 1 -- 172.21.15.120:0/1767807356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67780b2e50 msgr2=0x7f67781dd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.717+0000 7f677dd75640 1 --2- 172.21.15.120:0/1767807356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67780b2e50 0x7f67781dd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.717+0000 7f677dd75640 1 -- 172.21.15.120:0/1767807356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67780b80a0 msgr2=0x7f677813b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.717+0000 7f677dd75640 1 --2- 172.21.15.120:0/1767807356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67780b80a0 0x7f677813b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.717+0000 7f677dd75640 1 -- 172.21.15.120:0/1767807356 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6770009b30 con 0x7f677806a390 2023-12-19T05:39:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.717+0000 7f677dd75640 1 --2- 172.21.15.120:0/1767807356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f677806a390 0x7f6778147940 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f677400c7f0 tx=0x7f677400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.717+0000 7f676e7fc640 1 -- 172.21.15.120:0/1767807356 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67740079d0 con 0x7f677806a390 2023-12-19T05:39:14.721 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.717+0000 7f677ffd9640 1 -- 172.21.15.120:0/1767807356 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677814a640 con 0x7f677806a390 2023-12-19T05:39:14.722 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.717+0000 7f676e7fc640 1 -- 172.21.15.120:0/1767807356 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6774007b30 con 0x7f677806a390 2023-12-19T05:39:14.722 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.717+0000 7f676e7fc640 1 -- 172.21.15.120:0/1767807356 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677400ce40 con 0x7f677806a390 2023-12-19T05:39:14.722 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.717+0000 7f677ffd9640 1 -- 172.21.15.120:0/1767807356 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6778143ce0 con 0x7f677806a390 2023-12-19T05:39:14.723 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.718+0000 7f677ffd9640 1 -- 172.21.15.120:0/1767807356 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6778143f00 con 0x7f677806a390 2023-12-19T05:39:14.723 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.720+0000 7f676e7fc640 1 -- 172.21.15.120:0/1767807356 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6774024480 con 0x7f677806a390 2023-12-19T05:39:14.723 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.720+0000 7f676e7fc640 1 --2- 172.21.15.120:0/1767807356 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f675c06a460 0x7f675c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:14.723 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.721+0000 7f676e7fc640 1 -- 172.21.15.120:0/1767807356 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6774088f80 con 0x7f677806a390 2023-12-19T05:39:14.723 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.721+0000 7f677d574640 1 --2- 172.21.15.120:0/1767807356 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f675c06a460 0x7f675c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:14.723 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.721+0000 7f677d574640 1 --2- 172.21.15.120:0/1767807356 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f675c06a460 0x7f675c06c920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6768006b10 tx=0x7f6768008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:14.726 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.724+0000 7f676e7fc640 1 -- 172.21.15.120:0/1767807356 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6774054570 con 0x7f677806a390 2023-12-19T05:39:14.894 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.892+0000 7f677ffd9640 1 -- 172.21.15.120:0/1767807356 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67780bcd10 con 0x7f677806a390 2023-12-19T05:39:14.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.893+0000 7f676e7fc640 1 -- 172.21.15.120:0/1767807356 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f6774057b90 con 0x7f677806a390 2023-12-19T05:39:14.895 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:14.896 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:14.897 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.895+0000 7f677ffd9640 1 -- 172.21.15.120:0/1767807356 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f675c06a460 msgr2=0x7f675c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.897 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.895+0000 7f677ffd9640 1 --2- 172.21.15.120:0/1767807356 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f675c06a460 0x7f675c06c920 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6768006b10 tx=0x7f6768008040 comp rx=0 tx=0).stop 2023-12-19T05:39:14.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.895+0000 7f677ffd9640 1 -- 172.21.15.120:0/1767807356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f677806a390 msgr2=0x7f6778147940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:14.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.895+0000 7f677ffd9640 1 --2- 172.21.15.120:0/1767807356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f677806a390 0x7f6778147940 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f677400c7f0 tx=0x7f677400cbf0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.895+0000 7f677ffd9640 1 -- 172.21.15.120:0/1767807356 shutdown_connections 2023-12-19T05:39:14.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.895+0000 7f677ffd9640 1 --2- 172.21.15.120:0/1767807356 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f675c06a460 0x7f675c06c920 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.895+0000 7f677ffd9640 1 --2- 172.21.15.120:0/1767807356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f67780b80a0 0x7f677813b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.895+0000 7f677ffd9640 1 --2- 172.21.15.120:0/1767807356 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f67780b2e50 0x7f67781dd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.895+0000 7f677ffd9640 1 --2- 172.21.15.120:0/1767807356 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f677806a390 0x7f6778147940 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:14.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.895+0000 7f677ffd9640 1 -- 172.21.15.120:0/1767807356 >> 172.21.15.120:0/1767807356 conn(0x7f67780b8dd0 msgr2=0x7f67780bc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:14.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.895+0000 7f677ffd9640 1 -- 172.21.15.120:0/1767807356 shutdown_connections 2023-12-19T05:39:14.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:14.895+0000 7f677ffd9640 1 -- 172.21.15.120:0/1767807356 wait complete. 2023-12-19T05:39:14.908 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:45.976868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:38:56.035188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:38:57.050130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:14.908 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:15.010 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.007+0000 7f9bb2431640 1 Processor -- start 2023-12-19T05:39:15.010 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.007+0000 7f9bb2431640 1 -- start start 2023-12-19T05:39:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.008+0000 7f9bb2431640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9bac071970 0x7f9bac0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.008+0000 7f9bb2431640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bac06fef0 con 0x7f9bac14aa80 2023-12-19T05:39:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.008+0000 7f9bb2431640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bac0b40b0 con 0x7f9bac069f70 2023-12-19T05:39:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.008+0000 7f9bb2431640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bac0b3b30 con 0x7f9bac071970 2023-12-19T05:39:15.013 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.008+0000 7f9bab7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9bac14aa80 0x7f9bac153380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37142/0 (socket says 172.21.15.120:37142) 2023-12-19T05:39:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.008+0000 7f9bab7fe640 1 -- 172.21.15.120:0/97513530 learned_addr learned my addr 172.21.15.120:0/97513530 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.008+0000 7f9baaffd640 1 -- 172.21.15.120:0/97513530 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931646579 0 0) 0x7f9bac06fef0 con 0x7f9bac14aa80 2023-12-19T05:39:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.008+0000 7f9baaffd640 1 -- 172.21.15.120:0/97513530 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b94003520 con 0x7f9bac14aa80 2023-12-19T05:39:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.008+0000 7f9bb09ce640 1 --2- 172.21.15.120:0/97513530 >> v2:172.21.15.155:3300/0 conn(0x7f9bac071970 0x7f9bac0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9baaffd640 1 -- 172.21.15.120:0/97513530 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3084265656 0 0) 0x7f9b94003520 con 0x7f9bac14aa80 2023-12-19T05:39:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9baaffd640 1 -- 172.21.15.120:0/97513530 >> v2:172.21.15.155:3300/0 conn(0x7f9bac071970 msgr2=0x7f9bac0710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9baaffd640 1 --2- 172.21.15.120:0/97513530 >> v2:172.21.15.155:3300/0 conn(0x7f9bac071970 0x7f9bac0710c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9baaffd640 1 -- 172.21.15.120:0/97513530 >> v1:172.21.15.155:6789/0 conn(0x7f9bac069f70 legacy=0x7f9bac0b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9baaffd640 1 -- 172.21.15.120:0/97513530 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac071d80 con 0x7f9bac14aa80 2023-12-19T05:39:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9baaffd640 1 -- 172.21.15.120:0/97513530 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f9ba0001670 con 0x7f9bac14aa80 2023-12-19T05:39:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9baaffd640 1 -- 172.21.15.120:0/97513530 >> v1:172.21.15.120:6789/0 conn(0x7f9bac14aa80 legacy=0x7f9bac153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9baaffd640 1 --2- 172.21.15.120:0/97513530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b940039c0 0x7f9b94003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9baaffd640 1 --2- 172.21.15.120:0/97513530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b940047c0 0x7f9b94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.014 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9baaffd640 1 --2- 172.21.15.120:0/97513530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b94005180 0x7f9b9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9baaffd640 1 -- 172.21.15.120:0/97513530 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac0b3b30 con 0x7f9b94005180 2023-12-19T05:39:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9baaffd640 1 -- 172.21.15.120:0/97513530 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9400c080 con 0x7f9b940047c0 2023-12-19T05:39:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9baaffd640 1 -- 172.21.15.120:0/97513530 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9400c240 con 0x7f9b940039c0 2023-12-19T05:39:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9bb09ce640 1 --2- 172.21.15.120:0/97513530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b94005180 0x7f9b9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9bab7fe640 1 --2- 172.21.15.120:0/97513530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b940047c0 0x7f9b94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9babfff640 1 --2- 172.21.15.120:0/97513530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b940039c0 0x7f9b94003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9bb09ce640 1 -- 172.21.15.120:0/97513530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b940039c0 msgr2=0x7f9b94003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9bb09ce640 1 --2- 172.21.15.120:0/97513530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b940039c0 0x7f9b94003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9bb09ce640 1 -- 172.21.15.120:0/97513530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b940047c0 msgr2=0x7f9b94004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9bb09ce640 1 --2- 172.21.15.120:0/97513530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9b940047c0 0x7f9b94004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9bb09ce640 1 -- 172.21.15.120:0/97513530 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b94003520 con 0x7f9b94005180 2023-12-19T05:39:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.009+0000 7f9babfff640 1 --2- 172.21.15.120:0/97513530 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b940039c0 0x7f9b94003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.010+0000 7f9bb09ce640 1 -- 172.21.15.120:0/97513530 reap_dead start 2023-12-19T05:39:15.015 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.010+0000 7f9bb09ce640 1 --2- 172.21.15.120:0/97513530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b94005180 0x7f9b9400b980 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009fc0 tx=0x7f9b940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ca6771b573b188 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.010+0000 7f9baaffd640 1 -- 172.21.15.120:0/97513530 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba402cc60 con 0x7f9b94005180 2023-12-19T05:39:15.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.010+0000 7f9baaffd640 1 -- 172.21.15.120:0/97513530 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba400f040 con 0x7f9b94005180 2023-12-19T05:39:15.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.010+0000 7f9baaffd640 1 -- 172.21.15.120:0/97513530 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40039e0 con 0x7f9b94005180 2023-12-19T05:39:15.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.010+0000 7f9bb2431640 1 -- 172.21.15.120:0/97513530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b94005180 msgr2=0x7f9b9400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.010+0000 7f9bb2431640 1 --2- 172.21.15.120:0/97513530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b94005180 0x7f9b9400b980 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009fc0 tx=0x7f9b940057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.011+0000 7f9bb2431640 1 -- 172.21.15.120:0/97513530 shutdown_connections 2023-12-19T05:39:15.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.011+0000 7f9bb2431640 1 --2- 172.21.15.120:0/97513530 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9b94005180 0x7f9b9400b980 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.011+0000 7f9bb2431640 1 -- 172.21.15.120:0/97513530 >> 172.21.15.120:0/97513530 conn(0x7f9bac0bd210 msgr2=0x7f9bac0bd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.011+0000 7f9bb2431640 1 -- 172.21.15.120:0/97513530 shutdown_connections 2023-12-19T05:39:15.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.011+0000 7f9bb2431640 1 -- 172.21.15.120:0/97513530 wait complete. 2023-12-19T05:39:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.012+0000 7f9bb2431640 1 Processor -- start 2023-12-19T05:39:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.012+0000 7f9bb2431640 1 -- start start 2023-12-19T05:39:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.012+0000 7f9bb2431640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b94005180 0x7f9bac145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.012+0000 7f9bb2431640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bac148000 0x7f9bac146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.012+0000 7f9bb2431640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bac0b55f0 0x7f9bac14daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.012+0000 7f9bb2431640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac147120 con 0x7f9bac148000 2023-12-19T05:39:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.012+0000 7f9bb2431640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac147b70 con 0x7f9bac0b55f0 2023-12-19T05:39:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.012+0000 7f9bb2431640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac14ec30 con 0x7f9b94005180 2023-12-19T05:39:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.012+0000 7f9bab7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bac148000 0x7f9bac146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.012+0000 7f9bab7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bac148000 0x7f9bac146be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47364/0 (socket says 172.21.15.120:47364) 2023-12-19T05:39:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.012+0000 7f9bab7fe640 1 -- 172.21.15.120:0/3742665426 learned_addr learned my addr 172.21.15.120:0/3742665426 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:15.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.013+0000 7f9babfff640 1 --2- 172.21.15.120:0/3742665426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b94005180 0x7f9bac145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.013+0000 7f9bb09ce640 1 --2- 172.21.15.120:0/3742665426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bac0b55f0 0x7f9bac14daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.013+0000 7f9bab7fe640 1 -- 172.21.15.120:0/3742665426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b94005180 msgr2=0x7f9bac145320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.013+0000 7f9bab7fe640 1 --2- 172.21.15.120:0/3742665426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b94005180 0x7f9bac145320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.013+0000 7f9bab7fe640 1 -- 172.21.15.120:0/3742665426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bac0b55f0 msgr2=0x7f9bac14daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.013+0000 7f9bab7fe640 1 --2- 172.21.15.120:0/3742665426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bac0b55f0 0x7f9bac14daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.013+0000 7f9bab7fe640 1 -- 172.21.15.120:0/3742665426 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac14e6b0 con 0x7f9bac148000 2023-12-19T05:39:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.013+0000 7f9bab7fe640 1 --2- 172.21.15.120:0/3742665426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bac148000 0x7f9bac146be0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00072c0 tx=0x7f9ba0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.013+0000 7f9ba8ff9640 1 -- 172.21.15.120:0/3742665426 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0001430 con 0x7f9bac148000 2023-12-19T05:39:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.013+0000 7f9ba8ff9640 1 -- 172.21.15.120:0/3742665426 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba000f940 con 0x7f9bac148000 2023-12-19T05:39:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.013+0000 7f9bb2431640 1 -- 172.21.15.120:0/3742665426 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bac0b5a70 con 0x7f9bac148000 2023-12-19T05:39:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.013+0000 7f9ba8ff9640 1 -- 172.21.15.120:0/3742665426 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba000fcd0 con 0x7f9bac148000 2023-12-19T05:39:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.013+0000 7f9bb2431640 1 -- 172.21.15.120:0/3742665426 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac14e030 con 0x7f9bac148000 2023-12-19T05:39:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.014+0000 7f9bb2431640 1 -- 172.21.15.120:0/3742665426 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bac04e080 con 0x7f9bac148000 2023-12-19T05:39:15.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.014+0000 7f9ba8ff9640 1 -- 172.21.15.120:0/3742665426 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9ba001d460 con 0x7f9bac148000 2023-12-19T05:39:15.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.015+0000 7f9ba8ff9640 1 --2- 172.21.15.120:0/3742665426 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9b9806a460 0x7f9b9806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.015+0000 7f9ba8ff9640 1 -- 172.21.15.120:0/3742665426 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ba0088960 con 0x7f9bac148000 2023-12-19T05:39:15.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.015+0000 7f9babfff640 1 --2- 172.21.15.120:0/3742665426 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9b9806a460 0x7f9b9806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.015+0000 7f9babfff640 1 --2- 172.21.15.120:0/3742665426 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9b9806a460 0x7f9b9806c920 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c005450 tx=0x7f9b9c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.019+0000 7f9ba8ff9640 1 -- 172.21.15.120:0/3742665426 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9ba0053fe0 con 0x7f9bac148000 2023-12-19T05:39:15.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.184+0000 7f9bb2431640 1 -- 172.21.15.120:0/3742665426 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9bac147cb0 con 0x7f9bac148000 2023-12-19T05:39:15.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.184+0000 7f9ba8ff9640 1 -- 172.21.15.120:0/3742665426 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ba0057600 con 0x7f9bac148000 2023-12-19T05:39:15.186 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2023-12-19T05:39:15.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.186+0000 7f9bb2431640 1 -- 172.21.15.120:0/3742665426 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9b9806a460 msgr2=0x7f9b9806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.186+0000 7f9bb2431640 1 --2- 172.21.15.120:0/3742665426 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9b9806a460 0x7f9b9806c920 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c005450 tx=0x7f9b9c009040 comp rx=0 tx=0).stop 2023-12-19T05:39:15.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.186+0000 7f9bb2431640 1 -- 172.21.15.120:0/3742665426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bac148000 msgr2=0x7f9bac146be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.186+0000 7f9bb2431640 1 --2- 172.21.15.120:0/3742665426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bac148000 0x7f9bac146be0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9ba00072c0 tx=0x7f9ba0007780 comp rx=0 tx=0).stop 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.186+0000 7f9bb2431640 1 -- 172.21.15.120:0/3742665426 shutdown_connections 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.186+0000 7f9bb2431640 1 --2- 172.21.15.120:0/3742665426 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9b9806a460 0x7f9b9806c920 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.186+0000 7f9bb2431640 1 --2- 172.21.15.120:0/3742665426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bac0b55f0 0x7f9bac14daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.186+0000 7f9bb2431640 1 --2- 172.21.15.120:0/3742665426 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9bac148000 0x7f9bac146be0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.186+0000 7f9bb2431640 1 --2- 172.21.15.120:0/3742665426 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9b94005180 0x7f9bac145320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.186+0000 7f9bb2431640 1 -- 172.21.15.120:0/3742665426 >> 172.21.15.120:0/3742665426 conn(0x7f9bac0bd210 msgr2=0x7f9bac06a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.186+0000 7f9bb2431640 1 -- 172.21.15.120:0/3742665426 shutdown_connections 2023-12-19T05:39:15.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.186+0000 7f9bb2431640 1 -- 172.21.15.120:0/3742665426 wait complete. 2023-12-19T05:39:15.199 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:15.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.298+0000 7f1797be3640 1 Processor -- start 2023-12-19T05:39:15.301 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.298+0000 7f1797be3640 1 -- start start 2023-12-19T05:39:15.303 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.299+0000 7f1797be3640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f179006b080 0x7f17901477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.303 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.299+0000 7f1797be3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17900b9150 0x7f17900715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.303 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.299+0000 7f1797be3640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1790071110 con 0x7f1790070b60 2023-12-19T05:39:15.303 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.299+0000 7f1797be3640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17900b3c80 con 0x7f179006b080 2023-12-19T05:39:15.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.299+0000 7f1797be3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17900b48c0 con 0x7f17900b9150 2023-12-19T05:39:15.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.299+0000 7f179597f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f179006b080 0x7f17901477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.299+0000 7f1796180640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f1790070b60 0x7f1790141680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37152/0 (socket says 172.21.15.120:37152) 2023-12-19T05:39:15.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.299+0000 7f1796180640 1 -- 172.21.15.120:0/2003935141 learned_addr learned my addr 172.21.15.120:0/2003935141 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:15.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.299+0000 7f179517e640 1 --2- 172.21.15.120:0/2003935141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17900b9150 0x7f17900715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.299+0000 7f179597f640 1 -- 172.21.15.120:0/2003935141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17900b9150 msgr2=0x7f17900715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.299+0000 7f179597f640 1 --2- 172.21.15.120:0/2003935141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17900b9150 0x7f17900715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.299+0000 7f179597f640 1 -- 172.21.15.120:0/2003935141 >> v1:172.21.15.120:6789/0 conn(0x7f1790070b60 legacy=0x7f1790141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.299+0000 7f179497d640 1 -- 172.21.15.120:0/2003935141 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082026365 0 0) 0x7f1790071110 con 0x7f1790070b60 2023-12-19T05:39:15.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.299+0000 7f179597f640 1 -- 172.21.15.120:0/2003935141 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179006ffa0 con 0x7f179006b080 2023-12-19T05:39:15.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.300+0000 7f179597f640 1 --2- 172.21.15.120:0/2003935141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179006b080 0x7f17901477b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f178c009d90 tx=0x7f178c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbf990350b1d349 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.300+0000 7f179497d640 1 -- 172.21.15.120:0/2003935141 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c02cbc0 con 0x7f179006b080 2023-12-19T05:39:15.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.300+0000 7f179497d640 1 -- 172.21.15.120:0/2003935141 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c02cd20 con 0x7f179006b080 2023-12-19T05:39:15.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.300+0000 7f179497d640 1 -- 172.21.15.120:0/2003935141 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c034660 con 0x7f179006b080 2023-12-19T05:39:15.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.301+0000 7f1797be3640 1 -- 172.21.15.120:0/2003935141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179006b080 msgr2=0x7f17901477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.301+0000 7f1797be3640 1 --2- 172.21.15.120:0/2003935141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179006b080 0x7f17901477b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f178c009d90 tx=0x7f178c02be10 comp rx=0 tx=0).stop 2023-12-19T05:39:15.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.301+0000 7f1797be3640 1 -- 172.21.15.120:0/2003935141 shutdown_connections 2023-12-19T05:39:15.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.301+0000 7f1797be3640 1 --2- 172.21.15.120:0/2003935141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17900b9150 0x7f17900715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.301+0000 7f1797be3640 1 --2- 172.21.15.120:0/2003935141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179006b080 0x7f17901477b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.301+0000 7f1797be3640 1 -- 172.21.15.120:0/2003935141 >> 172.21.15.120:0/2003935141 conn(0x7f17900bd070 msgr2=0x7f17900bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.301+0000 7f1797be3640 1 -- 172.21.15.120:0/2003935141 shutdown_connections 2023-12-19T05:39:15.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.301+0000 7f1797be3640 1 -- 172.21.15.120:0/2003935141 wait complete. 2023-12-19T05:39:15.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.302+0000 7f1797be3640 1 Processor -- start 2023-12-19T05:39:15.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.302+0000 7f1797be3640 1 -- start start 2023-12-19T05:39:15.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f1797be3640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179006b080 0x7f1790144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f1797be3640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1790070b60 0x7f17901de220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f1797be3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17900b9150 0x7f179013c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f1797be3640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1790144970 con 0x7f1790070b60 2023-12-19T05:39:15.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f1797be3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1790144ea0 con 0x7f17900b9150 2023-12-19T05:39:15.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f1797be3640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17901de760 con 0x7f179006b080 2023-12-19T05:39:15.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f179517e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1790070b60 0x7f17901de220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f179517e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1790070b60 0x7f17901de220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47380/0 (socket says 172.21.15.120:47380) 2023-12-19T05:39:15.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f179517e640 1 -- 172.21.15.120:0/2780518512 learned_addr learned my addr 172.21.15.120:0/2780518512 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:15.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f179597f640 1 --2- 172.21.15.120:0/2780518512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179006b080 0x7f1790144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f1796180640 1 --2- 172.21.15.120:0/2780518512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17900b9150 0x7f179013c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f179517e640 1 -- 172.21.15.120:0/2780518512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179006b080 msgr2=0x7f1790144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f179517e640 1 --2- 172.21.15.120:0/2780518512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179006b080 0x7f1790144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f179517e640 1 -- 172.21.15.120:0/2780518512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17900b9150 msgr2=0x7f179013c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f179517e640 1 --2- 172.21.15.120:0/2780518512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17900b9150 0x7f179013c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f179517e640 1 -- 172.21.15.120:0/2780518512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c009a70 con 0x7f1790070b60 2023-12-19T05:39:15.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f179517e640 1 --2- 172.21.15.120:0/2780518512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1790070b60 0x7f17901de220 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f178000d5c0 tx=0x7f178000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f17867fc640 1 -- 172.21.15.120:0/2780518512 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17800125f0 con 0x7f1790070b60 2023-12-19T05:39:15.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f17867fc640 1 -- 172.21.15.120:0/2780518512 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1780012750 con 0x7f1790070b60 2023-12-19T05:39:15.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f1797be3640 1 -- 172.21.15.120:0/2780518512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1790144bc0 con 0x7f1790070b60 2023-12-19T05:39:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f17867fc640 1 -- 172.21.15.120:0/2780518512 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1780012b00 con 0x7f1790070b60 2023-12-19T05:39:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.303+0000 7f1797be3640 1 -- 172.21.15.120:0/2780518512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17901ddd00 con 0x7f1790070b60 2023-12-19T05:39:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.304+0000 7f1797be3640 1 -- 172.21.15.120:0/2780518512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17901ddec0 con 0x7f1790070b60 2023-12-19T05:39:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.304+0000 7f17867fc640 1 -- 172.21.15.120:0/2780518512 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1780012c60 con 0x7f1790070b60 2023-12-19T05:39:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.305+0000 7f17867fc640 1 --2- 172.21.15.120:0/2780518512 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f177406a430 0x7f177406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.305+0000 7f17867fc640 1 -- 172.21.15.120:0/2780518512 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1780088cc0 con 0x7f1790070b60 2023-12-19T05:39:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.305+0000 7f179597f640 1 --2- 172.21.15.120:0/2780518512 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f177406a430 0x7f177406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.305+0000 7f179597f640 1 --2- 172.21.15.120:0/2780518512 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f177406a430 0x7f177406c8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f178c036000 tx=0x7f178c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.312 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.309+0000 7f17867fc640 1 -- 172.21.15.120:0/2780518512 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1780054340 con 0x7f1790070b60 2023-12-19T05:39:15.476 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.474+0000 7f1797be3640 1 -- 172.21.15.120:0/2780518512 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17901dd850 con 0x7f1790070b60 2023-12-19T05:39:15.477 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.474+0000 7f17867fc640 1 -- 172.21.15.120:0/2780518512 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1780057960 con 0x7f1790070b60 2023-12-19T05:39:15.477 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2023-12-19T05:39:15.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.476+0000 7f1797be3640 1 -- 172.21.15.120:0/2780518512 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f177406a430 msgr2=0x7f177406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.476+0000 7f1797be3640 1 --2- 172.21.15.120:0/2780518512 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f177406a430 0x7f177406c8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f178c036000 tx=0x7f178c030000 comp rx=0 tx=0).stop 2023-12-19T05:39:15.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.476+0000 7f1797be3640 1 -- 172.21.15.120:0/2780518512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1790070b60 msgr2=0x7f17901de220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.476+0000 7f1797be3640 1 --2- 172.21.15.120:0/2780518512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1790070b60 0x7f17901de220 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f178000d5c0 tx=0x7f178000da80 comp rx=0 tx=0).stop 2023-12-19T05:39:15.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.476+0000 7f1797be3640 1 -- 172.21.15.120:0/2780518512 shutdown_connections 2023-12-19T05:39:15.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.476+0000 7f1797be3640 1 --2- 172.21.15.120:0/2780518512 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f177406a430 0x7f177406c8f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.476+0000 7f1797be3640 1 --2- 172.21.15.120:0/2780518512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17900b9150 0x7f179013c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.476+0000 7f1797be3640 1 --2- 172.21.15.120:0/2780518512 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1790070b60 0x7f17901de220 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.476+0000 7f1797be3640 1 --2- 172.21.15.120:0/2780518512 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179006b080 0x7f1790144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.476+0000 7f1797be3640 1 -- 172.21.15.120:0/2780518512 >> 172.21.15.120:0/2780518512 conn(0x7f17900bd070 msgr2=0x7f17900bbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.476+0000 7f1797be3640 1 -- 172.21.15.120:0/2780518512 shutdown_connections 2023-12-19T05:39:15.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.476+0000 7f1797be3640 1 -- 172.21.15.120:0/2780518512 wait complete. 2023-12-19T05:39:15.489 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:15.590 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.588+0000 7f8d5beb6640 1 Processor -- start 2023-12-19T05:39:15.591 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.588+0000 7f8d5beb6640 1 -- start start 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.589+0000 7f8d5beb6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8d54152270 0x7f8d54154660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.589+0000 7f8d5beb6640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d54143090 con 0x7f8d540bad20 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.589+0000 7f8d5beb6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d540b56d0 con 0x7f8d540b4d50 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.589+0000 7f8d5beb6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d540b6070 con 0x7f8d54152270 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.589+0000 7f8d59c52640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f8d540bad20 0x7f8d54142980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37154/0 (socket says 172.21.15.120:37154) 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.589+0000 7f8d59c52640 1 -- 172.21.15.120:0/3191349968 learned_addr learned my addr 172.21.15.120:0/3191349968 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.589+0000 7f8d58c50640 1 -- 172.21.15.120:0/3191349968 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820219297 0 0) 0x7f8d54143090 con 0x7f8d540bad20 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.589+0000 7f8d5a453640 1 --2- 172.21.15.120:0/3191349968 >> v2:172.21.15.155:3300/0 conn(0x7f8d54152270 0x7f8d54154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.589+0000 7f8d58c50640 1 -- 172.21.15.120:0/3191349968 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d40003520 con 0x7f8d540bad20 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d58c50640 1 -- 172.21.15.120:0/3191349968 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1962920657 0 0) 0x7f8d40003520 con 0x7f8d540bad20 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d58c50640 1 -- 172.21.15.120:0/3191349968 >> v2:172.21.15.155:3300/0 conn(0x7f8d54152270 msgr2=0x7f8d54154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d58c50640 1 --2- 172.21.15.120:0/3191349968 >> v2:172.21.15.155:3300/0 conn(0x7f8d54152270 0x7f8d54154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d58c50640 1 -- 172.21.15.120:0/3191349968 >> v1:172.21.15.155:6789/0 conn(0x7f8d540b4d50 legacy=0x7f8d540b96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d58c50640 1 -- 172.21.15.120:0/3191349968 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d540b59b0 con 0x7f8d540bad20 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d58c50640 1 -- 172.21.15.120:0/3191349968 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f8d500019f0 con 0x7f8d540bad20 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d58c50640 1 -- 172.21.15.120:0/3191349968 >> v1:172.21.15.120:6789/0 conn(0x7f8d540bad20 legacy=0x7f8d54142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d58c50640 1 --2- 172.21.15.120:0/3191349968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d40003970 0x7f8d40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d58c50640 1 --2- 172.21.15.120:0/3191349968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d400047c0 0x7f8d40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d58c50640 1 --2- 172.21.15.120:0/3191349968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d40005180 0x7f8d4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d58c50640 1 -- 172.21.15.120:0/3191349968 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540b6070 con 0x7f8d40003970 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d58c50640 1 -- 172.21.15.120:0/3191349968 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4000c020 con 0x7f8d40005180 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d58c50640 1 -- 172.21.15.120:0/3191349968 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4000c1e0 con 0x7f8d400047c0 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d59c52640 1 --2- 172.21.15.120:0/3191349968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d40003970 0x7f8d40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d59451640 1 --2- 172.21.15.120:0/3191349968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d400047c0 0x7f8d40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d5a453640 1 --2- 172.21.15.120:0/3191349968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d40005180 0x7f8d4000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d59c52640 1 -- 172.21.15.120:0/3191349968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d400047c0 msgr2=0x7f8d40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d59c52640 1 --2- 172.21.15.120:0/3191349968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d400047c0 0x7f8d40004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d59c52640 1 -- 172.21.15.120:0/3191349968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d40005180 msgr2=0x7f8d4000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d59c52640 1 --2- 172.21.15.120:0/3191349968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d40005180 0x7f8d4000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d59c52640 1 -- 172.21.15.120:0/3191349968 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40003520 con 0x7f8d40003970 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d59451640 1 --2- 172.21.15.120:0/3191349968 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d400047c0 0x7f8d40004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d5a453640 1 --2- 172.21.15.120:0/3191349968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d40005180 0x7f8d4000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.590+0000 7f8d5a453640 1 -- 172.21.15.120:0/3191349968 reap_dead start 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.591+0000 7f8d59c52640 1 --2- 172.21.15.120:0/3191349968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d40003970 0x7f8d40003d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000a830 tx=0x7f8d400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cf89c8d58278d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.591+0000 7f8d58c50640 1 -- 172.21.15.120:0/3191349968 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d500072d0 con 0x7f8d40003970 2023-12-19T05:39:15.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.591+0000 7f8d58c50640 1 -- 172.21.15.120:0/3191349968 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5002f070 con 0x7f8d40003970 2023-12-19T05:39:15.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.591+0000 7f8d58c50640 1 -- 172.21.15.120:0/3191349968 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d500076f0 con 0x7f8d40003970 2023-12-19T05:39:15.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.591+0000 7f8d5beb6640 1 -- 172.21.15.120:0/3191349968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d40003970 msgr2=0x7f8d40003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.591+0000 7f8d5beb6640 1 --2- 172.21.15.120:0/3191349968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d40003970 0x7f8d40003d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8d5000a830 tx=0x7f8d400057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.591+0000 7f8d5beb6640 1 -- 172.21.15.120:0/3191349968 shutdown_connections 2023-12-19T05:39:15.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.591+0000 7f8d5beb6640 1 --2- 172.21.15.120:0/3191349968 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d40003970 0x7f8d40003d90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.591+0000 7f8d5beb6640 1 -- 172.21.15.120:0/3191349968 >> 172.21.15.120:0/3191349968 conn(0x7f8d54069d00 msgr2=0x7f8d5406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.592+0000 7f8d5beb6640 1 -- 172.21.15.120:0/3191349968 shutdown_connections 2023-12-19T05:39:15.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.592+0000 7f8d5beb6640 1 -- 172.21.15.120:0/3191349968 wait complete. 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.593+0000 7f8d5beb6640 1 Processor -- start 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.593+0000 7f8d5beb6640 1 -- start start 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.593+0000 7f8d5beb6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d40003970 0x7f8d5413b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.593+0000 7f8d5beb6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d541488b0 0x7f8d5406b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.593+0000 7f8d5beb6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d5406ba10 0x7f8d541e3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.593+0000 7f8d5beb6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540b51c0 con 0x7f8d40003970 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.593+0000 7f8d5beb6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5406cee0 con 0x7f8d5406ba10 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.593+0000 7f8d5beb6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5413bde0 con 0x7f8d541488b0 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.593+0000 7f8d59c52640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d40003970 0x7f8d5413b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.593+0000 7f8d59c52640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d40003970 0x7f8d5413b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47392/0 (socket says 172.21.15.120:47392) 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.593+0000 7f8d59c52640 1 -- 172.21.15.120:0/1590179676 learned_addr learned my addr 172.21.15.120:0/1590179676 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:15.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.593+0000 7f8d59451640 1 --2- 172.21.15.120:0/1590179676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d541488b0 0x7f8d5406b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.593+0000 7f8d5a453640 1 --2- 172.21.15.120:0/1590179676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d5406ba10 0x7f8d541e3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.594+0000 7f8d59c52640 1 -- 172.21.15.120:0/1590179676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d541488b0 msgr2=0x7f8d5406b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.594+0000 7f8d59c52640 1 --2- 172.21.15.120:0/1590179676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d541488b0 0x7f8d5406b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.594+0000 7f8d59c52640 1 -- 172.21.15.120:0/1590179676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d5406ba10 msgr2=0x7f8d541e3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.594+0000 7f8d59c52640 1 --2- 172.21.15.120:0/1590179676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d5406ba10 0x7f8d541e3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.594+0000 7f8d59c52640 1 -- 172.21.15.120:0/1590179676 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5406cc90 con 0x7f8d40003970 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.594+0000 7f8d59c52640 1 --2- 172.21.15.120:0/1590179676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d40003970 0x7f8d5413b8a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8d5002cb30 tx=0x7f8d50001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.594+0000 7f8d4a7fc640 1 -- 172.21.15.120:0/1590179676 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d500074e0 con 0x7f8d40003970 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.594+0000 7f8d4a7fc640 1 -- 172.21.15.120:0/1590179676 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d50007640 con 0x7f8d40003970 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.594+0000 7f8d5beb6640 1 -- 172.21.15.120:0/1590179676 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d541469d0 con 0x7f8d40003970 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.594+0000 7f8d4a7fc640 1 -- 172.21.15.120:0/1590179676 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d500079b0 con 0x7f8d40003970 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.594+0000 7f8d5beb6640 1 -- 172.21.15.120:0/1590179676 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5406afb0 con 0x7f8d40003970 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.595+0000 7f8d5beb6640 1 -- 172.21.15.120:0/1590179676 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5406b140 con 0x7f8d40003970 2023-12-19T05:39:15.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.595+0000 7f8d4a7fc640 1 -- 172.21.15.120:0/1590179676 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8d50031030 con 0x7f8d40003970 2023-12-19T05:39:15.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.596+0000 7f8d4a7fc640 1 --2- 172.21.15.120:0/1590179676 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8d3806a460 0x7f8d3806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.596+0000 7f8d59451640 1 --2- 172.21.15.120:0/1590179676 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8d3806a460 0x7f8d3806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.596+0000 7f8d4a7fc640 1 -- 172.21.15.120:0/1590179676 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d500aa0a0 con 0x7f8d40003970 2023-12-19T05:39:15.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.596+0000 7f8d59451640 1 --2- 172.21.15.120:0/1590179676 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8d3806a460 0x7f8d3806c920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8d44000c00 tx=0x7f8d44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.600+0000 7f8d4a7fc640 1 -- 172.21.15.120:0/1590179676 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8d50075720 con 0x7f8d40003970 2023-12-19T05:39:15.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.767+0000 7f8d5beb6640 1 -- 172.21.15.120:0/1590179676 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8d5406b140 con 0x7f8d40003970 2023-12-19T05:39:15.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.767+0000 7f8d4a7fc640 1 -- 172.21.15.120:0/1590179676 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8d50078d40 con 0x7f8d40003970 2023-12-19T05:39:15.770 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2023-12-19T05:39:15.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.769+0000 7f8d5beb6640 1 -- 172.21.15.120:0/1590179676 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8d3806a460 msgr2=0x7f8d3806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.769+0000 7f8d5beb6640 1 --2- 172.21.15.120:0/1590179676 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8d3806a460 0x7f8d3806c920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8d44000c00 tx=0x7f8d44009040 comp rx=0 tx=0).stop 2023-12-19T05:39:15.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.769+0000 7f8d5beb6640 1 -- 172.21.15.120:0/1590179676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d40003970 msgr2=0x7f8d5413b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.769+0000 7f8d5beb6640 1 --2- 172.21.15.120:0/1590179676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d40003970 0x7f8d5413b8a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8d5002cb30 tx=0x7f8d50001d80 comp rx=0 tx=0).stop 2023-12-19T05:39:15.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.769+0000 7f8d5beb6640 1 -- 172.21.15.120:0/1590179676 shutdown_connections 2023-12-19T05:39:15.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.769+0000 7f8d5beb6640 1 --2- 172.21.15.120:0/1590179676 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8d3806a460 0x7f8d3806c920 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.769+0000 7f8d5beb6640 1 --2- 172.21.15.120:0/1590179676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d5406ba10 0x7f8d541e3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.769+0000 7f8d5beb6640 1 --2- 172.21.15.120:0/1590179676 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8d541488b0 0x7f8d5406b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.769+0000 7f8d5beb6640 1 --2- 172.21.15.120:0/1590179676 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8d40003970 0x7f8d5413b8a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.773 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.769+0000 7f8d5beb6640 1 -- 172.21.15.120:0/1590179676 >> 172.21.15.120:0/1590179676 conn(0x7f8d54069d00 msgr2=0x7f8d541399d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.773 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.769+0000 7f8d5beb6640 1 -- 172.21.15.120:0/1590179676 shutdown_connections 2023-12-19T05:39:15.773 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.769+0000 7f8d5beb6640 1 -- 172.21.15.120:0/1590179676 wait complete. 2023-12-19T05:39:15.782 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:15.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.878+0000 7efe65d16640 1 Processor -- start 2023-12-19T05:39:15.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.878+0000 7efe65d16640 1 -- start start 2023-12-19T05:39:15.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.879+0000 7efe65d16640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe60070c30 0x7efe601415e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.879+0000 7efe65d16640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe600b9450 con 0x7efe6006b080 2023-12-19T05:39:15.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.879+0000 7efe65d16640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe60070830 con 0x7efe601477d0 2023-12-19T05:39:15.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.879+0000 7efe65d16640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6006ff80 con 0x7efe60070c30 2023-12-19T05:39:15.884 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.879+0000 7efe5f7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7efe6006b080 0x7efe60071410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37164/0 (socket says 172.21.15.120:37164) 2023-12-19T05:39:15.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.879+0000 7efe5f7fe640 1 -- 172.21.15.120:0/2095004486 learned_addr learned my addr 172.21.15.120:0/2095004486 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:15.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.879+0000 7efe5effd640 1 --2- 172.21.15.120:0/2095004486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe60070c30 0x7efe601415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.879+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256472248 0 0) 0x7efe600b9450 con 0x7efe6006b080 2023-12-19T05:39:15.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe48003520 con 0x7efe6006b080 2023-12-19T05:39:15.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104015622 0 0) 0x7efe60070830 con 0x7efe601477d0 2023-12-19T05:39:15.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe600b9450 con 0x7efe601477d0 2023-12-19T05:39:15.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1751608782 0 0) 0x7efe48003520 con 0x7efe6006b080 2023-12-19T05:39:15.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe60070c30 msgr2=0x7efe601415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 --2- 172.21.15.120:0/2095004486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe60070c30 0x7efe601415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 >> v1:172.21.15.155:6789/0 conn(0x7efe601477d0 legacy=0x7efe60152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe60070260 con 0x7efe6006b080 2023-12-19T05:39:15.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7efe50001670 con 0x7efe6006b080 2023-12-19T05:39:15.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 >> v1:172.21.15.120:6789/0 conn(0x7efe6006b080 legacy=0x7efe60071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 --2- 172.21.15.120:0/2095004486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe60070c30 0x7efe48003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 --2- 172.21.15.120:0/2095004486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe48004090 0x7efe480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 --2- 172.21.15.120:0/2095004486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe48004d00 0x7efe48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6006ff80 con 0x7efe48004090 2023-12-19T05:39:15.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4800ba60 con 0x7efe48004d00 2023-12-19T05:39:15.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4800bc20 con 0x7efe60070c30 2023-12-19T05:39:15.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5effd640 1 --2- 172.21.15.120:0/2095004486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe48004090 0x7efe480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5f7fe640 1 --2- 172.21.15.120:0/2095004486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe60070c30 0x7efe48003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5ffff640 1 --2- 172.21.15.120:0/2095004486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe48004d00 0x7efe48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5effd640 1 -- 172.21.15.120:0/2095004486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe60070c30 msgr2=0x7efe48003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5effd640 1 --2- 172.21.15.120:0/2095004486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe60070c30 0x7efe48003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5effd640 1 -- 172.21.15.120:0/2095004486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe48004d00 msgr2=0x7efe48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:15.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5effd640 1 --2- 172.21.15.120:0/2095004486 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe48004d00 0x7efe48005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5effd640 1 -- 172.21.15.120:0/2095004486 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe48003520 con 0x7efe48004090 2023-12-19T05:39:15.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.880+0000 7efe5f7fe640 1 --2- 172.21.15.120:0/2095004486 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe60070c30 0x7efe48003b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:15.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.881+0000 7efe5effd640 1 --2- 172.21.15.120:0/2095004486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe48004090 0x7efe480047c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efe54009ac0 tx=0x7efe480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd11f58957d92560 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.881+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5402c6b0 con 0x7efe48004090 2023-12-19T05:39:15.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.881+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5402c810 con 0x7efe48004090 2023-12-19T05:39:15.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.881+0000 7efe5e7fc640 1 -- 172.21.15.120:0/2095004486 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5402cba0 con 0x7efe48004090 2023-12-19T05:39:15.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.881+0000 7efe65d16640 1 -- 172.21.15.120:0/2095004486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe48004090 msgr2=0x7efe480047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.881+0000 7efe65d16640 1 --2- 172.21.15.120:0/2095004486 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe48004090 0x7efe480047c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efe54009ac0 tx=0x7efe480057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.882+0000 7efe5ffff640 1 -- 172.21.15.120:0/2095004486 reap_dead start 2023-12-19T05:39:15.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.882+0000 7efe65d16640 1 -- 172.21.15.120:0/2095004486 shutdown_connections 2023-12-19T05:39:15.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.882+0000 7efe65d16640 1 -- 172.21.15.120:0/2095004486 >> 172.21.15.120:0/2095004486 conn(0x7efe600bcfd0 msgr2=0x7efe600bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:15.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.882+0000 7efe65d16640 1 -- 172.21.15.120:0/2095004486 shutdown_connections 2023-12-19T05:39:15.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.882+0000 7efe65d16640 1 -- 172.21.15.120:0/2095004486 wait complete. 2023-12-19T05:39:15.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.883+0000 7efe65d16640 1 Processor -- start 2023-12-19T05:39:15.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.883+0000 7efe65d16640 1 -- start start 2023-12-19T05:39:15.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.883+0000 7efe65d16640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe48004090 0x7efe600bb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.883+0000 7efe65d16640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe60142150 0x7efe601425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.883+0000 7efe65d16640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe6013a220 0x7efe6013a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.883+0000 7efe65d16640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe600bbe40 con 0x7efe6013a220 2023-12-19T05:39:15.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.883+0000 7efe65d16640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe601ce120 con 0x7efe60142150 2023-12-19T05:39:15.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.883+0000 7efe65d16640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe60142af0 con 0x7efe48004090 2023-12-19T05:39:15.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.883+0000 7efe5ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe6013a220 0x7efe6013a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.883+0000 7efe5ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe6013a220 0x7efe6013a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47416/0 (socket says 172.21.15.120:47416) 2023-12-19T05:39:15.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.883+0000 7efe5ffff640 1 -- 172.21.15.120:0/2336498205 learned_addr learned my addr 172.21.15.120:0/2336498205 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:15.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.884+0000 7efe5effd640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe60142150 0x7efe601425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.884+0000 7efe5f7fe640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe48004090 0x7efe600bb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.884+0000 7efe5ffff640 1 -- 172.21.15.120:0/2336498205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe48004090 msgr2=0x7efe600bb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.884+0000 7efe5ffff640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe48004090 0x7efe600bb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.884+0000 7efe5ffff640 1 -- 172.21.15.120:0/2336498205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe60142150 msgr2=0x7efe601425b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:15.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.884+0000 7efe5ffff640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe60142150 0x7efe601425b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:15.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.884+0000 7efe5ffff640 1 -- 172.21.15.120:0/2336498205 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6013abe0 con 0x7efe6013a220 2023-12-19T05:39:15.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.884+0000 7efe5f7fe640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe48004090 0x7efe600bb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:15.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.884+0000 7efe5ffff640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe6013a220 0x7efe6013a6a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efe6006b8e0 tx=0x7efe5800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.884+0000 7efe47fff640 1 -- 172.21.15.120:0/2336498205 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58003970 con 0x7efe6013a220 2023-12-19T05:39:15.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.884+0000 7efe47fff640 1 -- 172.21.15.120:0/2336498205 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58003af0 con 0x7efe6013a220 2023-12-19T05:39:15.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.884+0000 7efe65d16640 1 -- 172.21.15.120:0/2336498205 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe601cf230 con 0x7efe6013a220 2023-12-19T05:39:15.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.884+0000 7efe47fff640 1 -- 172.21.15.120:0/2336498205 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58003ea0 con 0x7efe6013a220 2023-12-19T05:39:15.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.884+0000 7efe65d16640 1 -- 172.21.15.120:0/2336498205 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe60141c30 con 0x7efe6013a220 2023-12-19T05:39:15.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.885+0000 7efe65d16640 1 -- 172.21.15.120:0/2336498205 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe6004e080 con 0x7efe6013a220 2023-12-19T05:39:15.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.885+0000 7efe47fff640 1 -- 172.21.15.120:0/2336498205 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efe580050d0 con 0x7efe6013a220 2023-12-19T05:39:15.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.886+0000 7efe47fff640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efe4c06a430 0x7efe4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:15.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.886+0000 7efe5f7fe640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efe4c06a430 0x7efe4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:15.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.886+0000 7efe47fff640 1 -- 172.21.15.120:0/2336498205 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe580886b0 con 0x7efe6013a220 2023-12-19T05:39:15.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.886+0000 7efe5f7fe640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efe4c06a430 0x7efe4c06c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe50005990 tx=0x7efe50001470 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:15.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:15.890+0000 7efe47fff640 1 -- 172.21.15.120:0/2336498205 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efe58053d30 con 0x7efe6013a220 2023-12-19T05:39:16.062 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.059+0000 7efe65d16640 1 -- 172.21.15.120:0/2336498205 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe60071c30 con 0x7efe6013a220 2023-12-19T05:39:16.062 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.060+0000 7efe47fff640 1 -- 172.21.15.120:0/2336498205 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7efe58057350 con 0x7efe6013a220 2023-12-19T05:39:16.063 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:16.063 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:16.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.063+0000 7efe65d16640 1 -- 172.21.15.120:0/2336498205 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efe4c06a430 msgr2=0x7efe4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.063+0000 7efe65d16640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efe4c06a430 0x7efe4c06c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe50005990 tx=0x7efe50001470 comp rx=0 tx=0).stop 2023-12-19T05:39:16.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.063+0000 7efe65d16640 1 -- 172.21.15.120:0/2336498205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe6013a220 msgr2=0x7efe6013a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.063+0000 7efe65d16640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe6013a220 0x7efe6013a6a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7efe6006b8e0 tx=0x7efe5800eb90 comp rx=0 tx=0).stop 2023-12-19T05:39:16.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.063+0000 7efe65d16640 1 -- 172.21.15.120:0/2336498205 shutdown_connections 2023-12-19T05:39:16.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.063+0000 7efe65d16640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efe4c06a430 0x7efe4c06c8f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.063+0000 7efe65d16640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efe6013a220 0x7efe6013a6a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.063+0000 7efe65d16640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe60142150 0x7efe601425b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.063+0000 7efe65d16640 1 --2- 172.21.15.120:0/2336498205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efe48004090 0x7efe600bb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.063+0000 7efe65d16640 1 -- 172.21.15.120:0/2336498205 >> 172.21.15.120:0/2336498205 conn(0x7efe600bcfd0 msgr2=0x7efe601402b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.063+0000 7efe65d16640 1 -- 172.21.15.120:0/2336498205 shutdown_connections 2023-12-19T05:39:16.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.063+0000 7efe65d16640 1 -- 172.21.15.120:0/2336498205 wait complete. 2023-12-19T05:39:16.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:45.976868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:38:56.035188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:38:57.050130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:16.076 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:16.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.176+0000 7fd9cfaca640 1 Processor -- start 2023-12-19T05:39:16.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.176+0000 7fd9cfaca640 1 -- start start 2023-12-19T05:39:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.177+0000 7fd9cfaca640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd9c806fe70 0x7fd9c806ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.177+0000 7fd9cfaca640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c8070400 con 0x7fd9c806b240 2023-12-19T05:39:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.177+0000 7fd9cfaca640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c8071210 con 0x7fd9c80b68f0 2023-12-19T05:39:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.177+0000 7fd9cfaca640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c80714f0 con 0x7fd9c806fe70 2023-12-19T05:39:16.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.177+0000 7fd9ce067640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fd9c806b240 0x7fd9c8142590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37168/0 (socket says 172.21.15.120:37168) 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.177+0000 7fd9ce067640 1 -- 172.21.15.120:0/3270261452 learned_addr learned my addr 172.21.15.120:0/3270261452 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.177+0000 7fd9cd065640 1 --2- 172.21.15.120:0/3270261452 >> v2:172.21.15.155:3300/0 conn(0x7fd9c806fe70 0x7fd9c806ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.177+0000 7fd9cc864640 1 -- 172.21.15.120:0/3270261452 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125089823 0 0) 0x7fd9c8070400 con 0x7fd9c806b240 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.177+0000 7fd9cc864640 1 -- 172.21.15.120:0/3270261452 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b4003520 con 0x7fd9c806b240 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cc864640 1 -- 172.21.15.120:0/3270261452 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1790796175 0 0) 0x7fd9b4003520 con 0x7fd9c806b240 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cc864640 1 -- 172.21.15.120:0/3270261452 >> v2:172.21.15.155:3300/0 conn(0x7fd9c806fe70 msgr2=0x7fd9c806ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cc864640 1 --2- 172.21.15.120:0/3270261452 >> v2:172.21.15.155:3300/0 conn(0x7fd9c806fe70 0x7fd9c806ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cc864640 1 -- 172.21.15.120:0/3270261452 >> v1:172.21.15.155:6789/0 conn(0x7fd9c80b68f0 legacy=0x7fd9c80b9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cc864640 1 -- 172.21.15.120:0/3270261452 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c80706e0 con 0x7fd9c806b240 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cc864640 1 -- 172.21.15.120:0/3270261452 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7fd9c0001670 con 0x7fd9c806b240 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cc864640 1 -- 172.21.15.120:0/3270261452 >> v1:172.21.15.120:6789/0 conn(0x7fd9c806b240 legacy=0x7fd9c8142590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cc864640 1 --2- 172.21.15.120:0/3270261452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9b4003970 0x7fd9b4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cc864640 1 --2- 172.21.15.120:0/3270261452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b4004370 0x7fd9b4004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cc864640 1 --2- 172.21.15.120:0/3270261452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b40050e0 0x7fd9b400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cc864640 1 -- 172.21.15.120:0/3270261452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80714f0 con 0x7fd9b4003970 2023-12-19T05:39:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cc864640 1 -- 172.21.15.120:0/3270261452 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b400c020 con 0x7fd9b40050e0 2023-12-19T05:39:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cc864640 1 -- 172.21.15.120:0/3270261452 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b400c1e0 con 0x7fd9b4004370 2023-12-19T05:39:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cd866640 1 --2- 172.21.15.120:0/3270261452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9b4003970 0x7fd9b4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9ce067640 1 --2- 172.21.15.120:0/3270261452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b40050e0 0x7fd9b400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cd065640 1 --2- 172.21.15.120:0/3270261452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b4004370 0x7fd9b4004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cd866640 1 -- 172.21.15.120:0/3270261452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b4004370 msgr2=0x7fd9b4004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cd866640 1 --2- 172.21.15.120:0/3270261452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b4004370 0x7fd9b4004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cd866640 1 -- 172.21.15.120:0/3270261452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b40050e0 msgr2=0x7fd9b400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cd866640 1 --2- 172.21.15.120:0/3270261452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9b40050e0 0x7fd9b400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cd866640 1 -- 172.21.15.120:0/3270261452 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b4003520 con 0x7fd9b4003970 2023-12-19T05:39:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9ce067640 1 -- 172.21.15.120:0/3270261452 reap_dead start 2023-12-19T05:39:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.178+0000 7fd9cd065640 1 --2- 172.21.15.120:0/3270261452 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9b4004370 0x7fd9b4004840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.179+0000 7fd9cd866640 1 --2- 172.21.15.120:0/3270261452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9b4003970 0x7fd9b4003d50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4001f60 tx=0x7fd9b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e062d511ef9d43db server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:16.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.179+0000 7fd9cc864640 1 -- 172.21.15.120:0/3270261452 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c402d6f0 con 0x7fd9b4003970 2023-12-19T05:39:16.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.179+0000 7fd9cc864640 1 -- 172.21.15.120:0/3270261452 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c402d870 con 0x7fd9b4003970 2023-12-19T05:39:16.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.179+0000 7fd9cc864640 1 -- 172.21.15.120:0/3270261452 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c402dc20 con 0x7fd9b4003970 2023-12-19T05:39:16.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.179+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3270261452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9b4003970 msgr2=0x7fd9b4003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.179+0000 7fd9cfaca640 1 --2- 172.21.15.120:0/3270261452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9b4003970 0x7fd9b4003d50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4001f60 tx=0x7fd9b40057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.180+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3270261452 shutdown_connections 2023-12-19T05:39:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.180+0000 7fd9cfaca640 1 --2- 172.21.15.120:0/3270261452 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9b4003970 0x7fd9b4003d50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.180+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3270261452 >> 172.21.15.120:0/3270261452 conn(0x7fd9c80bd070 msgr2=0x7fd9c80bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.180+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3270261452 shutdown_connections 2023-12-19T05:39:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.180+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3270261452 wait complete. 2023-12-19T05:39:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.181+0000 7fd9cfaca640 1 Processor -- start 2023-12-19T05:39:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.181+0000 7fd9cfaca640 1 -- start start 2023-12-19T05:39:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.181+0000 7fd9cfaca640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9b4003970 0x7fd9c8141b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.181+0000 7fd9cfaca640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9c81dd870 0x7fd9c8134370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.181+0000 7fd9cfaca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c81348b0 0x7fd9c81d1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.181+0000 7fd9cfaca640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c8140260 con 0x7fd9b4003970 2023-12-19T05:39:16.187 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.181+0000 7fd9cfaca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c81416c0 con 0x7fd9c81348b0 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.181+0000 7fd9cfaca640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c813fa30 con 0x7fd9c81dd870 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.181+0000 7fd9cd866640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9b4003970 0x7fd9c8141b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.181+0000 7fd9cd866640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9b4003970 0x7fd9c8141b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47438/0 (socket says 172.21.15.120:47438) 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.181+0000 7fd9cd866640 1 -- 172.21.15.120:0/3889565203 learned_addr learned my addr 172.21.15.120:0/3889565203 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.181+0000 7fd9ce067640 1 --2- 172.21.15.120:0/3889565203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c81348b0 0x7fd9c81d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.181+0000 7fd9cd065640 1 --2- 172.21.15.120:0/3889565203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9c81dd870 0x7fd9c8134370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.182+0000 7fd9cd866640 1 -- 172.21.15.120:0/3889565203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9c81dd870 msgr2=0x7fd9c8134370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.182+0000 7fd9cd866640 1 --2- 172.21.15.120:0/3889565203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9c81dd870 0x7fd9c8134370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.182+0000 7fd9cd866640 1 -- 172.21.15.120:0/3889565203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c81348b0 msgr2=0x7fd9c81d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.182+0000 7fd9cd866640 1 --2- 172.21.15.120:0/3889565203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c81348b0 0x7fd9c81d1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.182+0000 7fd9cd866640 1 -- 172.21.15.120:0/3889565203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c81d24b0 con 0x7fd9b4003970 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.182+0000 7fd9cd866640 1 --2- 172.21.15.120:0/3889565203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9b4003970 0x7fd9c8141b50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd9c402c080 tx=0x7fd9c40015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.182+0000 7fd9be7fc640 1 -- 172.21.15.120:0/3889565203 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c402de80 con 0x7fd9b4003970 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.182+0000 7fd9be7fc640 1 -- 172.21.15.120:0/3889565203 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c4035850 con 0x7fd9b4003970 2023-12-19T05:39:16.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.182+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3889565203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c81d2790 con 0x7fd9b4003970 2023-12-19T05:39:16.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.182+0000 7fd9be7fc640 1 -- 172.21.15.120:0/3889565203 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4035bc0 con 0x7fd9b4003970 2023-12-19T05:39:16.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.182+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3889565203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c81d0a70 con 0x7fd9b4003970 2023-12-19T05:39:16.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.183+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3889565203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c8142090 con 0x7fd9b4003970 2023-12-19T05:39:16.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.183+0000 7fd9be7fc640 1 -- 172.21.15.120:0/3889565203 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd9c4035d20 con 0x7fd9b4003970 2023-12-19T05:39:16.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.184+0000 7fd9be7fc640 1 --2- 172.21.15.120:0/3889565203 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd9ac06a460 0x7fd9ac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.184+0000 7fd9cd065640 1 --2- 172.21.15.120:0/3889565203 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd9ac06a460 0x7fd9ac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.184+0000 7fd9be7fc640 1 -- 172.21.15.120:0/3889565203 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9c4031070 con 0x7fd9b4003970 2023-12-19T05:39:16.189 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.184+0000 7fd9cd065640 1 --2- 172.21.15.120:0/3889565203 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd9ac06a460 0x7fd9ac06c920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80722e0 tx=0x7fd9b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:16.190 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.188+0000 7fd9be7fc640 1 -- 172.21.15.120:0/3889565203 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd9c4076640 con 0x7fd9b4003970 2023-12-19T05:39:16.355 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.353+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3889565203 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9c8140260 con 0x7fd9b4003970 2023-12-19T05:39:16.355 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.353+0000 7fd9be7fc640 1 -- 172.21.15.120:0/3889565203 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9c40473b0 con 0x7fd9b4003970 2023-12-19T05:39:16.355 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2023-12-19T05:39:16.357 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.355+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3889565203 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd9ac06a460 msgr2=0x7fd9ac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.355+0000 7fd9cfaca640 1 --2- 172.21.15.120:0/3889565203 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd9ac06a460 0x7fd9ac06c920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80722e0 tx=0x7fd9b8008040 comp rx=0 tx=0).stop 2023-12-19T05:39:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.355+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3889565203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9b4003970 msgr2=0x7fd9c8141b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.355+0000 7fd9cfaca640 1 --2- 172.21.15.120:0/3889565203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9b4003970 0x7fd9c8141b50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd9c402c080 tx=0x7fd9c40015b0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.355+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3889565203 shutdown_connections 2023-12-19T05:39:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.355+0000 7fd9cfaca640 1 --2- 172.21.15.120:0/3889565203 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd9ac06a460 0x7fd9ac06c920 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.355+0000 7fd9cfaca640 1 --2- 172.21.15.120:0/3889565203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd9c81348b0 0x7fd9c81d1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.355+0000 7fd9cfaca640 1 --2- 172.21.15.120:0/3889565203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd9c81dd870 0x7fd9c8134370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.355+0000 7fd9cfaca640 1 --2- 172.21.15.120:0/3889565203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd9b4003970 0x7fd9c8141b50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.355+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3889565203 >> 172.21.15.120:0/3889565203 conn(0x7fd9c80bd070 msgr2=0x7fd9c80bc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.355+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3889565203 shutdown_connections 2023-12-19T05:39:16.358 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.355+0000 7fd9cfaca640 1 -- 172.21.15.120:0/3889565203 wait complete. 2023-12-19T05:39:16.368 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:16.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.467+0000 7f21b0638640 1 Processor -- start 2023-12-19T05:39:16.469 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.467+0000 7f21b0638640 1 -- start start 2023-12-19T05:39:16.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21b0638640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f21a8144d70 0x7f21a80b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21b0638640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a8145150 con 0x7f21a80bc7e0 2023-12-19T05:39:16.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21b0638640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a80b9080 con 0x7f21a814df70 2023-12-19T05:39:16.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21b0638640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a80b9f00 con 0x7f21a8144d70 2023-12-19T05:39:16.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21aebd5640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f21a80bc7e0 0x7f21a80bcc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37172/0 (socket says 172.21.15.120:37172) 2023-12-19T05:39:16.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21aebd5640 1 -- 172.21.15.120:0/1003637302 learned_addr learned my addr 172.21.15.120:0/1003637302 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:16.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 -- 172.21.15.120:0/1003637302 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634212139 0 0) 0x7f21a8145150 con 0x7f21a80bc7e0 2023-12-19T05:39:16.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 -- 172.21.15.120:0/1003637302 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2194003520 con 0x7f21a80bc7e0 2023-12-19T05:39:16.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ae3d4640 1 --2- 172.21.15.120:0/1003637302 >> v2:172.21.15.155:3300/0 conn(0x7f21a8144d70 0x7f21a80b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 -- 172.21.15.120:0/1003637302 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2450554123 0 0) 0x7f2194003520 con 0x7f21a80bc7e0 2023-12-19T05:39:16.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 -- 172.21.15.120:0/1003637302 >> v2:172.21.15.155:3300/0 conn(0x7f21a8144d70 msgr2=0x7f21a80b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:16.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 --2- 172.21.15.120:0/1003637302 >> v2:172.21.15.155:3300/0 conn(0x7f21a8144d70 0x7f21a80b7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 -- 172.21.15.120:0/1003637302 >> v1:172.21.15.155:6789/0 conn(0x7f21a814df70 legacy=0x7f21a80b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 -- 172.21.15.120:0/1003637302 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a80b9360 con 0x7f21a80bc7e0 2023-12-19T05:39:16.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 -- 172.21.15.120:0/1003637302 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f21a00019f0 con 0x7f21a80bc7e0 2023-12-19T05:39:16.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 -- 172.21.15.120:0/1003637302 >> v1:172.21.15.120:6789/0 conn(0x7f21a80bc7e0 legacy=0x7f21a80bcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 --2- 172.21.15.120:0/1003637302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2194003970 0x7f2194003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.473 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 --2- 172.21.15.120:0/1003637302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21940047c0 0x7f2194004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 --2- 172.21.15.120:0/1003637302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2194005180 0x7f219400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 -- 172.21.15.120:0/1003637302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80b9f00 con 0x7f2194003970 2023-12-19T05:39:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 -- 172.21.15.120:0/1003637302 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219400c030 con 0x7f2194005180 2023-12-19T05:39:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ad3d2640 1 -- 172.21.15.120:0/1003637302 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219400c1f0 con 0x7f21940047c0 2023-12-19T05:39:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21ae3d4640 1 --2- 172.21.15.120:0/1003637302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2194003970 0x7f2194003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21aebd5640 1 --2- 172.21.15.120:0/1003637302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2194005180 0x7f219400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.468+0000 7f21adbd3640 1 --2- 172.21.15.120:0/1003637302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21940047c0 0x7f2194004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.469+0000 7f21ae3d4640 1 -- 172.21.15.120:0/1003637302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21940047c0 msgr2=0x7f2194004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.469+0000 7f21ae3d4640 1 --2- 172.21.15.120:0/1003637302 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21940047c0 0x7f2194004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.469+0000 7f21ae3d4640 1 -- 172.21.15.120:0/1003637302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2194005180 msgr2=0x7f219400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.469+0000 7f21ae3d4640 1 --2- 172.21.15.120:0/1003637302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2194005180 0x7f219400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.469+0000 7f21ae3d4640 1 -- 172.21.15.120:0/1003637302 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2194003520 con 0x7f2194003970 2023-12-19T05:39:16.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.469+0000 7f21aebd5640 1 -- 172.21.15.120:0/1003637302 reap_dead start 2023-12-19T05:39:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.469+0000 7f21ae3d4640 1 --2- 172.21.15.120:0/1003637302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2194003970 0x7f2194003d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009ac0 tx=0x7f21940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ce86a4689b7c35 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.469+0000 7f21ad3d2640 1 -- 172.21.15.120:0/1003637302 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a402c6b0 con 0x7f2194003970 2023-12-19T05:39:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.469+0000 7f21ad3d2640 1 -- 172.21.15.120:0/1003637302 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a402c810 con 0x7f2194003970 2023-12-19T05:39:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.469+0000 7f21ad3d2640 1 -- 172.21.15.120:0/1003637302 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a402cba0 con 0x7f2194003970 2023-12-19T05:39:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.470+0000 7f21b0638640 1 -- 172.21.15.120:0/1003637302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2194003970 msgr2=0x7f2194003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.470+0000 7f21b0638640 1 --2- 172.21.15.120:0/1003637302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2194003970 0x7f2194003d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f21a4009ac0 tx=0x7f21940057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.470+0000 7f21b0638640 1 -- 172.21.15.120:0/1003637302 shutdown_connections 2023-12-19T05:39:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.470+0000 7f21b0638640 1 --2- 172.21.15.120:0/1003637302 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2194003970 0x7f2194003d90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.470+0000 7f21b0638640 1 -- 172.21.15.120:0/1003637302 >> 172.21.15.120:0/1003637302 conn(0x7f21a8071430 msgr2=0x7f21a8071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.470+0000 7f21b0638640 1 -- 172.21.15.120:0/1003637302 shutdown_connections 2023-12-19T05:39:16.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.470+0000 7f21b0638640 1 -- 172.21.15.120:0/1003637302 wait complete. 2023-12-19T05:39:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.471+0000 7f21b0638640 1 Processor -- start 2023-12-19T05:39:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.471+0000 7f21b0638640 1 -- start start 2023-12-19T05:39:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21b0638640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2194003970 0x7f21a80c0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21b0638640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a814b910 0x7f21a80c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21b0638640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21a81dfd20 0x7f21a81e01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21b0638640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a81e0710 con 0x7f2194003970 2023-12-19T05:39:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21b0638640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a81df8d0 con 0x7f21a81dfd20 2023-12-19T05:39:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21b0638640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80be770 con 0x7f21a814b910 2023-12-19T05:39:16.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21ae3d4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2194003970 0x7f21a80c0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21ae3d4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2194003970 0x7f21a80c0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47446/0 (socket says 172.21.15.120:47446) 2023-12-19T05:39:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21ae3d4640 1 -- 172.21.15.120:0/786385663 learned_addr learned my addr 172.21.15.120:0/786385663 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21ae3d4640 1 -- 172.21.15.120:0/786385663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a814b910 msgr2=0x7f21a80c07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21ae3d4640 1 --2- 172.21.15.120:0/786385663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a814b910 0x7f21a80c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21ae3d4640 1 -- 172.21.15.120:0/786385663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21a81dfd20 msgr2=0x7f21a81e01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21ae3d4640 1 --2- 172.21.15.120:0/786385663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21a81dfd20 0x7f21a81e01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21ae3d4640 1 -- 172.21.15.120:0/786385663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a80be9c0 con 0x7f2194003970 2023-12-19T05:39:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21ae3d4640 1 --2- 172.21.15.120:0/786385663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2194003970 0x7f21a80c0260 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f21a4037040 tx=0x7f21a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f219effd640 1 -- 172.21.15.120:0/786385663 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a4003810 con 0x7f2194003970 2023-12-19T05:39:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f219effd640 1 -- 172.21.15.120:0/786385663 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a4003970 con 0x7f2194003970 2023-12-19T05:39:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21b0638640 1 -- 172.21.15.120:0/786385663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a80beca0 con 0x7f2194003970 2023-12-19T05:39:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f219effd640 1 -- 172.21.15.120:0/786385663 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a4003d00 con 0x7f2194003970 2023-12-19T05:39:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.472+0000 7f21b0638640 1 -- 172.21.15.120:0/786385663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a80bf470 con 0x7f2194003970 2023-12-19T05:39:16.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.473+0000 7f21b0638640 1 -- 172.21.15.120:0/786385663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a804e080 con 0x7f2194003970 2023-12-19T05:39:16.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.474+0000 7f219effd640 1 -- 172.21.15.120:0/786385663 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f21a4034440 con 0x7f2194003970 2023-12-19T05:39:16.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.474+0000 7f219effd640 1 --2- 172.21.15.120:0/786385663 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f218c06a460 0x7f218c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.474+0000 7f219effd640 1 -- 172.21.15.120:0/786385663 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21a40aa6c0 con 0x7f2194003970 2023-12-19T05:39:16.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.474+0000 7f21adbd3640 1 --2- 172.21.15.120:0/786385663 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f218c06a460 0x7f218c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.475+0000 7f21adbd3640 1 --2- 172.21.15.120:0/786385663 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f218c06a460 0x7f218c06c920 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2198007fd0 tx=0x7f2198009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:16.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.479+0000 7f219effd640 1 -- 172.21.15.120:0/786385663 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f21a4075f10 con 0x7f2194003970 2023-12-19T05:39:16.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.644+0000 7f21b0638640 1 -- 172.21.15.120:0/786385663 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21a8069e40 con 0x7f2194003970 2023-12-19T05:39:16.646 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.645+0000 7f219effd640 1 -- 172.21.15.120:0/786385663 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21a4079530 con 0x7f2194003970 2023-12-19T05:39:16.646 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2023-12-19T05:39:16.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.647+0000 7f21b0638640 1 -- 172.21.15.120:0/786385663 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f218c06a460 msgr2=0x7f218c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.647+0000 7f21b0638640 1 --2- 172.21.15.120:0/786385663 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f218c06a460 0x7f218c06c920 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2198007fd0 tx=0x7f2198009040 comp rx=0 tx=0).stop 2023-12-19T05:39:16.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.647+0000 7f21b0638640 1 -- 172.21.15.120:0/786385663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2194003970 msgr2=0x7f21a80c0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.647+0000 7f21b0638640 1 --2- 172.21.15.120:0/786385663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2194003970 0x7f21a80c0260 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f21a4037040 tx=0x7f21a4004730 comp rx=0 tx=0).stop 2023-12-19T05:39:16.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.647+0000 7f21b0638640 1 -- 172.21.15.120:0/786385663 shutdown_connections 2023-12-19T05:39:16.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.647+0000 7f21b0638640 1 --2- 172.21.15.120:0/786385663 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f218c06a460 0x7f218c06c920 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.648 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.647+0000 7f21b0638640 1 --2- 172.21.15.120:0/786385663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21a81dfd20 0x7f21a81e01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.647+0000 7f21b0638640 1 --2- 172.21.15.120:0/786385663 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21a814b910 0x7f21a80c07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.647+0000 7f21b0638640 1 --2- 172.21.15.120:0/786385663 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2194003970 0x7f21a80c0260 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.647+0000 7f21b0638640 1 -- 172.21.15.120:0/786385663 >> 172.21.15.120:0/786385663 conn(0x7f21a8071430 msgr2=0x7f21a80b3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.647+0000 7f21b0638640 1 -- 172.21.15.120:0/786385663 shutdown_connections 2023-12-19T05:39:16.649 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.647+0000 7f21b0638640 1 -- 172.21.15.120:0/786385663 wait complete. 2023-12-19T05:39:16.659 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:16.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.760+0000 7f91bd6c4640 1 Processor -- start 2023-12-19T05:39:16.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.760+0000 7f91bd6c4640 1 -- start start 2023-12-19T05:39:16.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.761+0000 7f91bd6c4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f91b8144d70 0x7f91b80b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.761+0000 7f91bd6c4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f91b814df70 0x7f91b80b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.761+0000 7f91bd6c4640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b8145150 con 0x7f91b80bc7e0 2023-12-19T05:39:16.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.761+0000 7f91bd6c4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b80b9f00 con 0x7f91b8144d70 2023-12-19T05:39:16.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.761+0000 7f91bd6c4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b80b84b0 con 0x7f91b814df70 2023-12-19T05:39:16.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.761+0000 7f91b6ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f91b8144d70 0x7f91b80b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.761+0000 7f91b6ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f91b8144d70 0x7f91b80b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47456/0 (socket says 172.21.15.120:47456) 2023-12-19T05:39:16.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.761+0000 7f91b6ffd640 1 -- 172.21.15.120:0/931185090 learned_addr learned my addr 172.21.15.120:0/931185090 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:16.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.761+0000 7f91b6ffd640 1 -- 172.21.15.120:0/931185090 >> v2:172.21.15.155:3300/0 conn(0x7f91b814df70 msgr2=0x7f91b80b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:16.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.761+0000 7f91b6ffd640 1 --2- 172.21.15.120:0/931185090 >> v2:172.21.15.155:3300/0 conn(0x7f91b814df70 0x7f91b80b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.761+0000 7f91b6ffd640 1 -- 172.21.15.120:0/931185090 >> v1:172.21.15.155:6789/0 conn(0x7f91b80bc7e0 legacy=0x7f91b80bcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:16.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.761+0000 7f91b6ffd640 1 -- 172.21.15.120:0/931185090 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80b9080 con 0x7f91b8144d70 2023-12-19T05:39:16.765 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.762+0000 7f91b6ffd640 1 --2- 172.21.15.120:0/931185090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91b8144d70 0x7f91b80b7f70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f91b81485f0 tx=0x7f91a802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff5a1222e791429 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:16.765 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.762+0000 7f91b5ffb640 1 -- 172.21.15.120:0/931185090 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a802cb20 con 0x7f91b8144d70 2023-12-19T05:39:16.765 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.762+0000 7f91b5ffb640 1 -- 172.21.15.120:0/931185090 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a802cc80 con 0x7f91b8144d70 2023-12-19T05:39:16.765 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.762+0000 7f91b5ffb640 1 -- 172.21.15.120:0/931185090 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80343f0 con 0x7f91b8144d70 2023-12-19T05:39:16.765 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.762+0000 7f91bd6c4640 1 -- 172.21.15.120:0/931185090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91b8144d70 msgr2=0x7f91b80b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.765 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.762+0000 7f91bd6c4640 1 --2- 172.21.15.120:0/931185090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91b8144d70 0x7f91b80b7f70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f91b81485f0 tx=0x7f91a802bf80 comp rx=0 tx=0).stop 2023-12-19T05:39:16.765 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.762+0000 7f91bd6c4640 1 -- 172.21.15.120:0/931185090 shutdown_connections 2023-12-19T05:39:16.765 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.762+0000 7f91bd6c4640 1 --2- 172.21.15.120:0/931185090 >> v2:172.21.15.155:3300/0 conn(0x7f91b814df70 0x7f91b80b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.765 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.762+0000 7f91bd6c4640 1 --2- 172.21.15.120:0/931185090 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91b8144d70 0x7f91b80b7f70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.765 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.762+0000 7f91bd6c4640 1 -- 172.21.15.120:0/931185090 >> 172.21.15.120:0/931185090 conn(0x7f91b8071430 msgr2=0x7f91b8071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.765 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.762+0000 7f91bd6c4640 1 -- 172.21.15.120:0/931185090 shutdown_connections 2023-12-19T05:39:16.766 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.763+0000 7f91bd6c4640 1 -- 172.21.15.120:0/931185090 wait complete. 2023-12-19T05:39:16.766 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.764+0000 7f91bd6c4640 1 Processor -- start 2023-12-19T05:39:16.766 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.764+0000 7f91bd6c4640 1 -- start start 2023-12-19T05:39:16.768 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.764+0000 7f91bd6c4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80bc7e0 0x7f91b814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.768 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.764+0000 7f91bd6c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91b8144d70 0x7f91b80a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.768 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.764+0000 7f91bd6c4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91b814df70 0x7f91b81dfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.768 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.764+0000 7f91bd6c4640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b81df9f0 con 0x7f91b8144d70 2023-12-19T05:39:16.768 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.764+0000 7f91bd6c4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b814d630 con 0x7f91b80bc7e0 2023-12-19T05:39:16.768 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.764+0000 7f91bd6c4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80abcf0 con 0x7f91b814df70 2023-12-19T05:39:16.768 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.764+0000 7f91b67fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91b8144d70 0x7f91b80a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.764+0000 7f91b67fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91b8144d70 0x7f91b80a90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47470/0 (socket says 172.21.15.120:47470) 2023-12-19T05:39:16.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.764+0000 7f91b67fc640 1 -- 172.21.15.120:0/2554069956 learned_addr learned my addr 172.21.15.120:0/2554069956 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:16.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.765+0000 7f91b6ffd640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80bc7e0 0x7f91b814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.765+0000 7f91b77fe640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91b814df70 0x7f91b81dfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.765+0000 7f91b67fc640 1 -- 172.21.15.120:0/2554069956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91b814df70 msgr2=0x7f91b81dfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.765+0000 7f91b67fc640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91b814df70 0x7f91b81dfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.765+0000 7f91b67fc640 1 -- 172.21.15.120:0/2554069956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80bc7e0 msgr2=0x7f91b814d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.765+0000 7f91b67fc640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80bc7e0 0x7f91b814d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.765+0000 7f91b67fc640 1 -- 172.21.15.120:0/2554069956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8009b30 con 0x7f91b8144d70 2023-12-19T05:39:16.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.765+0000 7f91b6ffd640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80bc7e0 0x7f91b814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:16.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.765+0000 7f91b67fc640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91b8144d70 0x7f91b80a90d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00b470 tx=0x7f91ac00b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:16.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.765+0000 7f919f7fe640 1 -- 172.21.15.120:0/2554069956 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac011890 con 0x7f91b8144d70 2023-12-19T05:39:16.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.765+0000 7f919f7fe640 1 -- 172.21.15.120:0/2554069956 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac011a10 con 0x7f91b8144d70 2023-12-19T05:39:16.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.765+0000 7f919f7fe640 1 -- 172.21.15.120:0/2554069956 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac011dc0 con 0x7f91b8144d70 2023-12-19T05:39:16.770 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.765+0000 7f91bd6c4640 1 -- 172.21.15.120:0/2554069956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b80b67b0 con 0x7f91b8144d70 2023-12-19T05:39:16.770 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.765+0000 7f91bd6c4640 1 -- 172.21.15.120:0/2554069956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b80ad240 con 0x7f91b8144d70 2023-12-19T05:39:16.770 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.766+0000 7f91bd6c4640 1 -- 172.21.15.120:0/2554069956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b804e080 con 0x7f91b8144d70 2023-12-19T05:39:16.770 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.766+0000 7f919f7fe640 1 -- 172.21.15.120:0/2554069956 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f91ac01a400 con 0x7f91b8144d70 2023-12-19T05:39:16.770 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.767+0000 7f919f7fe640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f91a406a460 0x7f91a406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:16.770 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.767+0000 7f919f7fe640 1 -- 172.21.15.120:0/2554069956 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91ac088d40 con 0x7f91b8144d70 2023-12-19T05:39:16.770 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.767+0000 7f91b6ffd640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f91a406a460 0x7f91a406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:16.770 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.767+0000 7f91b6ffd640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f91a406a460 0x7f91a406c920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f91a8035000 tx=0x7f91a8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:16.772 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.771+0000 7f919f7fe640 1 -- 172.21.15.120:0/2554069956 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f91ac0542a0 con 0x7f91b8144d70 2023-12-19T05:39:16.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.936+0000 7f91bd6c4640 1 -- 172.21.15.120:0/2554069956 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91b80b6940 con 0x7f91b8144d70 2023-12-19T05:39:16.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.936+0000 7f919f7fe640 1 -- 172.21.15.120:0/2554069956 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91b80b6940 con 0x7f91b8144d70 2023-12-19T05:39:16.938 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2023-12-19T05:39:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.938+0000 7f91bd6c4640 1 -- 172.21.15.120:0/2554069956 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f91a406a460 msgr2=0x7f91a406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.938+0000 7f91bd6c4640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f91a406a460 0x7f91a406c920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f91a8035000 tx=0x7f91a8030000 comp rx=0 tx=0).stop 2023-12-19T05:39:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.938+0000 7f91bd6c4640 1 -- 172.21.15.120:0/2554069956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91b8144d70 msgr2=0x7f91b80a90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.938+0000 7f91bd6c4640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91b8144d70 0x7f91b80a90d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00b470 tx=0x7f91ac00b930 comp rx=0 tx=0).stop 2023-12-19T05:39:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.938+0000 7f91bd6c4640 1 -- 172.21.15.120:0/2554069956 shutdown_connections 2023-12-19T05:39:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.938+0000 7f91bd6c4640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f91a406a460 0x7f91a406c920 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.938+0000 7f91bd6c4640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f91b814df70 0x7f91b81dfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.938+0000 7f91bd6c4640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f91b8144d70 0x7f91b80a90d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.938+0000 7f91bd6c4640 1 --2- 172.21.15.120:0/2554069956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91b80bc7e0 0x7f91b814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.938+0000 7f91bd6c4640 1 -- 172.21.15.120:0/2554069956 >> 172.21.15.120:0/2554069956 conn(0x7f91b8071430 msgr2=0x7f91b80be400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.938+0000 7f91bd6c4640 1 -- 172.21.15.120:0/2554069956 shutdown_connections 2023-12-19T05:39:16.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:16.938+0000 7f91bd6c4640 1 -- 172.21.15.120:0/2554069956 wait complete. 2023-12-19T05:39:16.950 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:17.053 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.049+0000 7f96f18b6640 1 Processor -- start 2023-12-19T05:39:17.053 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.049+0000 7f96f18b6640 1 -- start start 2023-12-19T05:39:17.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.049+0000 7f96f18b6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f96ec0b79b0 0x7f96ec0b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.049+0000 7f96f18b6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96ec14b230 0x7f96ec14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.049+0000 7f96f18b6640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ec0b96b0 con 0x7f96ec0b8860 2023-12-19T05:39:17.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.049+0000 7f96f18b6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ec14ae10 con 0x7f96ec0b79b0 2023-12-19T05:39:17.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.049+0000 7f96f18b6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0bacc0 con 0x7f96ec14b230 2023-12-19T05:39:17.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96e3fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f96ec0b8860 0x7f96ec144ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37188/0 (socket says 172.21.15.120:37188) 2023-12-19T05:39:17.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96e3fff640 1 -- 172.21.15.120:0/1309200436 learned_addr learned my addr 172.21.15.120:0/1309200436 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:17.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96eaffd640 1 --2- 172.21.15.120:0/1309200436 >> v2:172.21.15.155:3300/0 conn(0x7f96ec0b79b0 0x7f96ec0b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96eb7fe640 1 --2- 172.21.15.120:0/1309200436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96ec14b230 0x7f96ec14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 -- 172.21.15.120:0/1309200436 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264460749 0 0) 0x7f96ec0b96b0 con 0x7f96ec0b8860 2023-12-19T05:39:17.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 -- 172.21.15.120:0/1309200436 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96d8003520 con 0x7f96ec0b8860 2023-12-19T05:39:17.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 -- 172.21.15.120:0/1309200436 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 658543762 0 0) 0x7f96d8003520 con 0x7f96ec0b8860 2023-12-19T05:39:17.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 -- 172.21.15.120:0/1309200436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96ec14b230 msgr2=0x7f96ec14b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:17.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 --2- 172.21.15.120:0/1309200436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96ec14b230 0x7f96ec14b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 -- 172.21.15.120:0/1309200436 >> v2:172.21.15.155:3300/0 conn(0x7f96ec0b79b0 msgr2=0x7f96ec0b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 --2- 172.21.15.120:0/1309200436 >> v2:172.21.15.155:3300/0 conn(0x7f96ec0b79b0 0x7f96ec0b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 -- 172.21.15.120:0/1309200436 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec0b90f0 con 0x7f96ec0b8860 2023-12-19T05:39:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 -- 172.21.15.120:0/1309200436 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f96d4001670 con 0x7f96ec0b8860 2023-12-19T05:39:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96eaffd640 1 --2- 172.21.15.120:0/1309200436 >> v2:172.21.15.155:3300/0 conn(0x7f96ec0b79b0 0x7f96ec0b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 -- 172.21.15.120:0/1309200436 >> v1:172.21.15.120:6789/0 conn(0x7f96ec0b8860 legacy=0x7f96ec144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 --2- 172.21.15.120:0/1309200436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96d8003970 0x7f96d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 --2- 172.21.15.120:0/1309200436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96d80047c0 0x7f96d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 --2- 172.21.15.120:0/1309200436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96ec14b230 0x7f96d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 -- 172.21.15.120:0/1309200436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec14ae10 con 0x7f96d80047c0 2023-12-19T05:39:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 -- 172.21.15.120:0/1309200436 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d800b980 con 0x7f96d8003970 2023-12-19T05:39:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96ea7fc640 1 -- 172.21.15.120:0/1309200436 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d800bac0 con 0x7f96ec14b230 2023-12-19T05:39:17.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96e3fff640 1 --2- 172.21.15.120:0/1309200436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96d80047c0 0x7f96d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96eaffd640 1 --2- 172.21.15.120:0/1309200436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96d8003970 0x7f96d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96eb7fe640 1 --2- 172.21.15.120:0/1309200436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96ec14b230 0x7f96d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96e3fff640 1 -- 172.21.15.120:0/1309200436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96ec14b230 msgr2=0x7f96d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96e3fff640 1 --2- 172.21.15.120:0/1309200436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96ec14b230 0x7f96d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96e3fff640 1 -- 172.21.15.120:0/1309200436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96d8003970 msgr2=0x7f96d8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.050+0000 7f96e3fff640 1 --2- 172.21.15.120:0/1309200436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96d8003970 0x7f96d8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.051+0000 7f96e3fff640 1 -- 172.21.15.120:0/1309200436 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d8003520 con 0x7f96d80047c0 2023-12-19T05:39:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.051+0000 7f96eb7fe640 1 --2- 172.21.15.120:0/1309200436 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96ec14b230 0x7f96d8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.051+0000 7f96e3fff640 1 --2- 172.21.15.120:0/1309200436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96d80047c0 0x7f96d8004c40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f96d400c240 tx=0x7f96d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497071f6c4d366ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.051+0000 7f96ea7fc640 1 -- 172.21.15.120:0/1309200436 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d402cb00 con 0x7f96d80047c0 2023-12-19T05:39:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.051+0000 7f96ea7fc640 1 -- 172.21.15.120:0/1309200436 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d402cc60 con 0x7f96d80047c0 2023-12-19T05:39:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.051+0000 7f96ea7fc640 1 -- 172.21.15.120:0/1309200436 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4005af0 con 0x7f96d80047c0 2023-12-19T05:39:17.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.052+0000 7f96f18b6640 1 -- 172.21.15.120:0/1309200436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96d80047c0 msgr2=0x7f96d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.052+0000 7f96f18b6640 1 --2- 172.21.15.120:0/1309200436 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96d80047c0 0x7f96d8004c40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f96d400c240 tx=0x7f96d80057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.052+0000 7f96eb7fe640 1 -- 172.21.15.120:0/1309200436 reap_dead start 2023-12-19T05:39:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.052+0000 7f96f18b6640 1 -- 172.21.15.120:0/1309200436 shutdown_connections 2023-12-19T05:39:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.052+0000 7f96f18b6640 1 -- 172.21.15.120:0/1309200436 >> 172.21.15.120:0/1309200436 conn(0x7f96ec0c0340 msgr2=0x7f96ec0c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.052+0000 7f96f18b6640 1 -- 172.21.15.120:0/1309200436 shutdown_connections 2023-12-19T05:39:17.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.052+0000 7f96f18b6640 1 -- 172.21.15.120:0/1309200436 wait complete. 2023-12-19T05:39:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.053+0000 7f96f18b6640 1 Processor -- start 2023-12-19T05:39:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.053+0000 7f96f18b6640 1 -- start start 2023-12-19T05:39:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.053+0000 7f96f18b6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d80047c0 0x7f96ec148df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.053+0000 7f96f18b6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96ec09aa20 0x7f96ec1e37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.053+0000 7f96f18b6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96ec1e3cf0 0x7f96ec143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.053+0000 7f96f18b6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec149330 con 0x7f96ec1e3cf0 2023-12-19T05:39:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.053+0000 7f96f18b6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec1e3320 con 0x7f96ec09aa20 2023-12-19T05:39:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.053+0000 7f96f18b6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec09af80 con 0x7f96d80047c0 2023-12-19T05:39:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96eb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96ec1e3cf0 0x7f96ec143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96eb7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96ec1e3cf0 0x7f96ec143f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47494/0 (socket says 172.21.15.120:47494) 2023-12-19T05:39:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96eb7fe640 1 -- 172.21.15.120:0/1038590461 learned_addr learned my addr 172.21.15.120:0/1038590461 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96eaffd640 1 --2- 172.21.15.120:0/1038590461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d80047c0 0x7f96ec148df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96e3fff640 1 --2- 172.21.15.120:0/1038590461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96ec09aa20 0x7f96ec1e37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96eb7fe640 1 -- 172.21.15.120:0/1038590461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d80047c0 msgr2=0x7f96ec148df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96eb7fe640 1 --2- 172.21.15.120:0/1038590461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d80047c0 0x7f96ec148df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96eb7fe640 1 -- 172.21.15.120:0/1038590461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96ec09aa20 msgr2=0x7f96ec1e37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96eb7fe640 1 --2- 172.21.15.120:0/1038590461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96ec09aa20 0x7f96ec1e37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96eb7fe640 1 -- 172.21.15.120:0/1038590461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec09b260 con 0x7f96ec1e3cf0 2023-12-19T05:39:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96eb7fe640 1 --2- 172.21.15.120:0/1038590461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96ec1e3cf0 0x7f96ec143f80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0bcd90 tx=0x7f96e4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96e8ff9640 1 -- 172.21.15.120:0/1038590461 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e401b070 con 0x7f96ec1e3cf0 2023-12-19T05:39:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96e8ff9640 1 -- 172.21.15.120:0/1038590461 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e400f040 con 0x7f96ec1e3cf0 2023-12-19T05:39:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96f18b6640 1 -- 172.21.15.120:0/1038590461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ec09f360 con 0x7f96ec1e3cf0 2023-12-19T05:39:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96e8ff9640 1 -- 172.21.15.120:0/1038590461 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400e050 con 0x7f96ec1e3cf0 2023-12-19T05:39:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.054+0000 7f96f18b6640 1 -- 172.21.15.120:0/1038590461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ec0bbd50 con 0x7f96ec1e3cf0 2023-12-19T05:39:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.055+0000 7f96f18b6640 1 -- 172.21.15.120:0/1038590461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ec066d30 con 0x7f96ec1e3cf0 2023-12-19T05:39:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.055+0000 7f96e8ff9640 1 -- 172.21.15.120:0/1038590461 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f96e4015440 con 0x7f96ec1e3cf0 2023-12-19T05:39:17.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.056+0000 7f96e8ff9640 1 --2- 172.21.15.120:0/1038590461 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f96cc06a460 0x7f96cc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.062 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.056+0000 7f96e8ff9640 1 -- 172.21.15.120:0/1038590461 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96e4088d40 con 0x7f96ec1e3cf0 2023-12-19T05:39:17.062 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.056+0000 7f96eaffd640 1 --2- 172.21.15.120:0/1038590461 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f96cc06a460 0x7f96cc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.062 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.056+0000 7f96eaffd640 1 --2- 172.21.15.120:0/1038590461 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f96cc06a460 0x7f96cc06c920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0093d0 tx=0x7f96dc009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.062 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.060+0000 7f96e8ff9640 1 -- 172.21.15.120:0/1038590461 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f96e4054350 con 0x7f96ec1e3cf0 2023-12-19T05:39:17.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.226+0000 7f96f18b6640 1 -- 172.21.15.120:0/1038590461 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96ec1e3110 con 0x7f96ec1e3cf0 2023-12-19T05:39:17.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.227+0000 7f96e8ff9640 1 -- 172.21.15.120:0/1038590461 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f96e4057970 con 0x7f96ec1e3cf0 2023-12-19T05:39:17.228 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:17.228 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:17.230 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.229+0000 7f96f18b6640 1 -- 172.21.15.120:0/1038590461 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f96cc06a460 msgr2=0x7f96cc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.230 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.229+0000 7f96f18b6640 1 --2- 172.21.15.120:0/1038590461 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f96cc06a460 0x7f96cc06c920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0093d0 tx=0x7f96dc009190 comp rx=0 tx=0).stop 2023-12-19T05:39:17.230 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.229+0000 7f96f18b6640 1 -- 172.21.15.120:0/1038590461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96ec1e3cf0 msgr2=0x7f96ec143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.230 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.229+0000 7f96f18b6640 1 --2- 172.21.15.120:0/1038590461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96ec1e3cf0 0x7f96ec143f80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0bcd90 tx=0x7f96e4009f90 comp rx=0 tx=0).stop 2023-12-19T05:39:17.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.229+0000 7f96f18b6640 1 -- 172.21.15.120:0/1038590461 shutdown_connections 2023-12-19T05:39:17.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.229+0000 7f96f18b6640 1 --2- 172.21.15.120:0/1038590461 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f96cc06a460 0x7f96cc06c920 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.229+0000 7f96f18b6640 1 --2- 172.21.15.120:0/1038590461 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f96ec1e3cf0 0x7f96ec143f80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.229+0000 7f96f18b6640 1 --2- 172.21.15.120:0/1038590461 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96ec09aa20 0x7f96ec1e37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.229+0000 7f96f18b6640 1 --2- 172.21.15.120:0/1038590461 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f96d80047c0 0x7f96ec148df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.229+0000 7f96f18b6640 1 -- 172.21.15.120:0/1038590461 >> 172.21.15.120:0/1038590461 conn(0x7f96ec0c0340 msgr2=0x7f96ec0bfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.229+0000 7f96f18b6640 1 -- 172.21.15.120:0/1038590461 shutdown_connections 2023-12-19T05:39:17.231 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.229+0000 7f96f18b6640 1 -- 172.21.15.120:0/1038590461 wait complete. 2023-12-19T05:39:17.241 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:45.976868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:38:56.035188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:38:57.050130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:17.242 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:17.343 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.342+0000 7f03fcb0a640 1 Processor -- start 2023-12-19T05:39:17.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.342+0000 7f03fcb0a640 1 -- start start 2023-12-19T05:39:17.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.343+0000 7f03fcb0a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80bad20 0x7f03f80b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.343+0000 7f03fcb0a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f03f8142980 0x7f03f80b96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.343+0000 7f03fcb0a640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f80b56d0 con 0x7f03f80b9c10 2023-12-19T05:39:17.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.343+0000 7f03fcb0a640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f80b6070 con 0x7f03f8142980 2023-12-19T05:39:17.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.343+0000 7f03fcb0a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f80b59b0 con 0x7f03f80bad20 2023-12-19T05:39:17.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.343+0000 7f03f5d9b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f03f8142980 0x7f03f80b96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.343+0000 7f03f6d9d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f03f80b9c10 0x7f03f8070ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37198/0 (socket says 172.21.15.120:37198) 2023-12-19T05:39:17.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.343+0000 7f03f6d9d640 1 -- 172.21.15.120:0/2370131139 learned_addr learned my addr 172.21.15.120:0/2370131139 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:17.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.343+0000 7f03f659c640 1 --2- 172.21.15.120:0/2370131139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80bad20 0x7f03f80b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.343+0000 7f03f5d9b640 1 -- 172.21.15.120:0/2370131139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80bad20 msgr2=0x7f03f80b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:17.346 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.343+0000 7f03f5d9b640 1 --2- 172.21.15.120:0/2370131139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80bad20 0x7f03f80b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.346 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.343+0000 7f03f5d9b640 1 -- 172.21.15.120:0/2370131139 >> v1:172.21.15.120:6789/0 conn(0x7f03f80b9c10 legacy=0x7f03f8070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.346 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.343+0000 7f03f5d9b640 1 -- 172.21.15.120:0/2370131139 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f80b5c90 con 0x7f03f8142980 2023-12-19T05:39:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.344+0000 7f03f5d9b640 1 --2- 172.21.15.120:0/2370131139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03f8142980 0x7f03f80b96d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f03e00097a0 tx=0x7f03e002b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80362db0c90cd593 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.344+0000 7f03f559a640 1 -- 172.21.15.120:0/2370131139 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0030710 con 0x7f03f8142980 2023-12-19T05:39:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.344+0000 7f03f559a640 1 -- 172.21.15.120:0/2370131139 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e002e050 con 0x7f03f8142980 2023-12-19T05:39:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.344+0000 7f03f559a640 1 -- 172.21.15.120:0/2370131139 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0030a90 con 0x7f03f8142980 2023-12-19T05:39:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.345+0000 7f03fcb0a640 1 -- 172.21.15.120:0/2370131139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03f8142980 msgr2=0x7f03f80b96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.347 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.345+0000 7f03fcb0a640 1 --2- 172.21.15.120:0/2370131139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03f8142980 0x7f03f80b96d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f03e00097a0 tx=0x7f03e002b710 comp rx=0 tx=0).stop 2023-12-19T05:39:17.348 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.345+0000 7f03fcb0a640 1 -- 172.21.15.120:0/2370131139 shutdown_connections 2023-12-19T05:39:17.348 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.345+0000 7f03fcb0a640 1 --2- 172.21.15.120:0/2370131139 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03f8142980 0x7f03f80b96d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.348 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.345+0000 7f03fcb0a640 1 --2- 172.21.15.120:0/2370131139 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80bad20 0x7f03f80b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.348 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.345+0000 7f03fcb0a640 1 -- 172.21.15.120:0/2370131139 >> 172.21.15.120:0/2370131139 conn(0x7f03f8069d00 msgr2=0x7f03f806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.348 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.345+0000 7f03fcb0a640 1 -- 172.21.15.120:0/2370131139 shutdown_connections 2023-12-19T05:39:17.348 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.345+0000 7f03fcb0a640 1 -- 172.21.15.120:0/2370131139 wait complete. 2023-12-19T05:39:17.348 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.346+0000 7f03fcb0a640 1 Processor -- start 2023-12-19T05:39:17.348 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.346+0000 7f03fcb0a640 1 -- start start 2023-12-19T05:39:17.351 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03fcb0a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80b9c10 0x7f03f813dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.351 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03fcb0a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03f80bad20 0x7f03f8148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.351 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03fcb0a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03f8142980 0x7f03f81481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.351 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03fcb0a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f8147d00 con 0x7f03f8142980 2023-12-19T05:39:17.351 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03fcb0a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f8146cc0 con 0x7f03f80bad20 2023-12-19T05:39:17.351 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03fcb0a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f813e130 con 0x7f03f80b9c10 2023-12-19T05:39:17.351 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03f6d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03f8142980 0x7f03f81481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03f6d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03f8142980 0x7f03f81481e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47512/0 (socket says 172.21.15.120:47512) 2023-12-19T05:39:17.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03f6d9d640 1 -- 172.21.15.120:0/3568602691 learned_addr learned my addr 172.21.15.120:0/3568602691 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:17.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03f659c640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80b9c10 0x7f03f813dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03f5d9b640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03f80bad20 0x7f03f8148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03f6d9d640 1 -- 172.21.15.120:0/3568602691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80b9c10 msgr2=0x7f03f813dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03f6d9d640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80b9c10 0x7f03f813dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03f6d9d640 1 -- 172.21.15.120:0/3568602691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03f80bad20 msgr2=0x7f03f8148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03f6d9d640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03f80bad20 0x7f03f8148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03f6d9d640 1 -- 172.21.15.120:0/3568602691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e0009400 con 0x7f03f8142980 2023-12-19T05:39:17.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03f5d9b640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03f80bad20 0x7f03f8148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:17.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03f6d9d640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03f8142980 0x7f03f81481e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f03e800c780 tx=0x7f03e800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.347+0000 7f03eeffd640 1 -- 172.21.15.120:0/3568602691 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e80072d0 con 0x7f03f8142980 2023-12-19T05:39:17.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.348+0000 7f03eeffd640 1 -- 172.21.15.120:0/3568602691 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e8007430 con 0x7f03f8142980 2023-12-19T05:39:17.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.348+0000 7f03eeffd640 1 -- 172.21.15.120:0/3568602691 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e80047e0 con 0x7f03f8142980 2023-12-19T05:39:17.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.348+0000 7f03fcb0a640 1 -- 172.21.15.120:0/3568602691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f80b4770 con 0x7f03f8142980 2023-12-19T05:39:17.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.348+0000 7f03fcb0a640 1 -- 172.21.15.120:0/3568602691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f813a840 con 0x7f03f8142980 2023-12-19T05:39:17.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.349+0000 7f03fcb0a640 1 -- 172.21.15.120:0/3568602691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f804e080 con 0x7f03f8142980 2023-12-19T05:39:17.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.349+0000 7f03eeffd640 1 -- 172.21.15.120:0/3568602691 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f03e8004940 con 0x7f03f8142980 2023-12-19T05:39:17.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.349+0000 7f03eeffd640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f03d806a430 0x7f03d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.350+0000 7f03f659c640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f03d806a430 0x7f03d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.350+0000 7f03eeffd640 1 -- 172.21.15.120:0/3568602691 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03e8087b80 con 0x7f03f8142980 2023-12-19T05:39:17.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.350+0000 7f03f659c640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f03d806a430 0x7f03d806c8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f03f00113e0 tx=0x7f03f000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.354+0000 7f03eeffd640 1 -- 172.21.15.120:0/3568602691 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f03e80532b0 con 0x7f03f8142980 2023-12-19T05:39:17.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.519+0000 7f03fcb0a640 1 -- 172.21.15.120:0/3568602691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03f80b6580 con 0x7f03f8142980 2023-12-19T05:39:17.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.520+0000 7f03eeffd640 1 -- 172.21.15.120:0/3568602691 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03e8018070 con 0x7f03f8142980 2023-12-19T05:39:17.521 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2023-12-19T05:39:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.521+0000 7f03fcb0a640 1 -- 172.21.15.120:0/3568602691 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f03d806a430 msgr2=0x7f03d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.521+0000 7f03fcb0a640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f03d806a430 0x7f03d806c8f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f03f00113e0 tx=0x7f03f000b040 comp rx=0 tx=0).stop 2023-12-19T05:39:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.521+0000 7f03fcb0a640 1 -- 172.21.15.120:0/3568602691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03f8142980 msgr2=0x7f03f81481e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.521+0000 7f03fcb0a640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03f8142980 0x7f03f81481e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f03e800c780 tx=0x7f03e800cc40 comp rx=0 tx=0).stop 2023-12-19T05:39:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.521+0000 7f03fcb0a640 1 -- 172.21.15.120:0/3568602691 shutdown_connections 2023-12-19T05:39:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.521+0000 7f03fcb0a640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f03d806a430 0x7f03d806c8f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.521+0000 7f03fcb0a640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f03f8142980 0x7f03f81481e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.521+0000 7f03fcb0a640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f03f80bad20 0x7f03f8148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.521+0000 7f03fcb0a640 1 --2- 172.21.15.120:0/3568602691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f03f80b9c10 0x7f03f813dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.524 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.522+0000 7f03fcb0a640 1 -- 172.21.15.120:0/3568602691 >> 172.21.15.120:0/3568602691 conn(0x7f03f8069d00 msgr2=0x7f03f8140750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.524 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.522+0000 7f03fcb0a640 1 -- 172.21.15.120:0/3568602691 shutdown_connections 2023-12-19T05:39:17.524 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.522+0000 7f03fcb0a640 1 -- 172.21.15.120:0/3568602691 wait complete. 2023-12-19T05:39:17.533 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:17.635 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.633+0000 7fc3a204c640 1 Processor -- start 2023-12-19T05:39:17.635 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.633+0000 7fc3a204c640 1 -- start start 2023-12-19T05:39:17.636 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.634+0000 7fc3a204c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc39c0ba0d0 0x7fc39c156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.636 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.634+0000 7fc3a204c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c071e30 con 0x7fc39c070f50 2023-12-19T05:39:17.636 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.634+0000 7fc3a204c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c06af40 con 0x7fc39c14e820 2023-12-19T05:39:17.636 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.634+0000 7fc3a204c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39c06bbf0 con 0x7fc39c0ba0d0 2023-12-19T05:39:17.636 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.634+0000 7fc39bfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fc39c0ba0d0 0x7fc39c156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.636 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.634+0000 7fc39b7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fc39c070f50 0x7fc39c14e110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37210/0 (socket says 172.21.15.120:37210) 2023-12-19T05:39:17.636 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.634+0000 7fc39b7fe640 1 -- 172.21.15.120:0/3784434267 learned_addr learned my addr 172.21.15.120:0/3784434267 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:17.636 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.634+0000 7fc39bfff640 1 -- 172.21.15.120:0/3784434267 >> v1:172.21.15.155:6789/0 conn(0x7fc39c14e820 legacy=0x7fc39c153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:17.636 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.634+0000 7fc39bfff640 1 -- 172.21.15.120:0/3784434267 >> v1:172.21.15.120:6789/0 conn(0x7fc39c070f50 legacy=0x7fc39c14e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.636 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.635+0000 7fc39bfff640 1 -- 172.21.15.120:0/3784434267 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c06b220 con 0x7fc39c0ba0d0 2023-12-19T05:39:17.636 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.635+0000 7fc39a7fc640 1 -- 172.21.15.120:0/3784434267 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069717078 0 0) 0x7fc39c071e30 con 0x7fc39c070f50 2023-12-19T05:39:17.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.635+0000 7fc39bfff640 1 --2- 172.21.15.120:0/3784434267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc39c0ba0d0 0x7fc39c156ac0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc394009d90 tx=0x7fc39402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301c37c1d8b118ba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.635+0000 7fc39a7fc640 1 -- 172.21.15.120:0/3784434267 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39402cbd0 con 0x7fc39c0ba0d0 2023-12-19T05:39:17.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.635+0000 7fc39a7fc640 1 -- 172.21.15.120:0/3784434267 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39402cd30 con 0x7fc39c0ba0d0 2023-12-19T05:39:17.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.635+0000 7fc39a7fc640 1 -- 172.21.15.120:0/3784434267 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39402cea0 con 0x7fc39c0ba0d0 2023-12-19T05:39:17.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.636+0000 7fc3a204c640 1 -- 172.21.15.120:0/3784434267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc39c0ba0d0 msgr2=0x7fc39c156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.636+0000 7fc3a204c640 1 --2- 172.21.15.120:0/3784434267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc39c0ba0d0 0x7fc39c156ac0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc394009d90 tx=0x7fc39402be20 comp rx=0 tx=0).stop 2023-12-19T05:39:17.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.636+0000 7fc3a204c640 1 -- 172.21.15.120:0/3784434267 shutdown_connections 2023-12-19T05:39:17.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.636+0000 7fc3a204c640 1 --2- 172.21.15.120:0/3784434267 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc39c0ba0d0 0x7fc39c156ac0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.636+0000 7fc3a204c640 1 -- 172.21.15.120:0/3784434267 >> 172.21.15.120:0/3784434267 conn(0x7fc39c0be180 msgr2=0x7fc39c0be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.636+0000 7fc3a204c640 1 -- 172.21.15.120:0/3784434267 shutdown_connections 2023-12-19T05:39:17.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.636+0000 7fc3a204c640 1 -- 172.21.15.120:0/3784434267 wait complete. 2023-12-19T05:39:17.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.637+0000 7fc3a204c640 1 Processor -- start 2023-12-19T05:39:17.641 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.637+0000 7fc3a204c640 1 -- start start 2023-12-19T05:39:17.641 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc3a204c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc39c070f50 0x7fc39c142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.641 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc3a204c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc39c0ba0d0 0x7fc39c13ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.641 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc3a204c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc39c14e820 0x7fc39c1e35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.641 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc3a204c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c13f2a0 con 0x7fc39c070f50 2023-12-19T05:39:17.641 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc3a204c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c1e3b20 con 0x7fc39c0ba0d0 2023-12-19T05:39:17.641 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc3a204c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c13ea20 con 0x7fc39c14e820 2023-12-19T05:39:17.641 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc39b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc39c070f50 0x7fc39c142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.641 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc39b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc39c070f50 0x7fc39c142840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47534/0 (socket says 172.21.15.120:47534) 2023-12-19T05:39:17.641 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc39b7fe640 1 -- 172.21.15.120:0/185555861 learned_addr learned my addr 172.21.15.120:0/185555861 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:17.641 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc39affd640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc39c0ba0d0 0x7fc39c13ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.641 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc39bfff640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc39c14e820 0x7fc39c1e35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.641 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc39b7fe640 1 -- 172.21.15.120:0/185555861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc39c14e820 msgr2=0x7fc39c1e35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.641 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc39b7fe640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc39c14e820 0x7fc39c1e35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.642 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc39b7fe640 1 -- 172.21.15.120:0/185555861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc39c0ba0d0 msgr2=0x7fc39c13ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.642 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc39b7fe640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc39c0ba0d0 0x7fc39c13ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.642 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc39b7fe640 1 -- 172.21.15.120:0/185555861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394009a70 con 0x7fc39c070f50 2023-12-19T05:39:17.642 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc39affd640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc39c0ba0d0 0x7fc39c13ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:17.642 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc39b7fe640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc39c070f50 0x7fc39c142840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c4d0 tx=0x7fc38c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.642 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc383fff640 1 -- 172.21.15.120:0/185555861 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c0074e0 con 0x7fc39c070f50 2023-12-19T05:39:17.642 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc383fff640 1 -- 172.21.15.120:0/185555861 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c007660 con 0x7fc39c070f50 2023-12-19T05:39:17.642 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc383fff640 1 -- 172.21.15.120:0/185555861 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c004a20 con 0x7fc39c070f50 2023-12-19T05:39:17.642 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc3a204c640 1 -- 172.21.15.120:0/185555861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c1e4250 con 0x7fc39c070f50 2023-12-19T05:39:17.642 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.638+0000 7fc3a204c640 1 -- 172.21.15.120:0/185555861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c1e3f70 con 0x7fc39c070f50 2023-12-19T05:39:17.642 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.639+0000 7fc3a204c640 1 -- 172.21.15.120:0/185555861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39c04e080 con 0x7fc39c070f50 2023-12-19T05:39:17.642 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.640+0000 7fc383fff640 1 -- 172.21.15.120:0/185555861 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc38c004b80 con 0x7fc39c070f50 2023-12-19T05:39:17.643 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.640+0000 7fc383fff640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc38806a430 0x7fc38806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.643 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.640+0000 7fc39affd640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc38806a430 0x7fc38806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.643 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.640+0000 7fc383fff640 1 -- 172.21.15.120:0/185555861 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc38c087b40 con 0x7fc39c070f50 2023-12-19T05:39:17.643 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.640+0000 7fc39affd640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc38806a430 0x7fc38806c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc390006fd0 tx=0x7fc390008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.645 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.644+0000 7fc383fff640 1 -- 172.21.15.120:0/185555861 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fc38c053130 con 0x7fc39c070f50 2023-12-19T05:39:17.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.811+0000 7fc3a204c640 1 -- 172.21.15.120:0/185555861 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc39c0bf020 con 0x7fc39c070f50 2023-12-19T05:39:17.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.811+0000 7fc383fff640 1 -- 172.21.15.120:0/185555861 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc38c0180a0 con 0x7fc39c070f50 2023-12-19T05:39:17.814 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2023-12-19T05:39:17.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.813+0000 7fc3a204c640 1 -- 172.21.15.120:0/185555861 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc38806a430 msgr2=0x7fc38806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.813+0000 7fc3a204c640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc38806a430 0x7fc38806c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc390006fd0 tx=0x7fc390008040 comp rx=0 tx=0).stop 2023-12-19T05:39:17.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.813+0000 7fc3a204c640 1 -- 172.21.15.120:0/185555861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc39c070f50 msgr2=0x7fc39c142840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.813+0000 7fc3a204c640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc39c070f50 0x7fc39c142840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00c4d0 tx=0x7fc38c00c990 comp rx=0 tx=0).stop 2023-12-19T05:39:17.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.813+0000 7fc3a204c640 1 -- 172.21.15.120:0/185555861 shutdown_connections 2023-12-19T05:39:17.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.813+0000 7fc3a204c640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fc38806a430 0x7fc38806c8f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.813+0000 7fc3a204c640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fc39c14e820 0x7fc39c1e35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.813+0000 7fc3a204c640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc39c0ba0d0 0x7fc39c13ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.813+0000 7fc3a204c640 1 --2- 172.21.15.120:0/185555861 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fc39c070f50 0x7fc39c142840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.813+0000 7fc3a204c640 1 -- 172.21.15.120:0/185555861 >> 172.21.15.120:0/185555861 conn(0x7fc39c0be180 msgr2=0x7fc39c0b5760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.813+0000 7fc3a204c640 1 -- 172.21.15.120:0/185555861 shutdown_connections 2023-12-19T05:39:17.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.813+0000 7fc3a204c640 1 -- 172.21.15.120:0/185555861 wait complete. 2023-12-19T05:39:17.825 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:17.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.925+0000 7f8dc41e0640 1 Processor -- start 2023-12-19T05:39:17.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.926+0000 7f8dc41e0640 1 -- start start 2023-12-19T05:39:17.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.926+0000 7f8dc41e0640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8dbc070f50 0x7f8dbc14e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.926+0000 7f8dc41e0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8dbc0ba0d0 0x7f8dbc14e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.926+0000 7f8dc41e0640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dbc071e30 con 0x7f8dbc071330 2023-12-19T05:39:17.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.926+0000 7f8dc41e0640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dbc06bbf0 con 0x7f8dbc070f50 2023-12-19T05:39:17.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.926+0000 7f8dc41e0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dbc06af40 con 0x7f8dbc0ba0d0 2023-12-19T05:39:17.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.926+0000 7f8dc1f7c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8dbc070f50 0x7f8dbc14e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.926+0000 7f8dc277d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f8dbc071330 0x7f8dbc14ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37216/0 (socket says 172.21.15.120:37216) 2023-12-19T05:39:17.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.926+0000 7f8dc1f7c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8dbc070f50 0x7f8dbc14e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47542/0 (socket says 172.21.15.120:47542) 2023-12-19T05:39:17.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.926+0000 7f8dc277d640 1 -- 172.21.15.120:0/842606291 learned_addr learned my addr 172.21.15.120:0/842606291 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:17.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.927+0000 7f8dc177b640 1 --2- 172.21.15.120:0/842606291 >> v2:172.21.15.155:3300/0 conn(0x7f8dbc0ba0d0 0x7f8dbc14e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.927+0000 7f8dc1f7c640 1 -- 172.21.15.120:0/842606291 >> v2:172.21.15.155:3300/0 conn(0x7f8dbc0ba0d0 msgr2=0x7f8dbc14e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:17.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.927+0000 7f8dc1f7c640 1 --2- 172.21.15.120:0/842606291 >> v2:172.21.15.155:3300/0 conn(0x7f8dbc0ba0d0 0x7f8dbc14e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.927+0000 7f8dc1f7c640 1 -- 172.21.15.120:0/842606291 >> v1:172.21.15.120:6789/0 conn(0x7f8dbc071330 legacy=0x7f8dbc14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.927+0000 7f8dc1f7c640 1 -- 172.21.15.120:0/842606291 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dbc06b220 con 0x7f8dbc070f50 2023-12-19T05:39:17.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.927+0000 7f8dc0f7a640 1 -- 172.21.15.120:0/842606291 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624001386 0 0) 0x7f8dbc071e30 con 0x7f8dbc071330 2023-12-19T05:39:17.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.927+0000 7f8dc177b640 1 --2- 172.21.15.120:0/842606291 >> v2:172.21.15.155:3300/0 conn(0x7f8dbc0ba0d0 0x7f8dbc14e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:17.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.927+0000 7f8dc1f7c640 1 --2- 172.21.15.120:0/842606291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dbc070f50 0x7f8dbc14e110 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc04e7c0 tx=0x7f8dac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3ea8b970772380 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.927+0000 7f8dc0f7a640 1 -- 172.21.15.120:0/842606291 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac02e070 con 0x7f8dbc070f50 2023-12-19T05:39:17.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.927+0000 7f8dc0f7a640 1 -- 172.21.15.120:0/842606291 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dac0315a0 con 0x7f8dbc070f50 2023-12-19T05:39:17.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.928+0000 7f8dc0f7a640 1 -- 172.21.15.120:0/842606291 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dac031930 con 0x7f8dbc070f50 2023-12-19T05:39:17.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.928+0000 7f8dc41e0640 1 -- 172.21.15.120:0/842606291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dbc070f50 msgr2=0x7f8dbc14e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.928+0000 7f8dc41e0640 1 --2- 172.21.15.120:0/842606291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dbc070f50 0x7f8dbc14e110 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc04e7c0 tx=0x7f8dac02b840 comp rx=0 tx=0).stop 2023-12-19T05:39:17.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.928+0000 7f8dc41e0640 1 -- 172.21.15.120:0/842606291 shutdown_connections 2023-12-19T05:39:17.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.928+0000 7f8dc41e0640 1 --2- 172.21.15.120:0/842606291 >> v2:172.21.15.155:3300/0 conn(0x7f8dbc0ba0d0 0x7f8dbc14e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.928+0000 7f8dc41e0640 1 --2- 172.21.15.120:0/842606291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dbc070f50 0x7f8dbc14e110 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.928+0000 7f8dc41e0640 1 -- 172.21.15.120:0/842606291 >> 172.21.15.120:0/842606291 conn(0x7f8dbc0be180 msgr2=0x7f8dbc0be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.928+0000 7f8dc41e0640 1 -- 172.21.15.120:0/842606291 shutdown_connections 2023-12-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.928+0000 7f8dc41e0640 1 -- 172.21.15.120:0/842606291 wait complete. 2023-12-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.929+0000 7f8dc41e0640 1 Processor -- start 2023-12-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.929+0000 7f8dc41e0640 1 -- start start 2023-12-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc41e0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dbc070f50 0x7f8dbc0b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc41e0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dbc071330 0x7f8dbc148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc41e0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dbc0ba0d0 0x7f8dbc13f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc41e0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc0b7230 con 0x7f8dbc0ba0d0 2023-12-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc41e0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc1e0500 con 0x7f8dbc071330 2023-12-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc41e0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dbc14a0d0 con 0x7f8dbc070f50 2023-12-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc277d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dbc0ba0d0 0x7f8dbc13f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc277d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dbc0ba0d0 0x7f8dbc13f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47558/0 (socket says 172.21.15.120:47558) 2023-12-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc277d640 1 -- 172.21.15.120:0/3041142693 learned_addr learned my addr 172.21.15.120:0/3041142693 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc1f7c640 1 --2- 172.21.15.120:0/3041142693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dbc070f50 0x7f8dbc0b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc177b640 1 --2- 172.21.15.120:0/3041142693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dbc071330 0x7f8dbc148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc277d640 1 -- 172.21.15.120:0/3041142693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dbc070f50 msgr2=0x7f8dbc0b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc277d640 1 --2- 172.21.15.120:0/3041142693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dbc070f50 0x7f8dbc0b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc277d640 1 -- 172.21.15.120:0/3041142693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dbc071330 msgr2=0x7f8dbc148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc277d640 1 --2- 172.21.15.120:0/3041142693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dbc071330 0x7f8dbc148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc277d640 1 -- 172.21.15.120:0/3041142693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dac009400 con 0x7f8dbc0ba0d0 2023-12-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc277d640 1 --2- 172.21.15.120:0/3041142693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dbc0ba0d0 0x7f8dbc13f4a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8db400c7d0 tx=0x7f8db400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8db27fc640 1 -- 172.21.15.120:0/3041142693 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db400a640 con 0x7f8dbc0ba0d0 2023-12-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8db27fc640 1 -- 172.21.15.120:0/3041142693 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db400a7a0 con 0x7f8dbc0ba0d0 2023-12-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8db27fc640 1 -- 172.21.15.120:0/3041142693 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db400ab90 con 0x7f8dbc0ba0d0 2023-12-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc41e0640 1 -- 172.21.15.120:0/3041142693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dbc1df930 con 0x7f8dbc0ba0d0 2023-12-19T05:39:17.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.930+0000 7f8dc41e0640 1 -- 172.21.15.120:0/3041142693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dbc1dfeb0 con 0x7f8dbc0ba0d0 2023-12-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.931+0000 7f8dc41e0640 1 -- 172.21.15.120:0/3041142693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dbc04e080 con 0x7f8dbc0ba0d0 2023-12-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.932+0000 7f8db27fc640 1 -- 172.21.15.120:0/3041142693 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8db400acf0 con 0x7f8dbc0ba0d0 2023-12-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.932+0000 7f8db27fc640 1 --2- 172.21.15.120:0/3041142693 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8da006a460 0x7f8da006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.932+0000 7f8db27fc640 1 -- 172.21.15.120:0/3041142693 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8db4087d60 con 0x7f8dbc0ba0d0 2023-12-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.932+0000 7f8dc1f7c640 1 --2- 172.21.15.120:0/3041142693 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8da006a460 0x7f8da006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.933+0000 7f8dc1f7c640 1 --2- 172.21.15.120:0/3041142693 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8da006a460 0x7f8da006c920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8dac036000 tx=0x7f8dac008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:17.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:17.936+0000 7f8db27fc640 1 -- 172.21.15.120:0/3041142693 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8db4053350 con 0x7f8dbc0ba0d0 2023-12-19T05:39:18.104 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.102+0000 7f8dc41e0640 1 -- 172.21.15.120:0/3041142693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8dbc1e0640 con 0x7f8dbc0ba0d0 2023-12-19T05:39:18.104 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.103+0000 7f8db27fc640 1 -- 172.21.15.120:0/3041142693 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8db40180a0 con 0x7f8dbc0ba0d0 2023-12-19T05:39:18.104 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2023-12-19T05:39:18.106 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.104+0000 7f8dc41e0640 1 -- 172.21.15.120:0/3041142693 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8da006a460 msgr2=0x7f8da006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.106 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.104+0000 7f8dc41e0640 1 --2- 172.21.15.120:0/3041142693 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8da006a460 0x7f8da006c920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8dac036000 tx=0x7f8dac008030 comp rx=0 tx=0).stop 2023-12-19T05:39:18.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.104+0000 7f8dc41e0640 1 -- 172.21.15.120:0/3041142693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dbc0ba0d0 msgr2=0x7f8dbc13f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.104+0000 7f8dc41e0640 1 --2- 172.21.15.120:0/3041142693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dbc0ba0d0 0x7f8dbc13f4a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8db400c7d0 tx=0x7f8db400cc90 comp rx=0 tx=0).stop 2023-12-19T05:39:18.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.105+0000 7f8dc41e0640 1 -- 172.21.15.120:0/3041142693 shutdown_connections 2023-12-19T05:39:18.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.105+0000 7f8dc41e0640 1 --2- 172.21.15.120:0/3041142693 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8da006a460 0x7f8da006c920 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.105+0000 7f8dc41e0640 1 --2- 172.21.15.120:0/3041142693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8dbc0ba0d0 0x7f8dbc13f4a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.105+0000 7f8dc41e0640 1 --2- 172.21.15.120:0/3041142693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8dbc071330 0x7f8dbc148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.108 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.105+0000 7f8dc41e0640 1 --2- 172.21.15.120:0/3041142693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8dbc070f50 0x7f8dbc0b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.108 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.105+0000 7f8dc41e0640 1 -- 172.21.15.120:0/3041142693 >> 172.21.15.120:0/3041142693 conn(0x7f8dbc0be180 msgr2=0x7f8dbc0b8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:18.108 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.105+0000 7f8dc41e0640 1 -- 172.21.15.120:0/3041142693 shutdown_connections 2023-12-19T05:39:18.108 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.105+0000 7f8dc41e0640 1 -- 172.21.15.120:0/3041142693 wait complete. 2023-12-19T05:39:18.117 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:18.216 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.215+0000 7fe835318640 1 Processor -- start 2023-12-19T05:39:18.216 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.215+0000 7fe835318640 1 -- start start 2023-12-19T05:39:18.223 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe835318640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8300b79b0 0x7fe8300b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.223 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe835318640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe83014b230 0x7fe83014b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe835318640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8300b96b0 con 0x7fe8300b8860 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe835318640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83014ae10 con 0x7fe83014b230 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe835318640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8300bacc0 con 0x7fe8300b79b0 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82e7fc640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe8300b8860 0x7fe830144ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37232/0 (socket says 172.21.15.120:37232) 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82e7fc640 1 -- 172.21.15.120:0/3850368251 learned_addr learned my addr 172.21.15.120:0/3850368251 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 -- 172.21.15.120:0/3850368251 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919007537 0 0) 0x7fe8300b96b0 con 0x7fe8300b8860 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 -- 172.21.15.120:0/3850368251 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe818003520 con 0x7fe8300b8860 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82f7fe640 1 --2- 172.21.15.120:0/3850368251 >> v2:172.21.15.155:3300/0 conn(0x7fe83014b230 0x7fe83014b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82effd640 1 --2- 172.21.15.120:0/3850368251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8300b79b0 0x7fe8300b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 -- 172.21.15.120:0/3850368251 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1536377616 0 0) 0x7fe818003520 con 0x7fe8300b8860 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 -- 172.21.15.120:0/3850368251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8300b79b0 msgr2=0x7fe8300b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 --2- 172.21.15.120:0/3850368251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8300b79b0 0x7fe8300b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 -- 172.21.15.120:0/3850368251 >> v2:172.21.15.155:3300/0 conn(0x7fe83014b230 msgr2=0x7fe83014b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 --2- 172.21.15.120:0/3850368251 >> v2:172.21.15.155:3300/0 conn(0x7fe83014b230 0x7fe83014b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.224 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 -- 172.21.15.120:0/3850368251 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8300b90f0 con 0x7fe8300b8860 2023-12-19T05:39:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 -- 172.21.15.120:0/3850368251 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7fe824001670 con 0x7fe8300b8860 2023-12-19T05:39:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82effd640 1 --2- 172.21.15.120:0/3850368251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8300b79b0 0x7fe8300b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 -- 172.21.15.120:0/3850368251 >> v1:172.21.15.120:6789/0 conn(0x7fe8300b8860 legacy=0x7fe830144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 --2- 172.21.15.120:0/3850368251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe818003970 0x7fe818003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 --2- 172.21.15.120:0/3850368251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8300b79b0 0x7fe8180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 --2- 172.21.15.120:0/3850368251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe818004d00 0x7fe818005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 -- 172.21.15.120:0/3850368251 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83014ae10 con 0x7fe818003970 2023-12-19T05:39:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 -- 172.21.15.120:0/3850368251 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81800b980 con 0x7fe818004d00 2023-12-19T05:39:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82dffb640 1 -- 172.21.15.120:0/3850368251 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81800bac0 con 0x7fe8300b79b0 2023-12-19T05:39:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82effd640 1 --2- 172.21.15.120:0/3850368251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe818003970 0x7fe818003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.216+0000 7fe82e7fc640 1 --2- 172.21.15.120:0/3850368251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8300b79b0 0x7fe8180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.217+0000 7fe82f7fe640 1 --2- 172.21.15.120:0/3850368251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe818004d00 0x7fe818005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.225 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.217+0000 7fe82effd640 1 -- 172.21.15.120:0/3850368251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8300b79b0 msgr2=0x7fe8180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.217+0000 7fe82effd640 1 --2- 172.21.15.120:0/3850368251 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe8300b79b0 0x7fe8180047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.217+0000 7fe82effd640 1 -- 172.21.15.120:0/3850368251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe818004d00 msgr2=0x7fe818005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.217+0000 7fe82effd640 1 --2- 172.21.15.120:0/3850368251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe818004d00 0x7fe818005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.217+0000 7fe82effd640 1 -- 172.21.15.120:0/3850368251 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818003520 con 0x7fe818003970 2023-12-19T05:39:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.217+0000 7fe82effd640 1 --2- 172.21.15.120:0/3850368251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe818003970 0x7fe818003d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe8200073e0 tx=0x7fe8180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29a051311218898 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.218+0000 7fe82dffb640 1 -- 172.21.15.120:0/3850368251 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82002cd30 con 0x7fe818003970 2023-12-19T05:39:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.218+0000 7fe82dffb640 1 -- 172.21.15.120:0/3850368251 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82002ce90 con 0x7fe818003970 2023-12-19T05:39:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.218+0000 7fe82dffb640 1 -- 172.21.15.120:0/3850368251 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe820034640 con 0x7fe818003970 2023-12-19T05:39:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.218+0000 7fe835318640 1 -- 172.21.15.120:0/3850368251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe818003970 msgr2=0x7fe818003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.218+0000 7fe835318640 1 --2- 172.21.15.120:0/3850368251 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe818003970 0x7fe818003d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe8200073e0 tx=0x7fe8180057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.218+0000 7fe82f7fe640 1 -- 172.21.15.120:0/3850368251 reap_dead start 2023-12-19T05:39:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.218+0000 7fe835318640 1 -- 172.21.15.120:0/3850368251 shutdown_connections 2023-12-19T05:39:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.218+0000 7fe835318640 1 -- 172.21.15.120:0/3850368251 >> 172.21.15.120:0/3850368251 conn(0x7fe8300c0340 msgr2=0x7fe8300c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:18.226 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.218+0000 7fe835318640 1 -- 172.21.15.120:0/3850368251 shutdown_connections 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.218+0000 7fe835318640 1 -- 172.21.15.120:0/3850368251 wait complete. 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.219+0000 7fe835318640 1 Processor -- start 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.219+0000 7fe835318640 1 -- start start 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe835318640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe818003970 0x7fe830138310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe835318640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe830139240 0x7fe8301e0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe835318640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8300b31c0 0x7fe8300b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe835318640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe830138850 con 0x7fe8300b31c0 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe835318640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8301375c0 con 0x7fe830139240 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe835318640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8301e0390 con 0x7fe818003970 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe82f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8300b31c0 0x7fe8300b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe82f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8300b31c0 0x7fe8300b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47584/0 (socket says 172.21.15.120:47584) 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe82f7fe640 1 -- 172.21.15.120:0/3145115918 learned_addr learned my addr 172.21.15.120:0/3145115918 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe82e7fc640 1 --2- 172.21.15.120:0/3145115918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe830139240 0x7fe8301e0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe82effd640 1 --2- 172.21.15.120:0/3145115918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe818003970 0x7fe830138310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe82f7fe640 1 -- 172.21.15.120:0/3145115918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe818003970 msgr2=0x7fe830138310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.227 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe82f7fe640 1 --2- 172.21.15.120:0/3145115918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe818003970 0x7fe830138310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe82f7fe640 1 -- 172.21.15.120:0/3145115918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe830139240 msgr2=0x7fe8301e0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe82f7fe640 1 --2- 172.21.15.120:0/3145115918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe830139240 0x7fe8301e0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe82f7fe640 1 -- 172.21.15.120:0/3145115918 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8300b3b80 con 0x7fe8300b31c0 2023-12-19T05:39:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe82f7fe640 1 --2- 172.21.15.120:0/3145115918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8300b31c0 0x7fe8300b3640 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe830067290 tx=0x7fe828011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe8177fe640 1 -- 172.21.15.120:0/3145115918 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828004030 con 0x7fe8300b31c0 2023-12-19T05:39:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe8177fe640 1 -- 172.21.15.120:0/3145115918 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe828004190 con 0x7fe8300b31c0 2023-12-19T05:39:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.220+0000 7fe835318640 1 -- 172.21.15.120:0/3145115918 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8301372e0 con 0x7fe8300b31c0 2023-12-19T05:39:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.221+0000 7fe8177fe640 1 -- 172.21.15.120:0/3145115918 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe828004520 con 0x7fe8300b31c0 2023-12-19T05:39:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.221+0000 7fe835318640 1 -- 172.21.15.120:0/3145115918 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8301e0d60 con 0x7fe8300b31c0 2023-12-19T05:39:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.221+0000 7fe835318640 1 -- 172.21.15.120:0/3145115918 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe830066d30 con 0x7fe8300b31c0 2023-12-19T05:39:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.222+0000 7fe8177fe640 1 -- 172.21.15.120:0/3145115918 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe82800f710 con 0x7fe8300b31c0 2023-12-19T05:39:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.222+0000 7fe8177fe640 1 --2- 172.21.15.120:0/3145115918 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe81c06a430 0x7fe81c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.222+0000 7fe82effd640 1 --2- 172.21.15.120:0/3145115918 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe81c06a430 0x7fe81c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.228 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.222+0000 7fe8177fe640 1 -- 172.21.15.120:0/3145115918 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe828088cc0 con 0x7fe8300b31c0 2023-12-19T05:39:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.223+0000 7fe82effd640 1 --2- 172.21.15.120:0/3145115918 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe81c06a430 0x7fe81c06c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe820036000 tx=0x7fe820030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.229 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.227+0000 7fe8177fe640 1 -- 172.21.15.120:0/3145115918 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe828054340 con 0x7fe8300b31c0 2023-12-19T05:39:18.396 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.394+0000 7fe835318640 1 -- 172.21.15.120:0/3145115918 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8300b8650 con 0x7fe8300b31c0 2023-12-19T05:39:18.397 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.395+0000 7fe8177fe640 1 -- 172.21.15.120:0/3145115918 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fe828057960 con 0x7fe8300b31c0 2023-12-19T05:39:18.397 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:18.397 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:18.399 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.397+0000 7fe835318640 1 -- 172.21.15.120:0/3145115918 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe81c06a430 msgr2=0x7fe81c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.399 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.397+0000 7fe835318640 1 --2- 172.21.15.120:0/3145115918 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe81c06a430 0x7fe81c06c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe820036000 tx=0x7fe820030000 comp rx=0 tx=0).stop 2023-12-19T05:39:18.399 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.397+0000 7fe835318640 1 -- 172.21.15.120:0/3145115918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8300b31c0 msgr2=0x7fe8300b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.399 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.397+0000 7fe835318640 1 --2- 172.21.15.120:0/3145115918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8300b31c0 0x7fe8300b3640 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe830067290 tx=0x7fe828011cf0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.399 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.397+0000 7fe835318640 1 -- 172.21.15.120:0/3145115918 shutdown_connections 2023-12-19T05:39:18.399 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.397+0000 7fe835318640 1 --2- 172.21.15.120:0/3145115918 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe81c06a430 0x7fe81c06c8f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.399 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.397+0000 7fe835318640 1 --2- 172.21.15.120:0/3145115918 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe8300b31c0 0x7fe8300b3640 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.399 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.397+0000 7fe835318640 1 --2- 172.21.15.120:0/3145115918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe830139240 0x7fe8301e0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.399 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.397+0000 7fe835318640 1 --2- 172.21.15.120:0/3145115918 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe818003970 0x7fe830138310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.399 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.397+0000 7fe835318640 1 -- 172.21.15.120:0/3145115918 >> 172.21.15.120:0/3145115918 conn(0x7fe8300c0340 msgr2=0x7fe83014a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:18.400 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.398+0000 7fe835318640 1 -- 172.21.15.120:0/3145115918 shutdown_connections 2023-12-19T05:39:18.400 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.398+0000 7fe835318640 1 -- 172.21.15.120:0/3145115918 wait complete. 2023-12-19T05:39:18.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:45.976868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:38:56.035188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:38:57.050130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:18.410 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:18.511 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.510+0000 7fefe4023640 1 Processor -- start 2023-12-19T05:39:18.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.510+0000 7fefe4023640 1 -- start start 2023-12-19T05:39:18.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.511+0000 7fefe4023640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefdc06af80 0x7fefdc0b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.511+0000 7fefe4023640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefdc070590 con 0x7fefdc14ded0 2023-12-19T05:39:18.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.511+0000 7fefe4023640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefdc145000 con 0x7fefdc06f650 2023-12-19T05:39:18.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.511+0000 7fefe4023640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc071650 con 0x7fefdc06af80 2023-12-19T05:39:18.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.511+0000 7fefe25c0640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fefdc14ded0 0x7fefdc1552b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37234/0 (socket says 172.21.15.120:37234) 2023-12-19T05:39:18.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.511+0000 7fefe25c0640 1 -- 172.21.15.120:0/3850702152 learned_addr learned my addr 172.21.15.120:0/3850702152 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:18.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.511+0000 7fefe1dbf640 1 --2- 172.21.15.120:0/3850702152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefdc06af80 0x7fefdc0b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.511+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382886819 0 0) 0x7fefdc070590 con 0x7fefdc14ded0 2023-12-19T05:39:18.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.511+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefc8003520 con 0x7fefdc14ded0 2023-12-19T05:39:18.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594024194 0 0) 0x7fefdc145000 con 0x7fefdc06f650 2023-12-19T05:39:18.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefdc070590 con 0x7fefdc06f650 2023-12-19T05:39:18.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1743558239 0 0) 0x7fefc8003520 con 0x7fefdc14ded0 2023-12-19T05:39:18.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefdc06af80 msgr2=0x7fefdc0b87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:18.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 --2- 172.21.15.120:0/3850702152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefdc06af80 0x7fefdc0b87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 >> v1:172.21.15.155:6789/0 conn(0x7fefdc06f650 legacy=0x7fefdc1448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc0b6b10 con 0x7fefdc14ded0 2023-12-19T05:39:18.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7fefd4001670 con 0x7fefdc14ded0 2023-12-19T05:39:18.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 >> v1:172.21.15.120:6789/0 conn(0x7fefdc14ded0 legacy=0x7fefdc1552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 --2- 172.21.15.120:0/3850702152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefc8003b30 0x7fefc8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 --2- 172.21.15.120:0/3850702152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefdc06af80 0x7fefc80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 --2- 172.21.15.120:0/3850702152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fefc8004d00 0x7fefc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc800ba30 con 0x7fefc8004d00 2023-12-19T05:39:18.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc800bb70 con 0x7fefc8003b30 2023-12-19T05:39:18.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc800bce0 con 0x7fefdc06af80 2023-12-19T05:39:18.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe25c0640 1 --2- 172.21.15.120:0/3850702152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fefc8004d00 0x7fefc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe1dbf640 1 --2- 172.21.15.120:0/3850702152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefc8003b30 0x7fefc8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe15be640 1 --2- 172.21.15.120:0/3850702152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefdc06af80 0x7fefc80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe25c0640 1 -- 172.21.15.120:0/3850702152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefdc06af80 msgr2=0x7fefc80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:18.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe25c0640 1 --2- 172.21.15.120:0/3850702152 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefdc06af80 0x7fefc80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe25c0640 1 -- 172.21.15.120:0/3850702152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefc8003b30 msgr2=0x7fefc8003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:18.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe25c0640 1 --2- 172.21.15.120:0/3850702152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefc8003b30 0x7fefc8003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.512+0000 7fefe25c0640 1 -- 172.21.15.120:0/3850702152 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc8003520 con 0x7fefc8004d00 2023-12-19T05:39:18.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.513+0000 7fefe25c0640 1 --2- 172.21.15.120:0/3850702152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fefc8004d00 0x7fefc8005180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fefd400c160 tx=0x7fefc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b050ffa36a3d51cf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.513+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4005ad0 con 0x7fefc8004d00 2023-12-19T05:39:18.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.513+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd4005c30 con 0x7fefc8004d00 2023-12-19T05:39:18.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.513+0000 7fefe0dbd640 1 -- 172.21.15.120:0/3850702152 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd402c830 con 0x7fefc8004d00 2023-12-19T05:39:18.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.514+0000 7fefe4023640 1 -- 172.21.15.120:0/3850702152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fefc8004d00 msgr2=0x7fefc8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.514+0000 7fefe4023640 1 --2- 172.21.15.120:0/3850702152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fefc8004d00 0x7fefc8005180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fefd400c160 tx=0x7fefc80057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.514+0000 7fefe25c0640 1 -- 172.21.15.120:0/3850702152 reap_dead start 2023-12-19T05:39:18.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.514+0000 7fefe4023640 1 -- 172.21.15.120:0/3850702152 shutdown_connections 2023-12-19T05:39:18.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.514+0000 7fefe4023640 1 -- 172.21.15.120:0/3850702152 >> 172.21.15.120:0/3850702152 conn(0x7fefdc0b91e0 msgr2=0x7fefdc0b95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:18.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.514+0000 7fefe4023640 1 -- 172.21.15.120:0/3850702152 shutdown_connections 2023-12-19T05:39:18.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.514+0000 7fefe4023640 1 -- 172.21.15.120:0/3850702152 wait complete. 2023-12-19T05:39:18.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.515+0000 7fefe4023640 1 Processor -- start 2023-12-19T05:39:18.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.515+0000 7fefe4023640 1 -- start start 2023-12-19T05:39:18.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.515+0000 7fefe4023640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefc8004d00 0x7fefdc141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.515+0000 7fefe4023640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefdc1474a0 0x7fefdc13f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.515+0000 7fefe4023640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fefdc13f560 0x7fefdc13c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.515+0000 7fefe4023640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc141f90 con 0x7fefdc13f560 2023-12-19T05:39:18.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.515+0000 7fefe4023640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc147f80 con 0x7fefdc1474a0 2023-12-19T05:39:18.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.515+0000 7fefe4023640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc1479c0 con 0x7fefc8004d00 2023-12-19T05:39:18.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.515+0000 7fefe25c0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fefdc13f560 0x7fefdc13c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.515+0000 7fefe25c0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fefdc13f560 0x7fefdc13c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47594/0 (socket says 172.21.15.120:47594) 2023-12-19T05:39:18.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.515+0000 7fefe25c0640 1 -- 172.21.15.120:0/4139079895 learned_addr learned my addr 172.21.15.120:0/4139079895 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:18.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.515+0000 7fefe1dbf640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefc8004d00 0x7fefdc141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.516+0000 7fefe15be640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefdc1474a0 0x7fefdc13f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.516+0000 7fefe25c0640 1 -- 172.21.15.120:0/4139079895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefc8004d00 msgr2=0x7fefdc141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.516+0000 7fefe25c0640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefc8004d00 0x7fefdc141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.516+0000 7fefe25c0640 1 -- 172.21.15.120:0/4139079895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefdc1474a0 msgr2=0x7fefdc13f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.516+0000 7fefe25c0640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefdc1474a0 0x7fefdc13f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.516+0000 7fefe25c0640 1 -- 172.21.15.120:0/4139079895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc147ca0 con 0x7fefdc13f560 2023-12-19T05:39:18.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.516+0000 7fefe15be640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefdc1474a0 0x7fefdc13f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:18.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.516+0000 7fefe25c0640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fefdc13f560 0x7fefdc13c950 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fefd400c160 tx=0x7fefd40019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.516+0000 7fefd27fc640 1 -- 172.21.15.120:0/4139079895 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd403c040 con 0x7fefdc13f560 2023-12-19T05:39:18.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.516+0000 7fefd27fc640 1 -- 172.21.15.120:0/4139079895 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd402cc40 con 0x7fefdc13f560 2023-12-19T05:39:18.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.516+0000 7fefd27fc640 1 -- 172.21.15.120:0/4139079895 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4001bd0 con 0x7fefdc13f560 2023-12-19T05:39:18.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.516+0000 7fefe4023640 1 -- 172.21.15.120:0/4139079895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefdc13eb00 con 0x7fefdc13f560 2023-12-19T05:39:18.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.516+0000 7fefe4023640 1 -- 172.21.15.120:0/4139079895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc148c50 con 0x7fefdc13f560 2023-12-19T05:39:18.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.517+0000 7fefe4023640 1 -- 172.21.15.120:0/4139079895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefdc0707e0 con 0x7fefdc13f560 2023-12-19T05:39:18.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.517+0000 7fefd27fc640 1 -- 172.21.15.120:0/4139079895 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fefd4032070 con 0x7fefdc13f560 2023-12-19T05:39:18.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.518+0000 7fefd27fc640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fefc006a430 0x7fefc006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.518+0000 7fefe1dbf640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fefc006a430 0x7fefc006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.518+0000 7fefd27fc640 1 -- 172.21.15.120:0/4139079895 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefd40a9780 con 0x7fefdc13f560 2023-12-19T05:39:18.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.518+0000 7fefe1dbf640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fefc006a430 0x7fefc006c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fefd8007520 tx=0x7fefd800b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.522+0000 7fefd27fc640 1 -- 172.21.15.120:0/4139079895 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fefd4074d70 con 0x7fefdc13f560 2023-12-19T05:39:18.688 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.687+0000 7fefe4023640 1 -- 172.21.15.120:0/4139079895 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fefdc04e080 con 0x7fefdc13f560 2023-12-19T05:39:18.689 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.687+0000 7fefd27fc640 1 -- 172.21.15.120:0/4139079895 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fefd4046020 con 0x7fefdc13f560 2023-12-19T05:39:18.689 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2023-12-19T05:39:18.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.689+0000 7fefe4023640 1 -- 172.21.15.120:0/4139079895 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fefc006a430 msgr2=0x7fefc006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.689+0000 7fefe4023640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fefc006a430 0x7fefc006c8f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fefd8007520 tx=0x7fefd800b040 comp rx=0 tx=0).stop 2023-12-19T05:39:18.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.689+0000 7fefe4023640 1 -- 172.21.15.120:0/4139079895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fefdc13f560 msgr2=0x7fefdc13c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.689+0000 7fefe4023640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fefdc13f560 0x7fefdc13c950 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fefd400c160 tx=0x7fefd40019f0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.689+0000 7fefe4023640 1 -- 172.21.15.120:0/4139079895 shutdown_connections 2023-12-19T05:39:18.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.689+0000 7fefe4023640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fefc006a430 0x7fefc006c8f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.689+0000 7fefe4023640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fefdc13f560 0x7fefdc13c950 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.689+0000 7fefe4023640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fefdc1474a0 0x7fefdc13f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.689+0000 7fefe4023640 1 --2- 172.21.15.120:0/4139079895 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fefc8004d00 0x7fefdc141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.689+0000 7fefe4023640 1 -- 172.21.15.120:0/4139079895 >> 172.21.15.120:0/4139079895 conn(0x7fefdc0b91e0 msgr2=0x7fefdc142780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:18.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.689+0000 7fefe4023640 1 -- 172.21.15.120:0/4139079895 shutdown_connections 2023-12-19T05:39:18.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.689+0000 7fefe4023640 1 -- 172.21.15.120:0/4139079895 wait complete. 2023-12-19T05:39:18.701 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:18.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.802+0000 7f05a7dae640 1 Processor -- start 2023-12-19T05:39:18.804 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.803+0000 7f05a7dae640 1 -- start start 2023-12-19T05:39:18.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.803+0000 7f05a7dae640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f05a0144d70 0x7f05a00b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.803+0000 7f05a7dae640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f05a014df70 0x7f05a00b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.803+0000 7f05a7dae640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a0145150 con 0x7f05a00bc7e0 2023-12-19T05:39:18.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.803+0000 7f05a7dae640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a00b9f00 con 0x7f05a0144d70 2023-12-19T05:39:18.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.803+0000 7f05a7dae640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a00b84b0 con 0x7f05a014df70 2023-12-19T05:39:18.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.803+0000 7f05a5b4a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f05a0144d70 0x7f05a00b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.803+0000 7f05a634b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f05a00bc7e0 0x7f05a00bcc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37236/0 (socket says 172.21.15.120:37236) 2023-12-19T05:39:18.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.803+0000 7f05a634b640 1 -- 172.21.15.120:0/1364232195 learned_addr learned my addr 172.21.15.120:0/1364232195 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:18.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.804+0000 7f05a5349640 1 --2- 172.21.15.120:0/1364232195 >> v2:172.21.15.155:3300/0 conn(0x7f05a014df70 0x7f05a00b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.804+0000 7f05a5b4a640 1 -- 172.21.15.120:0/1364232195 >> v2:172.21.15.155:3300/0 conn(0x7f05a014df70 msgr2=0x7f05a00b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:18.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.804+0000 7f05a4b48640 1 -- 172.21.15.120:0/1364232195 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366114388 0 0) 0x7f05a0145150 con 0x7f05a00bc7e0 2023-12-19T05:39:18.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.804+0000 7f05a5b4a640 1 --2- 172.21.15.120:0/1364232195 >> v2:172.21.15.155:3300/0 conn(0x7f05a014df70 0x7f05a00b8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.807 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.804+0000 7f05a5b4a640 1 -- 172.21.15.120:0/1364232195 >> v1:172.21.15.120:6789/0 conn(0x7f05a00bc7e0 legacy=0x7f05a00bcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.807 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.804+0000 7f05a5b4a640 1 -- 172.21.15.120:0/1364232195 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a00b9080 con 0x7f05a0144d70 2023-12-19T05:39:18.807 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.804+0000 7f05a5b4a640 1 --2- 172.21.15.120:0/1364232195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05a0144d70 0x7f05a00b7f70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f05a01485f0 tx=0x7f059402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e676dfc173685b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.807 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.805+0000 7f05a4b48640 1 -- 172.21.15.120:0/1364232195 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594030610 con 0x7f05a0144d70 2023-12-19T05:39:18.807 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.805+0000 7f05a4b48640 1 -- 172.21.15.120:0/1364232195 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0594030770 con 0x7f05a0144d70 2023-12-19T05:39:18.807 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.805+0000 7f05a4b48640 1 -- 172.21.15.120:0/1364232195 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594030b00 con 0x7f05a0144d70 2023-12-19T05:39:18.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.805+0000 7f05a7dae640 1 -- 172.21.15.120:0/1364232195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05a0144d70 msgr2=0x7f05a00b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.805+0000 7f05a7dae640 1 --2- 172.21.15.120:0/1364232195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05a0144d70 0x7f05a00b7f70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f05a01485f0 tx=0x7f059402b960 comp rx=0 tx=0).stop 2023-12-19T05:39:18.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.805+0000 7f05a7dae640 1 -- 172.21.15.120:0/1364232195 shutdown_connections 2023-12-19T05:39:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.805+0000 7f05a7dae640 1 --2- 172.21.15.120:0/1364232195 >> v2:172.21.15.155:3300/0 conn(0x7f05a014df70 0x7f05a00b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.805+0000 7f05a7dae640 1 --2- 172.21.15.120:0/1364232195 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05a0144d70 0x7f05a00b7f70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.805+0000 7f05a7dae640 1 -- 172.21.15.120:0/1364232195 >> 172.21.15.120:0/1364232195 conn(0x7f05a0071430 msgr2=0x7f05a0071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.805+0000 7f05a7dae640 1 -- 172.21.15.120:0/1364232195 shutdown_connections 2023-12-19T05:39:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.805+0000 7f05a7dae640 1 -- 172.21.15.120:0/1364232195 wait complete. 2023-12-19T05:39:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.806+0000 7f05a7dae640 1 Processor -- start 2023-12-19T05:39:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.806+0000 7f05a7dae640 1 -- start start 2023-12-19T05:39:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a7dae640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05a00bc7e0 0x7f05a00b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a7dae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a0144d70 0x7f05a00ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a7dae640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05a014df70 0x7f05a01e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a7dae640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a00b5c10 con 0x7f05a014df70 2023-12-19T05:39:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a7dae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a00ab5e0 con 0x7f05a0144d70 2023-12-19T05:39:18.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a7dae640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a00ab850 con 0x7f05a00bc7e0 2023-12-19T05:39:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a634b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05a014df70 0x7f05a01e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a634b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05a014df70 0x7f05a01e2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47602/0 (socket says 172.21.15.120:47602) 2023-12-19T05:39:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a634b640 1 -- 172.21.15.120:0/1590430163 learned_addr learned my addr 172.21.15.120:0/1590430163 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a5349640 1 --2- 172.21.15.120:0/1590430163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a0144d70 0x7f05a00ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a5b4a640 1 --2- 172.21.15.120:0/1590430163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05a00bc7e0 0x7f05a00b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a634b640 1 -- 172.21.15.120:0/1590430163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05a00bc7e0 msgr2=0x7f05a00b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a634b640 1 --2- 172.21.15.120:0/1590430163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05a00bc7e0 0x7f05a00b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a634b640 1 -- 172.21.15.120:0/1590430163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a0144d70 msgr2=0x7f05a00ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a634b640 1 --2- 172.21.15.120:0/1590430163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a0144d70 0x7f05a00ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a634b640 1 -- 172.21.15.120:0/1590430163 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0594009400 con 0x7f05a014df70 2023-12-19T05:39:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a634b640 1 --2- 172.21.15.120:0/1590430163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05a014df70 0x7f05a01e2f10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f059800c810 tx=0x7f059800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05927fc640 1 -- 172.21.15.120:0/1590430163 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059800a640 con 0x7f05a014df70 2023-12-19T05:39:18.811 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05927fc640 1 -- 172.21.15.120:0/1590430163 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059800a7c0 con 0x7f05a014df70 2023-12-19T05:39:18.812 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05a7dae640 1 -- 172.21.15.120:0/1590430163 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a00a9a10 con 0x7f05a014df70 2023-12-19T05:39:18.812 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.807+0000 7f05927fc640 1 -- 172.21.15.120:0/1590430163 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059800ab70 con 0x7f05a014df70 2023-12-19T05:39:18.812 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.808+0000 7f05a7dae640 1 -- 172.21.15.120:0/1590430163 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a00a9fd0 con 0x7f05a014df70 2023-12-19T05:39:18.812 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.809+0000 7f05a7dae640 1 -- 172.21.15.120:0/1590430163 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a004e080 con 0x7f05a014df70 2023-12-19T05:39:18.812 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.809+0000 7f05927fc640 1 -- 172.21.15.120:0/1590430163 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f059800acd0 con 0x7f05a014df70 2023-12-19T05:39:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.809+0000 7f05927fc640 1 --2- 172.21.15.120:0/1590430163 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f058406a430 0x7f058406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.809+0000 7f05927fc640 1 -- 172.21.15.120:0/1590430163 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0598088120 con 0x7f05a014df70 2023-12-19T05:39:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.810+0000 7f05a5b4a640 1 --2- 172.21.15.120:0/1590430163 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f058406a430 0x7f058406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:18.813 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.810+0000 7f05a5b4a640 1 --2- 172.21.15.120:0/1590430163 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f058406a430 0x7f058406c8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0594036000 tx=0x7f0594008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:18.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.814+0000 7f05927fc640 1 -- 172.21.15.120:0/1590430163 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0598053710 con 0x7f05a014df70 2023-12-19T05:39:18.981 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.979+0000 7f05a7dae640 1 -- 172.21.15.120:0/1590430163 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05a00bc5a0 con 0x7f05a014df70 2023-12-19T05:39:18.981 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.980+0000 7f05927fc640 1 -- 172.21.15.120:0/1590430163 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0598056d30 con 0x7f05a014df70 2023-12-19T05:39:18.981 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2023-12-19T05:39:18.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.982+0000 7f05a7dae640 1 -- 172.21.15.120:0/1590430163 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f058406a430 msgr2=0x7f058406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.982+0000 7f05a7dae640 1 --2- 172.21.15.120:0/1590430163 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f058406a430 0x7f058406c8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0594036000 tx=0x7f0594008030 comp rx=0 tx=0).stop 2023-12-19T05:39:18.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.982+0000 7f05a7dae640 1 -- 172.21.15.120:0/1590430163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05a014df70 msgr2=0x7f05a01e2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:18.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.982+0000 7f05a7dae640 1 --2- 172.21.15.120:0/1590430163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05a014df70 0x7f05a01e2f10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f059800c810 tx=0x7f059800ccd0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.982+0000 7f05a7dae640 1 -- 172.21.15.120:0/1590430163 shutdown_connections 2023-12-19T05:39:18.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.982+0000 7f05a7dae640 1 --2- 172.21.15.120:0/1590430163 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f058406a430 0x7f058406c8f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.982+0000 7f05a7dae640 1 --2- 172.21.15.120:0/1590430163 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f05a014df70 0x7f05a01e2f10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.982+0000 7f05a7dae640 1 --2- 172.21.15.120:0/1590430163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05a0144d70 0x7f05a00ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.982+0000 7f05a7dae640 1 --2- 172.21.15.120:0/1590430163 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f05a00bc7e0 0x7f05a00b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:18.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.982+0000 7f05a7dae640 1 -- 172.21.15.120:0/1590430163 >> 172.21.15.120:0/1590430163 conn(0x7f05a0071430 msgr2=0x7f05a00be150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:18.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.982+0000 7f05a7dae640 1 -- 172.21.15.120:0/1590430163 shutdown_connections 2023-12-19T05:39:18.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:18.982+0000 7f05a7dae640 1 -- 172.21.15.120:0/1590430163 wait complete. 2023-12-19T05:39:18.994 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.094+0000 7f216ec7d640 1 Processor -- start 2023-12-19T05:39:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.094+0000 7f216ec7d640 1 -- start start 2023-12-19T05:39:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.095+0000 7f216ec7d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f21680b68f0 0x7f21680b9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.095+0000 7f216ec7d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f216806fe70 0x7f216806ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.095+0000 7f216ec7d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2168070400 con 0x7f216806b240 2023-12-19T05:39:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.095+0000 7f216ec7d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2168071210 con 0x7f21680b68f0 2023-12-19T05:39:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.095+0000 7f216ec7d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21680714f0 con 0x7f216806fe70 2023-12-19T05:39:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.095+0000 7f216ca19640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f21680b68f0 0x7f21680b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.095+0000 7f216d21a640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f216806b240 0x7f2168142590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37248/0 (socket says 172.21.15.120:37248) 2023-12-19T05:39:19.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.095+0000 7f216d21a640 1 -- 172.21.15.120:0/158504287 learned_addr learned my addr 172.21.15.120:0/158504287 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.095+0000 7f216ca19640 1 -- 172.21.15.120:0/158504287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f216806fe70 msgr2=0x7f216806ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.095+0000 7f2167fff640 1 --2- 172.21.15.120:0/158504287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f216806fe70 0x7f216806ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.095+0000 7f216ca19640 1 --2- 172.21.15.120:0/158504287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f216806fe70 0x7f216806ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.095+0000 7f21677fe640 1 -- 172.21.15.120:0/158504287 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326526108 0 0) 0x7f2168070400 con 0x7f216806b240 2023-12-19T05:39:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.095+0000 7f216ca19640 1 -- 172.21.15.120:0/158504287 >> v1:172.21.15.120:6789/0 conn(0x7f216806b240 legacy=0x7f2168142590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.098 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.095+0000 7f216ca19640 1 -- 172.21.15.120:0/158504287 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21680706e0 con 0x7f21680b68f0 2023-12-19T05:39:19.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.096+0000 7f216ca19640 1 --2- 172.21.15.120:0/158504287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21680b68f0 0x7f21680b9340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f21580097a0 tx=0x7f215802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e47aed36f6895a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.096+0000 7f21677fe640 1 -- 172.21.15.120:0/158504287 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158031830 con 0x7f21680b68f0 2023-12-19T05:39:19.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.096+0000 7f21677fe640 1 -- 172.21.15.120:0/158504287 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2158031990 con 0x7f21680b68f0 2023-12-19T05:39:19.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.096+0000 7f21677fe640 1 -- 172.21.15.120:0/158504287 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158031d20 con 0x7f21680b68f0 2023-12-19T05:39:19.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.097+0000 7f216ec7d640 1 -- 172.21.15.120:0/158504287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21680b68f0 msgr2=0x7f21680b9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.097+0000 7f216ec7d640 1 --2- 172.21.15.120:0/158504287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21680b68f0 0x7f21680b9340 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f21580097a0 tx=0x7f215802b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.097+0000 7f216ec7d640 1 -- 172.21.15.120:0/158504287 shutdown_connections 2023-12-19T05:39:19.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.097+0000 7f216ec7d640 1 --2- 172.21.15.120:0/158504287 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f216806fe70 0x7f216806ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.097+0000 7f216ec7d640 1 --2- 172.21.15.120:0/158504287 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21680b68f0 0x7f21680b9340 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.097+0000 7f216ec7d640 1 -- 172.21.15.120:0/158504287 >> 172.21.15.120:0/158504287 conn(0x7f21680bd070 msgr2=0x7f21680bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:19.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.097+0000 7f216ec7d640 1 -- 172.21.15.120:0/158504287 shutdown_connections 2023-12-19T05:39:19.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.097+0000 7f216ec7d640 1 -- 172.21.15.120:0/158504287 wait complete. 2023-12-19T05:39:19.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.098+0000 7f216ec7d640 1 Processor -- start 2023-12-19T05:39:19.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.098+0000 7f216ec7d640 1 -- start start 2023-12-19T05:39:19.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f216ec7d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f216806b240 0x7f216813bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f216ec7d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f216806fe70 0x7f21681d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f216ec7d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21680b68f0 0x7f21681d18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f216ec7d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216813c600 con 0x7f216806fe70 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f216ec7d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21681d0600 con 0x7f216806b240 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f216ec7d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216813c320 con 0x7f21680b68f0 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f2167fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f216806fe70 0x7f21681d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f2167fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f216806fe70 0x7f21681d0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47620/0 (socket says 172.21.15.120:47620) 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f2167fff640 1 -- 172.21.15.120:0/2201299221 learned_addr learned my addr 172.21.15.120:0/2201299221 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f216ca19640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f216806b240 0x7f216813bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f216d21a640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21680b68f0 0x7f21681d18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f2167fff640 1 -- 172.21.15.120:0/2201299221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21680b68f0 msgr2=0x7f21681d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f2167fff640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21680b68f0 0x7f21681d18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f2167fff640 1 -- 172.21.15.120:0/2201299221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f216806b240 msgr2=0x7f216813bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f2167fff640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f216806b240 0x7f216813bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f2167fff640 1 -- 172.21.15.120:0/2201299221 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158009400 con 0x7f216806fe70 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f216ca19640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f216806b240 0x7f216813bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f2167fff640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f216806fe70 0x7f21681d0b50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f215c00c7f0 tx=0x7f215c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f21657fa640 1 -- 172.21.15.120:0/2201299221 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c004220 con 0x7f216806fe70 2023-12-19T05:39:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f21657fa640 1 -- 172.21.15.120:0/2201299221 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c0043a0 con 0x7f216806fe70 2023-12-19T05:39:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f216ec7d640 1 -- 172.21.15.120:0/2201299221 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21680bbbe0 con 0x7f216806fe70 2023-12-19T05:39:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f21657fa640 1 -- 172.21.15.120:0/2201299221 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c007860 con 0x7f216806fe70 2023-12-19T05:39:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.099+0000 7f216ec7d640 1 -- 172.21.15.120:0/2201299221 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2168135f50 con 0x7f216806fe70 2023-12-19T05:39:19.104 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.101+0000 7f216ec7d640 1 -- 172.21.15.120:0/2201299221 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21681d0770 con 0x7f216806fe70 2023-12-19T05:39:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.101+0000 7f21657fa640 1 -- 172.21.15.120:0/2201299221 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f215c007bd0 con 0x7f216806fe70 2023-12-19T05:39:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.101+0000 7f21657fa640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f215406a430 0x7f215406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.101+0000 7f216ca19640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f215406a430 0x7f215406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.101+0000 7f21657fa640 1 -- 172.21.15.120:0/2201299221 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f215c088870 con 0x7f216806fe70 2023-12-19T05:39:19.105 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.102+0000 7f216ca19640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f215406a430 0x7f215406c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2158036000 tx=0x7f215803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.106 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.105+0000 7f21657fa640 1 -- 172.21.15.120:0/2201299221 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f215c053ef0 con 0x7f216806fe70 2023-12-19T05:39:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.270+0000 7f216ec7d640 1 -- 172.21.15.120:0/2201299221 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f216804e080 con 0x7f216806fe70 2023-12-19T05:39:19.272 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.271+0000 7f21657fa640 1 -- 172.21.15.120:0/2201299221 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f215c01e020 con 0x7f216806fe70 2023-12-19T05:39:19.272 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2023-12-19T05:39:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.272+0000 7f216ec7d640 1 -- 172.21.15.120:0/2201299221 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f215406a430 msgr2=0x7f215406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.272+0000 7f216ec7d640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f215406a430 0x7f215406c8f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2158036000 tx=0x7f215803c040 comp rx=0 tx=0).stop 2023-12-19T05:39:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.272+0000 7f216ec7d640 1 -- 172.21.15.120:0/2201299221 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f216806fe70 msgr2=0x7f21681d0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.272+0000 7f216ec7d640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f216806fe70 0x7f21681d0b50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f215c00c7f0 tx=0x7f215c00ccb0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.273+0000 7f216ec7d640 1 -- 172.21.15.120:0/2201299221 shutdown_connections 2023-12-19T05:39:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.273+0000 7f216ec7d640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f215406a430 0x7f215406c8f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.273+0000 7f216ec7d640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21680b68f0 0x7f21681d18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.274 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.273+0000 7f216ec7d640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f216806fe70 0x7f21681d0b50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.273+0000 7f216ec7d640 1 --2- 172.21.15.120:0/2201299221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f216806b240 0x7f216813bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.273+0000 7f216ec7d640 1 -- 172.21.15.120:0/2201299221 >> 172.21.15.120:0/2201299221 conn(0x7f21680bd070 msgr2=0x7f216813e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.273+0000 7f216ec7d640 1 -- 172.21.15.120:0/2201299221 shutdown_connections 2023-12-19T05:39:19.275 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.273+0000 7f216ec7d640 1 -- 172.21.15.120:0/2201299221 wait complete. 2023-12-19T05:39:19.295 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-12-19T05:39:19.295 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:19.394 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.392+0000 7fd215c26640 1 Processor -- start 2023-12-19T05:39:19.394 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.393+0000 7fd215c26640 1 -- start start 2023-12-19T05:39:19.395 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.393+0000 7fd215c26640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd21006da70 0x7fd2101429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.393+0000 7fd215c26640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd210142ee0 0x7fd2100b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.393+0000 7fd215c26640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2100b4e30 0x7fd2100b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.393+0000 7fd215c26640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21006ebc0 con 0x7fd21006da70 2023-12-19T05:39:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.393+0000 7fd215c26640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2100b3db0 con 0x7fd210142ee0 2023-12-19T05:39:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.393+0000 7fd215c26640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21006e690 con 0x7fd2100b4e30 2023-12-19T05:39:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.393+0000 7fd20f7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd21006da70 0x7fd2101429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.393+0000 7fd20f7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd21006da70 0x7fd2101429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47632/0 (socket says 172.21.15.120:47632) 2023-12-19T05:39:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.393+0000 7fd20f7fe640 1 -- 172.21.15.120:0/2856502964 learned_addr learned my addr 172.21.15.120:0/2856502964 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.394+0000 7fd20ffff640 1 --2- 172.21.15.120:0/2856502964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2100b4e30 0x7fd2100b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.394+0000 7fd206ffd640 1 --2- 172.21.15.120:0/2856502964 >> v2:172.21.15.155:3300/0 conn(0x7fd210142ee0 0x7fd2100b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.394+0000 7fd20f7fe640 1 -- 172.21.15.120:0/2856502964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2100b4e30 msgr2=0x7fd2100b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:19.396 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.394+0000 7fd20f7fe640 1 --2- 172.21.15.120:0/2856502964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2100b4e30 0x7fd2100b35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.394+0000 7fd20f7fe640 1 -- 172.21.15.120:0/2856502964 >> v2:172.21.15.155:3300/0 conn(0x7fd210142ee0 msgr2=0x7fd2100b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.394+0000 7fd20f7fe640 1 --2- 172.21.15.120:0/2856502964 >> v2:172.21.15.155:3300/0 conn(0x7fd210142ee0 0x7fd2100b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.394+0000 7fd20f7fe640 1 -- 172.21.15.120:0/2856502964 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2100b9f60 con 0x7fd21006da70 2023-12-19T05:39:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.394+0000 7fd20ffff640 1 --2- 172.21.15.120:0/2856502964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2100b4e30 0x7fd2100b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.394+0000 7fd206ffd640 1 --2- 172.21.15.120:0/2856502964 >> v2:172.21.15.155:3300/0 conn(0x7fd210142ee0 0x7fd2100b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.394+0000 7fd20f7fe640 1 --2- 172.21.15.120:0/2856502964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd21006da70 0x7fd2101429a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd21006d0d0 tx=0x7fd20002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a92d585e9b56a18a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.394+0000 7fd20effd640 1 -- 172.21.15.120:0/2856502964 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2000317c0 con 0x7fd21006da70 2023-12-19T05:39:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.394+0000 7fd20effd640 1 -- 172.21.15.120:0/2856502964 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd200031920 con 0x7fd21006da70 2023-12-19T05:39:19.397 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.394+0000 7fd20effd640 1 -- 172.21.15.120:0/2856502964 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200031cb0 con 0x7fd21006da70 2023-12-19T05:39:19.400 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.395+0000 7fd215c26640 1 -- 172.21.15.120:0/2856502964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd21006da70 msgr2=0x7fd2101429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.400 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.395+0000 7fd215c26640 1 --2- 172.21.15.120:0/2856502964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd21006da70 0x7fd2101429a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd21006d0d0 tx=0x7fd20002b860 comp rx=0 tx=0).stop 2023-12-19T05:39:19.400 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.395+0000 7fd215c26640 1 -- 172.21.15.120:0/2856502964 shutdown_connections 2023-12-19T05:39:19.400 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.395+0000 7fd215c26640 1 --2- 172.21.15.120:0/2856502964 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd2100b4e30 0x7fd2100b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.400 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.395+0000 7fd215c26640 1 --2- 172.21.15.120:0/2856502964 >> v2:172.21.15.155:3300/0 conn(0x7fd210142ee0 0x7fd2100b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.400 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.395+0000 7fd215c26640 1 --2- 172.21.15.120:0/2856502964 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd21006da70 0x7fd2101429a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.400 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.395+0000 7fd215c26640 1 -- 172.21.15.120:0/2856502964 >> 172.21.15.120:0/2856502964 conn(0x7fd2100bac10 msgr2=0x7fd2100bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:19.400 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.395+0000 7fd215c26640 1 -- 172.21.15.120:0/2856502964 shutdown_connections 2023-12-19T05:39:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.395+0000 7fd215c26640 1 -- 172.21.15.120:0/2856502964 wait complete. 2023-12-19T05:39:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.396+0000 7fd215c26640 1 Processor -- start 2023-12-19T05:39:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.396+0000 7fd215c26640 1 -- start start 2023-12-19T05:39:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd215c26640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd21006da70 0x7fd21014c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd215c26640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2100b4e30 0x7fd2101e0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd215c26640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd210142ee0 0x7fd2101e0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd215c26640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2100b8830 con 0x7fd2100b4e30 2023-12-19T05:39:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd215c26640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd210144300 con 0x7fd210142ee0 2023-12-19T05:39:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd215c26640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd210149a40 con 0x7fd21006da70 2023-12-19T05:39:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd206ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2100b4e30 0x7fd2101e0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd206ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2100b4e30 0x7fd2101e0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47646/0 (socket says 172.21.15.120:47646) 2023-12-19T05:39:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd206ffd640 1 -- 172.21.15.120:0/424066675 learned_addr learned my addr 172.21.15.120:0/424066675 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd20ffff640 1 --2- 172.21.15.120:0/424066675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd210142ee0 0x7fd2101e0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.401 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd20f7fe640 1 --2- 172.21.15.120:0/424066675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd21006da70 0x7fd21014c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd206ffd640 1 -- 172.21.15.120:0/424066675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd21006da70 msgr2=0x7fd21014c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd206ffd640 1 --2- 172.21.15.120:0/424066675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd21006da70 0x7fd21014c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd206ffd640 1 -- 172.21.15.120:0/424066675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd210142ee0 msgr2=0x7fd2101e0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd206ffd640 1 --2- 172.21.15.120:0/424066675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd210142ee0 0x7fd2101e0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd206ffd640 1 -- 172.21.15.120:0/424066675 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000094d0 con 0x7fd2100b4e30 2023-12-19T05:39:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.397+0000 7fd206ffd640 1 --2- 172.21.15.120:0/424066675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2100b4e30 0x7fd2101e0340 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800c7f0 tx=0x7fd1f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.398+0000 7fd20cff9640 1 -- 172.21.15.120:0/424066675 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8007820 con 0x7fd2100b4e30 2023-12-19T05:39:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.398+0000 7fd20cff9640 1 -- 172.21.15.120:0/424066675 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f8007980 con 0x7fd2100b4e30 2023-12-19T05:39:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.398+0000 7fd215c26640 1 -- 172.21.15.120:0/424066675 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21014caa0 con 0x7fd2100b4e30 2023-12-19T05:39:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.398+0000 7fd20cff9640 1 -- 172.21.15.120:0/424066675 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8007cf0 con 0x7fd2100b4e30 2023-12-19T05:39:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.398+0000 7fd215c26640 1 -- 172.21.15.120:0/424066675 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21006cd60 con 0x7fd2100b4e30 2023-12-19T05:39:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.399+0000 7fd215c26640 1 -- 172.21.15.120:0/424066675 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2101498a0 con 0x7fd2100b4e30 2023-12-19T05:39:19.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.399+0000 7fd20cff9640 1 -- 172.21.15.120:0/424066675 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd1f80113f0 con 0x7fd2100b4e30 2023-12-19T05:39:19.403 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.399+0000 7fd20cff9640 1 --2- 172.21.15.120:0/424066675 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd1f406a460 0x7fd1f406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.403 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.399+0000 7fd20f7fe640 1 --2- 172.21.15.120:0/424066675 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd1f406a460 0x7fd1f406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.403 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.400+0000 7fd20cff9640 1 -- 172.21.15.120:0/424066675 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1f8088a70 con 0x7fd2100b4e30 2023-12-19T05:39:19.403 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.400+0000 7fd20f7fe640 1 --2- 172.21.15.120:0/424066675 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd1f406a460 0x7fd1f406c920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd200036000 tx=0x7fd20003d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.405 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.404+0000 7fd20cff9640 1 -- 172.21.15.120:0/424066675 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd2101498a0 con 0x7fd2100b4e30 2023-12-19T05:39:19.573 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.571+0000 7fd215c26640 1 -- 172.21.15.120:0/424066675 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2101498a0 con 0x7fd2100b4e30 2023-12-19T05:39:19.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.572+0000 7fd20cff9640 1 -- 172.21.15.120:0/424066675 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fd1f8085ef0 con 0x7fd2100b4e30 2023-12-19T05:39:19.574 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:19.574 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:19.575 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.574+0000 7fd215c26640 1 -- 172.21.15.120:0/424066675 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd1f406a460 msgr2=0x7fd1f406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.574+0000 7fd215c26640 1 --2- 172.21.15.120:0/424066675 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd1f406a460 0x7fd1f406c920 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd200036000 tx=0x7fd20003d040 comp rx=0 tx=0).stop 2023-12-19T05:39:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.574+0000 7fd215c26640 1 -- 172.21.15.120:0/424066675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2100b4e30 msgr2=0x7fd2101e0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.574+0000 7fd215c26640 1 --2- 172.21.15.120:0/424066675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2100b4e30 0x7fd2101e0340 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800c7f0 tx=0x7fd1f800ccb0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.574+0000 7fd215c26640 1 -- 172.21.15.120:0/424066675 shutdown_connections 2023-12-19T05:39:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.574+0000 7fd215c26640 1 --2- 172.21.15.120:0/424066675 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd1f406a460 0x7fd1f406c920 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.574+0000 7fd215c26640 1 --2- 172.21.15.120:0/424066675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd210142ee0 0x7fd2101e0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.574+0000 7fd215c26640 1 --2- 172.21.15.120:0/424066675 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd2100b4e30 0x7fd2101e0340 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.574+0000 7fd215c26640 1 --2- 172.21.15.120:0/424066675 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd21006da70 0x7fd21014c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.574+0000 7fd215c26640 1 -- 172.21.15.120:0/424066675 >> 172.21.15.120:0/424066675 conn(0x7fd2100bac10 msgr2=0x7fd2100a18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.574+0000 7fd215c26640 1 -- 172.21.15.120:0/424066675 shutdown_connections 2023-12-19T05:39:19.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.574+0000 7fd215c26640 1 -- 172.21.15.120:0/424066675 wait complete. 2023-12-19T05:39:19.586 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:45.976868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:38:56.035188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:38:57.050130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:19.587 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:19.688 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.687+0000 7f9ceb4e7640 1 Processor -- start 2023-12-19T05:39:19.688 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.687+0000 7f9ceb4e7640 1 -- start start 2023-12-19T05:39:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.688+0000 7f9ceb4e7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9ce4144d70 0x7f9ce40b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.688+0000 7f9ceb4e7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9ce40bc7e0 0x7f9ce40bcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.688+0000 7f9ceb4e7640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce4145150 con 0x7f9ce414df70 2023-12-19T05:39:19.690 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.688+0000 7f9ceb4e7640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce40b9f00 con 0x7f9ce40bc7e0 2023-12-19T05:39:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.688+0000 7f9ceb4e7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce40b84b0 con 0x7f9ce4144d70 2023-12-19T05:39:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.688+0000 7f9ce9a84640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f9ce40bc7e0 0x7f9ce40bcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.688+0000 7f9ce8a82640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9ce414df70 0x7f9ce40b8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37252/0 (socket says 172.21.15.120:37252) 2023-12-19T05:39:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.688+0000 7f9ce8a82640 1 -- 172.21.15.120:0/334632062 learned_addr learned my addr 172.21.15.120:0/334632062 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.688+0000 7f9ce9283640 1 --2- 172.21.15.120:0/334632062 >> v2:172.21.15.155:3300/0 conn(0x7f9ce4144d70 0x7f9ce40b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.688+0000 7f9ce9a84640 1 -- 172.21.15.120:0/334632062 >> v2:172.21.15.155:3300/0 conn(0x7f9ce4144d70 msgr2=0x7f9ce40b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.688+0000 7f9cdbfff640 1 -- 172.21.15.120:0/334632062 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543290790 0 0) 0x7f9ce4145150 con 0x7f9ce414df70 2023-12-19T05:39:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.688+0000 7f9ce9a84640 1 --2- 172.21.15.120:0/334632062 >> v2:172.21.15.155:3300/0 conn(0x7f9ce4144d70 0x7f9ce40b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.688+0000 7f9ce9a84640 1 -- 172.21.15.120:0/334632062 >> v1:172.21.15.120:6789/0 conn(0x7f9ce414df70 legacy=0x7f9ce40b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.688+0000 7f9ce9a84640 1 -- 172.21.15.120:0/334632062 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce40b9080 con 0x7f9ce40bc7e0 2023-12-19T05:39:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.689+0000 7f9ce9a84640 1 --2- 172.21.15.120:0/334632062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ce40bc7e0 0x7f9ce40bcc00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40c1400 tx=0x7f9cdc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdfc2974f438d9a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.689+0000 7f9cdbfff640 1 -- 172.21.15.120:0/334632062 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc02cd00 con 0x7f9ce40bc7e0 2023-12-19T05:39:19.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.689+0000 7f9cdbfff640 1 -- 172.21.15.120:0/334632062 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc02ce60 con 0x7f9ce40bc7e0 2023-12-19T05:39:19.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.689+0000 7f9cdbfff640 1 -- 172.21.15.120:0/334632062 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc034660 con 0x7f9ce40bc7e0 2023-12-19T05:39:19.695 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.690+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/334632062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ce40bc7e0 msgr2=0x7f9ce40bcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.695 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.690+0000 7f9ceb4e7640 1 --2- 172.21.15.120:0/334632062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ce40bc7e0 0x7f9ce40bcc00 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40c1400 tx=0x7f9cdc02bf50 comp rx=0 tx=0).stop 2023-12-19T05:39:19.695 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.690+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/334632062 shutdown_connections 2023-12-19T05:39:19.695 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.690+0000 7f9ceb4e7640 1 --2- 172.21.15.120:0/334632062 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ce40bc7e0 0x7f9ce40bcc00 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.695 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.690+0000 7f9ceb4e7640 1 --2- 172.21.15.120:0/334632062 >> v2:172.21.15.155:3300/0 conn(0x7f9ce4144d70 0x7f9ce40b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.695 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.690+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/334632062 >> 172.21.15.120:0/334632062 conn(0x7f9ce4071430 msgr2=0x7f9ce4071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:19.695 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.690+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/334632062 shutdown_connections 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.690+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/334632062 wait complete. 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.691+0000 7f9ceb4e7640 1 Processor -- start 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.691+0000 7f9ceb4e7640 1 -- start start 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.691+0000 7f9ceb4e7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ce40bc7e0 0x7f9ce41e2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.691+0000 7f9ceb4e7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ce4144d70 0x7f9ce40bae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.691+0000 7f9ceb4e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ce414df70 0x7f9ce40abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.691+0000 7f9ceb4e7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce4146e00 con 0x7f9ce414df70 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.691+0000 7f9ceb4e7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40bb3a0 con 0x7f9ce4144d70 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.691+0000 7f9ceb4e7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40bb670 con 0x7f9ce40bc7e0 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.691+0000 7f9ce9a84640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ce414df70 0x7f9ce40abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.691+0000 7f9ce9a84640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ce414df70 0x7f9ce40abbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47660/0 (socket says 172.21.15.120:47660) 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.691+0000 7f9ce9a84640 1 -- 172.21.15.120:0/577013860 learned_addr learned my addr 172.21.15.120:0/577013860 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.692+0000 7f9ce8a82640 1 --2- 172.21.15.120:0/577013860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ce4144d70 0x7f9ce40bae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.692+0000 7f9ce9283640 1 --2- 172.21.15.120:0/577013860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ce40bc7e0 0x7f9ce41e2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.692+0000 7f9ce9a84640 1 -- 172.21.15.120:0/577013860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ce40bc7e0 msgr2=0x7f9ce41e2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.692+0000 7f9ce9a84640 1 --2- 172.21.15.120:0/577013860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ce40bc7e0 0x7f9ce41e2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.692+0000 7f9ce9a84640 1 -- 172.21.15.120:0/577013860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ce4144d70 msgr2=0x7f9ce40bae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.692+0000 7f9ce9a84640 1 --2- 172.21.15.120:0/577013860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ce4144d70 0x7f9ce40bae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.692+0000 7f9ce9a84640 1 -- 172.21.15.120:0/577013860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc009a70 con 0x7f9ce414df70 2023-12-19T05:39:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.692+0000 7f9ce9a84640 1 --2- 172.21.15.120:0/577013860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ce414df70 0x7f9ce40abbb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009eb0 tx=0x7f9cdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.692+0000 7f9cd9ffb640 1 -- 172.21.15.120:0/577013860 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc03d600 con 0x7f9ce414df70 2023-12-19T05:39:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.692+0000 7f9cd9ffb640 1 -- 172.21.15.120:0/577013860 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc03d780 con 0x7f9ce414df70 2023-12-19T05:39:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.692+0000 7f9cd9ffb640 1 -- 172.21.15.120:0/577013860 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc03db30 con 0x7f9ce414df70 2023-12-19T05:39:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.692+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/577013860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce4146880 con 0x7f9ce414df70 2023-12-19T05:39:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.692+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/577013860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce4147810 con 0x7f9ce414df70 2023-12-19T05:39:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.693+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/577013860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce404e080 con 0x7f9ce414df70 2023-12-19T05:39:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.693+0000 7f9cd9ffb640 1 -- 172.21.15.120:0/577013860 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9cdc03b040 con 0x7f9ce414df70 2023-12-19T05:39:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.694+0000 7f9cd9ffb640 1 --2- 172.21.15.120:0/577013860 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9cc806a430 0x7f9cc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.694+0000 7f9ce9283640 1 --2- 172.21.15.120:0/577013860 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9cc806a430 0x7f9cc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.694+0000 7f9cd9ffb640 1 -- 172.21.15.120:0/577013860 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cdc0ab040 con 0x7f9ce414df70 2023-12-19T05:39:19.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.694+0000 7f9ce9283640 1 --2- 172.21.15.120:0/577013860 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9cc806a430 0x7f9cc806c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0006fd0 tx=0x7f9ce0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.699 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.698+0000 7f9cd9ffb640 1 -- 172.21.15.120:0/577013860 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9cdc076630 con 0x7f9ce414df70 2023-12-19T05:39:19.866 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.864+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/577013860 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ce40bec90 con 0x7f9ce414df70 2023-12-19T05:39:19.866 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.865+0000 7f9cd9ffb640 1 -- 172.21.15.120:0/577013860 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9cdc039020 con 0x7f9ce414df70 2023-12-19T05:39:19.866 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2023-12-19T05:39:19.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.867+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/577013860 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9cc806a430 msgr2=0x7f9cc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.867+0000 7f9ceb4e7640 1 --2- 172.21.15.120:0/577013860 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9cc806a430 0x7f9cc806c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0006fd0 tx=0x7f9ce0008040 comp rx=0 tx=0).stop 2023-12-19T05:39:19.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.867+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/577013860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ce414df70 msgr2=0x7f9ce40abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.867+0000 7f9ceb4e7640 1 --2- 172.21.15.120:0/577013860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ce414df70 0x7f9ce40abbb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009eb0 tx=0x7f9cdc004a40 comp rx=0 tx=0).stop 2023-12-19T05:39:19.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.867+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/577013860 shutdown_connections 2023-12-19T05:39:19.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.867+0000 7f9ceb4e7640 1 --2- 172.21.15.120:0/577013860 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9cc806a430 0x7f9cc806c8f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.867+0000 7f9ceb4e7640 1 --2- 172.21.15.120:0/577013860 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ce414df70 0x7f9ce40abbb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.867+0000 7f9ceb4e7640 1 --2- 172.21.15.120:0/577013860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ce4144d70 0x7f9ce40bae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.867+0000 7f9ceb4e7640 1 --2- 172.21.15.120:0/577013860 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ce40bc7e0 0x7f9ce41e2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.867+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/577013860 >> 172.21.15.120:0/577013860 conn(0x7f9ce4071430 msgr2=0x7f9ce40bf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:19.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.867+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/577013860 shutdown_connections 2023-12-19T05:39:19.870 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.867+0000 7f9ceb4e7640 1 -- 172.21.15.120:0/577013860 wait complete. 2023-12-19T05:39:19.879 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:19.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.979+0000 7fb98ff3e640 1 Processor -- start 2023-12-19T05:39:19.981 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.979+0000 7fb98ff3e640 1 -- start start 2023-12-19T05:39:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.980+0000 7fb98ff3e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb988144d70 0x7fb9880b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.980+0000 7fb98ff3e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb98814df70 0x7fb9880b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.980+0000 7fb98ff3e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb988145150 con 0x7fb9880bc7e0 2023-12-19T05:39:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.980+0000 7fb98ff3e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9880b9f00 con 0x7fb988144d70 2023-12-19T05:39:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.980+0000 7fb98ff3e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9880b84b0 con 0x7fb98814df70 2023-12-19T05:39:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.980+0000 7fb98dcda640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb988144d70 0x7fb9880b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.980+0000 7fb98dcda640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb988144d70 0x7fb9880b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47672/0 (socket says 172.21.15.120:47672) 2023-12-19T05:39:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.980+0000 7fb98dcda640 1 -- 172.21.15.120:0/3196946651 learned_addr learned my addr 172.21.15.120:0/3196946651 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.980+0000 7fb98dcda640 1 -- 172.21.15.120:0/3196946651 >> v2:172.21.15.155:3300/0 conn(0x7fb98814df70 msgr2=0x7fb9880b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.980+0000 7fb98dcda640 1 --2- 172.21.15.120:0/3196946651 >> v2:172.21.15.155:3300/0 conn(0x7fb98814df70 0x7fb9880b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.980+0000 7fb98dcda640 1 -- 172.21.15.120:0/3196946651 >> v1:172.21.15.155:6789/0 conn(0x7fb9880bc7e0 legacy=0x7fb9880bcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:19.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.980+0000 7fb98dcda640 1 -- 172.21.15.120:0/3196946651 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9880b9080 con 0x7fb988144d70 2023-12-19T05:39:19.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.981+0000 7fb98dcda640 1 --2- 172.21.15.120:0/3196946651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb988144d70 0x7fb9880b7f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb9881485f0 tx=0x7fb98402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123bf9c9f62bb8f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.981+0000 7fb98ccd8640 1 -- 172.21.15.120:0/3196946651 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb984030860 con 0x7fb988144d70 2023-12-19T05:39:19.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.981+0000 7fb98ccd8640 1 -- 172.21.15.120:0/3196946651 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9840309c0 con 0x7fb988144d70 2023-12-19T05:39:19.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.981+0000 7fb98ccd8640 1 -- 172.21.15.120:0/3196946651 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb984030d50 con 0x7fb988144d70 2023-12-19T05:39:19.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.982+0000 7fb98ff3e640 1 -- 172.21.15.120:0/3196946651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb988144d70 msgr2=0x7fb9880b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.982+0000 7fb98ff3e640 1 --2- 172.21.15.120:0/3196946651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb988144d70 0x7fb9880b7f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb9881485f0 tx=0x7fb98402b9a0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.982+0000 7fb98ff3e640 1 -- 172.21.15.120:0/3196946651 shutdown_connections 2023-12-19T05:39:19.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.982+0000 7fb98ff3e640 1 --2- 172.21.15.120:0/3196946651 >> v2:172.21.15.155:3300/0 conn(0x7fb98814df70 0x7fb9880b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.985 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.982+0000 7fb98ff3e640 1 --2- 172.21.15.120:0/3196946651 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb988144d70 0x7fb9880b7f70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.985 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.982+0000 7fb98ff3e640 1 -- 172.21.15.120:0/3196946651 >> 172.21.15.120:0/3196946651 conn(0x7fb988071430 msgr2=0x7fb988071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:19.985 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.982+0000 7fb98ff3e640 1 -- 172.21.15.120:0/3196946651 shutdown_connections 2023-12-19T05:39:19.985 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.982+0000 7fb98ff3e640 1 -- 172.21.15.120:0/3196946651 wait complete. 2023-12-19T05:39:19.985 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.983+0000 7fb98ff3e640 1 Processor -- start 2023-12-19T05:39:19.985 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.983+0000 7fb98ff3e640 1 -- start start 2023-12-19T05:39:19.987 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98ff3e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9880bc7e0 0x7fb9881469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.987 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98ff3e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb988144d70 0x7fb9880b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.987 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98ff3e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb98814df70 0x7fb9881e37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.987 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98ff3e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880b5a20 con 0x7fb9880bc7e0 2023-12-19T05:39:19.987 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98ff3e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb988145540 con 0x7fb988144d70 2023-12-19T05:39:19.987 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98ff3e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb988145790 con 0x7fb98814df70 2023-12-19T05:39:19.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98dcda640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9880bc7e0 0x7fb9881469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98dcda640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9880bc7e0 0x7fb9881469b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47684/0 (socket says 172.21.15.120:47684) 2023-12-19T05:39:19.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98dcda640 1 -- 172.21.15.120:0/1627742789 learned_addr learned my addr 172.21.15.120:0/1627742789 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:19.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98d4d9640 1 --2- 172.21.15.120:0/1627742789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb988144d70 0x7fb9880b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98e4db640 1 --2- 172.21.15.120:0/1627742789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb98814df70 0x7fb9881e37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98dcda640 1 -- 172.21.15.120:0/1627742789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb98814df70 msgr2=0x7fb9881e37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98dcda640 1 --2- 172.21.15.120:0/1627742789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb98814df70 0x7fb9881e37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98dcda640 1 -- 172.21.15.120:0/1627742789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb988144d70 msgr2=0x7fb9880b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:19.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98dcda640 1 --2- 172.21.15.120:0/1627742789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb988144d70 0x7fb9880b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:19.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98dcda640 1 -- 172.21.15.120:0/1627742789 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9840094d0 con 0x7fb9880bc7e0 2023-12-19T05:39:19.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98dcda640 1 --2- 172.21.15.120:0/1627742789 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9880bc7e0 0x7fb9881469b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb984000c00 tx=0x7fb984004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb97e7fc640 1 -- 172.21.15.120:0/1627742789 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb984039d40 con 0x7fb9880bc7e0 2023-12-19T05:39:19.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb97e7fc640 1 -- 172.21.15.120:0/1627742789 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb984043400 con 0x7fb9880bc7e0 2023-12-19T05:39:19.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98ff3e640 1 -- 172.21.15.120:0/1627742789 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb988145a70 con 0x7fb9880bc7e0 2023-12-19T05:39:19.989 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb97e7fc640 1 -- 172.21.15.120:0/1627742789 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb984039ea0 con 0x7fb9880bc7e0 2023-12-19T05:39:19.989 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.984+0000 7fb98ff3e640 1 -- 172.21.15.120:0/1627742789 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9880af880 con 0x7fb9880bc7e0 2023-12-19T05:39:19.989 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.985+0000 7fb98ff3e640 1 -- 172.21.15.120:0/1627742789 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9881e3410 con 0x7fb9880bc7e0 2023-12-19T05:39:19.989 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.986+0000 7fb97e7fc640 1 -- 172.21.15.120:0/1627742789 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb9840437b0 con 0x7fb9880bc7e0 2023-12-19T05:39:19.989 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.986+0000 7fb97e7fc640 1 --2- 172.21.15.120:0/1627742789 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb96c06a430 0x7fb96c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:19.989 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.986+0000 7fb98d4d9640 1 --2- 172.21.15.120:0/1627742789 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb96c06a430 0x7fb96c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:19.989 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.986+0000 7fb97e7fc640 1 -- 172.21.15.120:0/1627742789 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb98403e070 con 0x7fb9880bc7e0 2023-12-19T05:39:19.989 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.987+0000 7fb98d4d9640 1 --2- 172.21.15.120:0/1627742789 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb96c06a430 0x7fb96c06c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb9880ac650 tx=0x7fb978009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:19.991 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:19.990+0000 7fb97e7fc640 1 -- 172.21.15.120:0/1627742789 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb984077160 con 0x7fb9880bc7e0 2023-12-19T05:39:20.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.157+0000 7fb98ff3e640 1 -- 172.21.15.120:0/1627742789 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb98804e080 con 0x7fb9880bc7e0 2023-12-19T05:39:20.158 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.157+0000 7fb97e7fc640 1 -- 172.21.15.120:0/1627742789 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb984034020 con 0x7fb9880bc7e0 2023-12-19T05:39:20.158 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2023-12-19T05:39:20.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.159+0000 7fb98ff3e640 1 -- 172.21.15.120:0/1627742789 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb96c06a430 msgr2=0x7fb96c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.159+0000 7fb98ff3e640 1 --2- 172.21.15.120:0/1627742789 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb96c06a430 0x7fb96c06c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb9880ac650 tx=0x7fb978009060 comp rx=0 tx=0).stop 2023-12-19T05:39:20.160 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.159+0000 7fb98ff3e640 1 -- 172.21.15.120:0/1627742789 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9880bc7e0 msgr2=0x7fb9881469b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.161 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.159+0000 7fb98ff3e640 1 --2- 172.21.15.120:0/1627742789 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9880bc7e0 0x7fb9881469b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb984000c00 tx=0x7fb984004730 comp rx=0 tx=0).stop 2023-12-19T05:39:20.161 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.159+0000 7fb98ff3e640 1 -- 172.21.15.120:0/1627742789 shutdown_connections 2023-12-19T05:39:20.161 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.159+0000 7fb98ff3e640 1 --2- 172.21.15.120:0/1627742789 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb96c06a430 0x7fb96c06c8f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.161 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.159+0000 7fb98ff3e640 1 --2- 172.21.15.120:0/1627742789 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb98814df70 0x7fb9881e37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.161 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.159+0000 7fb98ff3e640 1 --2- 172.21.15.120:0/1627742789 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb988144d70 0x7fb9880b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.161 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.159+0000 7fb98ff3e640 1 --2- 172.21.15.120:0/1627742789 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb9880bc7e0 0x7fb9881469b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.159+0000 7fb98ff3e640 1 -- 172.21.15.120:0/1627742789 >> 172.21.15.120:0/1627742789 conn(0x7fb988071430 msgr2=0x7fb9880bf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:20.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.159+0000 7fb98ff3e640 1 -- 172.21.15.120:0/1627742789 shutdown_connections 2023-12-19T05:39:20.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.159+0000 7fb98ff3e640 1 -- 172.21.15.120:0/1627742789 wait complete. 2023-12-19T05:39:20.171 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:20.273 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.272+0000 7f2d37e7d640 1 Processor -- start 2023-12-19T05:39:20.273 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.272+0000 7f2d37e7d640 1 -- start start 2023-12-19T05:39:20.275 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.273+0000 7f2d37e7d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2d30144d70 0x7f2d300b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.275 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.273+0000 7f2d37e7d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d3014df70 0x7f2d300b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.275 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.273+0000 7f2d37e7d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d30145150 con 0x7f2d300bc7e0 2023-12-19T05:39:20.275 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.273+0000 7f2d37e7d640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d300b9f00 con 0x7f2d30144d70 2023-12-19T05:39:20.275 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.273+0000 7f2d37e7d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d300b84b0 con 0x7f2d3014df70 2023-12-19T05:39:20.275 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.273+0000 7f2d3641a640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f2d300bc7e0 0x7f2d300bcc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37268/0 (socket says 172.21.15.120:37268) 2023-12-19T05:39:20.275 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.273+0000 7f2d35c19640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f2d30144d70 0x7f2d300b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.275 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.273+0000 7f2d3641a640 1 -- 172.21.15.120:0/260182276 learned_addr learned my addr 172.21.15.120:0/260182276 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:20.276 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.273+0000 7f2d35418640 1 --2- 172.21.15.120:0/260182276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d3014df70 0x7f2d300b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.276 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.273+0000 7f2d35c19640 1 -- 172.21.15.120:0/260182276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d3014df70 msgr2=0x7f2d300b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:20.276 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.273+0000 7f2d35c19640 1 --2- 172.21.15.120:0/260182276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d3014df70 0x7f2d300b8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.276 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.273+0000 7f2d35c19640 1 -- 172.21.15.120:0/260182276 >> v1:172.21.15.120:6789/0 conn(0x7f2d300bc7e0 legacy=0x7f2d300bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.276 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.273+0000 7f2d34c17640 1 -- 172.21.15.120:0/260182276 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329952625 0 0) 0x7f2d30145150 con 0x7f2d300bc7e0 2023-12-19T05:39:20.276 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.273+0000 7f2d35c19640 1 -- 172.21.15.120:0/260182276 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d300b9080 con 0x7f2d30144d70 2023-12-19T05:39:20.276 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.274+0000 7f2d35c19640 1 --2- 172.21.15.120:0/260182276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d30144d70 0x7f2d300b7f70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0097a0 tx=0x7f2d2c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4b04ea27370e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:20.276 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.274+0000 7f2d34c17640 1 -- 172.21.15.120:0/260182276 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c030610 con 0x7f2d30144d70 2023-12-19T05:39:20.276 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.274+0000 7f2d34c17640 1 -- 172.21.15.120:0/260182276 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c030770 con 0x7f2d30144d70 2023-12-19T05:39:20.276 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.274+0000 7f2d34c17640 1 -- 172.21.15.120:0/260182276 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c030b00 con 0x7f2d30144d70 2023-12-19T05:39:20.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.274+0000 7f2d37e7d640 1 -- 172.21.15.120:0/260182276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d30144d70 msgr2=0x7f2d300b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.274+0000 7f2d37e7d640 1 --2- 172.21.15.120:0/260182276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d30144d70 0x7f2d300b7f70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0097a0 tx=0x7f2d2c02b960 comp rx=0 tx=0).stop 2023-12-19T05:39:20.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.274+0000 7f2d37e7d640 1 -- 172.21.15.120:0/260182276 shutdown_connections 2023-12-19T05:39:20.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.274+0000 7f2d37e7d640 1 --2- 172.21.15.120:0/260182276 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d3014df70 0x7f2d300b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.274+0000 7f2d37e7d640 1 --2- 172.21.15.120:0/260182276 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d30144d70 0x7f2d300b7f70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.274+0000 7f2d37e7d640 1 -- 172.21.15.120:0/260182276 >> 172.21.15.120:0/260182276 conn(0x7f2d30071430 msgr2=0x7f2d30071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:20.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.275+0000 7f2d37e7d640 1 -- 172.21.15.120:0/260182276 shutdown_connections 2023-12-19T05:39:20.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.275+0000 7f2d37e7d640 1 -- 172.21.15.120:0/260182276 wait complete. 2023-12-19T05:39:20.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d37e7d640 1 Processor -- start 2023-12-19T05:39:20.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d37e7d640 1 -- start start 2023-12-19T05:39:20.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d37e7d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d300bc7e0 0x7f2d300ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d37e7d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d30144d70 0x7f2d301e3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d37e7d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d3014df70 0x7f2d301e4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d37e7d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d300ae350 con 0x7f2d30144d70 2023-12-19T05:39:20.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d37e7d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d301e38c0 con 0x7f2d3014df70 2023-12-19T05:39:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d37e7d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d30147e70 con 0x7f2d300bc7e0 2023-12-19T05:39:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d35418640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d30144d70 0x7f2d301e3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d35418640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d30144d70 0x7f2d301e3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47694/0 (socket says 172.21.15.120:47694) 2023-12-19T05:39:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d35418640 1 -- 172.21.15.120:0/1569406260 learned_addr learned my addr 172.21.15.120:0/1569406260 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d35c19640 1 --2- 172.21.15.120:0/1569406260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d300bc7e0 0x7f2d300ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d3641a640 1 --2- 172.21.15.120:0/1569406260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d3014df70 0x7f2d301e4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d35418640 1 -- 172.21.15.120:0/1569406260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d300bc7e0 msgr2=0x7f2d300ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d35418640 1 --2- 172.21.15.120:0/1569406260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d300bc7e0 0x7f2d300ab120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d35418640 1 -- 172.21.15.120:0/1569406260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d3014df70 msgr2=0x7f2d301e4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d35418640 1 --2- 172.21.15.120:0/1569406260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d3014df70 0x7f2d301e4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.276+0000 7f2d35418640 1 -- 172.21.15.120:0/1569406260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c009400 con 0x7f2d30144d70 2023-12-19T05:39:20.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.277+0000 7f2d35418640 1 --2- 172.21.15.120:0/1569406260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d30144d70 0x7f2d301e3d50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000d5f0 tx=0x7f2d2000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.277+0000 7f2d267fc640 1 -- 172.21.15.120:0/1569406260 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200125f0 con 0x7f2d30144d70 2023-12-19T05:39:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.277+0000 7f2d267fc640 1 -- 172.21.15.120:0/1569406260 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d20012750 con 0x7f2d30144d70 2023-12-19T05:39:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.277+0000 7f2d37e7d640 1 -- 172.21.15.120:0/1569406260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d30148110 con 0x7f2d30144d70 2023-12-19T05:39:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.277+0000 7f2d267fc640 1 -- 172.21.15.120:0/1569406260 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d20012b00 con 0x7f2d30144d70 2023-12-19T05:39:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.277+0000 7f2d37e7d640 1 -- 172.21.15.120:0/1569406260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d300af3d0 con 0x7f2d30144d70 2023-12-19T05:39:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.278+0000 7f2d37e7d640 1 -- 172.21.15.120:0/1569406260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d30148300 con 0x7f2d30144d70 2023-12-19T05:39:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.278+0000 7f2d267fc640 1 -- 172.21.15.120:0/1569406260 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2d20012c60 con 0x7f2d30144d70 2023-12-19T05:39:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.278+0000 7f2d267fc640 1 --2- 172.21.15.120:0/1569406260 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f2d1406a460 0x7f2d1406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.279+0000 7f2d267fc640 1 -- 172.21.15.120:0/1569406260 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d20088cb0 con 0x7f2d30144d70 2023-12-19T05:39:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.279+0000 7f2d35c19640 1 --2- 172.21.15.120:0/1569406260 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f2d1406a460 0x7f2d1406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.279+0000 7f2d35c19640 1 --2- 172.21.15.120:0/1569406260 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f2d1406a460 0x7f2d1406c920 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c036000 tx=0x7f2d2c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:20.285 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.283+0000 7f2d267fc640 1 -- 172.21.15.120:0/1569406260 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f2d20054330 con 0x7f2d30144d70 2023-12-19T05:39:20.451 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.449+0000 7f2d37e7d640 1 -- 172.21.15.120:0/1569406260 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2d3004e080 con 0x7f2d30144d70 2023-12-19T05:39:20.451 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.450+0000 7f2d267fc640 1 -- 172.21.15.120:0/1569406260 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2d20057950 con 0x7f2d30144d70 2023-12-19T05:39:20.451 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2023-12-19T05:39:20.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.451+0000 7f2d37e7d640 1 -- 172.21.15.120:0/1569406260 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f2d1406a460 msgr2=0x7f2d1406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.451+0000 7f2d37e7d640 1 --2- 172.21.15.120:0/1569406260 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f2d1406a460 0x7f2d1406c920 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c036000 tx=0x7f2d2c03b040 comp rx=0 tx=0).stop 2023-12-19T05:39:20.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.451+0000 7f2d37e7d640 1 -- 172.21.15.120:0/1569406260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d30144d70 msgr2=0x7f2d301e3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.451+0000 7f2d37e7d640 1 --2- 172.21.15.120:0/1569406260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d30144d70 0x7f2d301e3d50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000d5f0 tx=0x7f2d2000dab0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.451+0000 7f2d37e7d640 1 -- 172.21.15.120:0/1569406260 shutdown_connections 2023-12-19T05:39:20.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.451+0000 7f2d37e7d640 1 --2- 172.21.15.120:0/1569406260 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f2d1406a460 0x7f2d1406c920 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.451+0000 7f2d37e7d640 1 --2- 172.21.15.120:0/1569406260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d3014df70 0x7f2d301e4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.451+0000 7f2d37e7d640 1 --2- 172.21.15.120:0/1569406260 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f2d30144d70 0x7f2d301e3d50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.451+0000 7f2d37e7d640 1 --2- 172.21.15.120:0/1569406260 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f2d300bc7e0 0x7f2d300ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.454 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.451+0000 7f2d37e7d640 1 -- 172.21.15.120:0/1569406260 >> 172.21.15.120:0/1569406260 conn(0x7f2d30071430 msgr2=0x7f2d300b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:20.454 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.452+0000 7f2d37e7d640 1 -- 172.21.15.120:0/1569406260 shutdown_connections 2023-12-19T05:39:20.454 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.452+0000 7f2d37e7d640 1 -- 172.21.15.120:0/1569406260 wait complete. 2023-12-19T05:39:20.463 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-12-19T05:39:20.566 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.561+0000 7f77e4a17640 1 Processor -- start 2023-12-19T05:39:20.566 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.561+0000 7f77e4a17640 1 -- start start 2023-12-19T05:39:20.567 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.562+0000 7f77e4a17640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77e00b79b0 0x7f77e00b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.567 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.562+0000 7f77e4a17640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f77e014b230 0x7f77e014b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.567 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.562+0000 7f77e4a17640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e00b96b0 con 0x7f77e00b8860 2023-12-19T05:39:20.567 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.562+0000 7f77e4a17640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e014ae10 con 0x7f77e014b230 2023-12-19T05:39:20.567 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.562+0000 7f77e4a17640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00bacc0 con 0x7f77e00b79b0 2023-12-19T05:39:20.567 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.562+0000 7f77ded9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f77e014b230 0x7f77e014b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.567 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.562+0000 7f77ddd9b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f77e00b8860 0x7f77e0144ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:37274/0 (socket says 172.21.15.120:37274) 2023-12-19T05:39:20.567 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.562+0000 7f77ddd9b640 1 -- 172.21.15.120:0/3638947279 learned_addr learned my addr 172.21.15.120:0/3638947279 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:20.568 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.562+0000 7f77de59c640 1 --2- 172.21.15.120:0/3638947279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77e00b79b0 0x7f77e00b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.568 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.562+0000 7f77ded9d640 1 -- 172.21.15.120:0/3638947279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77e00b79b0 msgr2=0x7f77e00b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:20.568 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.562+0000 7f77ded9d640 1 --2- 172.21.15.120:0/3638947279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77e00b79b0 0x7f77e00b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.568 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.562+0000 7f77ded9d640 1 -- 172.21.15.120:0/3638947279 >> v1:172.21.15.120:6789/0 conn(0x7f77e00b8860 legacy=0x7f77e0144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.568 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.562+0000 7f77dd59a640 1 -- 172.21.15.120:0/3638947279 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615836973 0 0) 0x7f77e00b96b0 con 0x7f77e00b8860 2023-12-19T05:39:20.568 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.562+0000 7f77ded9d640 1 -- 172.21.15.120:0/3638947279 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00b90f0 con 0x7f77e014b230 2023-12-19T05:39:20.568 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.563+0000 7f77ded9d640 1 --2- 172.21.15.120:0/3638947279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77e014b230 0x7f77e014b6c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f77d00097a0 tx=0x7f77d002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e741850160a899 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:20.569 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.563+0000 7f77dd59a640 1 -- 172.21.15.120:0/3638947279 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0031830 con 0x7f77e014b230 2023-12-19T05:39:20.569 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.563+0000 7f77dd59a640 1 -- 172.21.15.120:0/3638947279 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d0031990 con 0x7f77e014b230 2023-12-19T05:39:20.569 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.563+0000 7f77dd59a640 1 -- 172.21.15.120:0/3638947279 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0031d20 con 0x7f77e014b230 2023-12-19T05:39:20.569 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.564+0000 7f77e4a17640 1 -- 172.21.15.120:0/3638947279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77e014b230 msgr2=0x7f77e014b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.569 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.564+0000 7f77e4a17640 1 --2- 172.21.15.120:0/3638947279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77e014b230 0x7f77e014b6c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f77d00097a0 tx=0x7f77d002b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.569 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.564+0000 7f77e4a17640 1 -- 172.21.15.120:0/3638947279 shutdown_connections 2023-12-19T05:39:20.570 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.564+0000 7f77e4a17640 1 --2- 172.21.15.120:0/3638947279 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77e014b230 0x7f77e014b6c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.570 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.564+0000 7f77e4a17640 1 --2- 172.21.15.120:0/3638947279 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77e00b79b0 0x7f77e00b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.570 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.564+0000 7f77e4a17640 1 -- 172.21.15.120:0/3638947279 >> 172.21.15.120:0/3638947279 conn(0x7f77e00c0340 msgr2=0x7f77e00c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:20.570 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.564+0000 7f77e4a17640 1 -- 172.21.15.120:0/3638947279 shutdown_connections 2023-12-19T05:39:20.570 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.564+0000 7f77e4a17640 1 -- 172.21.15.120:0/3638947279 wait complete. 2023-12-19T05:39:20.571 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.565+0000 7f77e4a17640 1 Processor -- start 2023-12-19T05:39:20.571 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.565+0000 7f77e4a17640 1 -- start start 2023-12-19T05:39:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.565+0000 7f77e4a17640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77e00b79b0 0x7f77e0148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77e4a17640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77e00b8860 0x7f77e01dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77e4a17640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77e014b230 0x7f77e009d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.575 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77e4a17640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e01493a0 con 0x7f77e00b8860 2023-12-19T05:39:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77e4a17640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e009cff0 con 0x7f77e014b230 2023-12-19T05:39:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77e4a17640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e009d210 con 0x7f77e00b79b0 2023-12-19T05:39:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77ddd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77e00b8860 0x7f77e01dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77ddd9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77e00b8860 0x7f77e01dfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:47714/0 (socket says 172.21.15.120:47714) 2023-12-19T05:39:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77ddd9b640 1 -- 172.21.15.120:0/4150481394 learned_addr learned my addr 172.21.15.120:0/4150481394 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77de59c640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77e00b79b0 0x7f77e0148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77ded9d640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77e014b230 0x7f77e009d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.576 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77ddd9b640 1 -- 172.21.15.120:0/4150481394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77e00b79b0 msgr2=0x7f77e0148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77ddd9b640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77e00b79b0 0x7f77e0148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77ddd9b640 1 -- 172.21.15.120:0/4150481394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77e014b230 msgr2=0x7f77e009d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77ddd9b640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77e014b230 0x7f77e009d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77ddd9b640 1 -- 172.21.15.120:0/4150481394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d0009400 con 0x7f77e00b8860 2023-12-19T05:39:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77ded9d640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77e014b230 0x7f77e009d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:20.577 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77ddd9b640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77e00b8860 0x7f77e01dfb80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c8c0 tx=0x7f77d400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77ceffd640 1 -- 172.21.15.120:0/4150481394 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d400a640 con 0x7f77e00b8860 2023-12-19T05:39:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77ceffd640 1 -- 172.21.15.120:0/4150481394 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d400a7c0 con 0x7f77e00b8860 2023-12-19T05:39:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77ceffd640 1 -- 172.21.15.120:0/4150481394 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d400ab70 con 0x7f77e00b8860 2023-12-19T05:39:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77e4a17640 1 -- 172.21.15.120:0/4150481394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e009b040 con 0x7f77e00b8860 2023-12-19T05:39:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.566+0000 7f77e4a17640 1 -- 172.21.15.120:0/4150481394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e009b3d0 con 0x7f77e00b8860 2023-12-19T05:39:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.567+0000 7f77e4a17640 1 -- 172.21.15.120:0/4150481394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e004e080 con 0x7f77e00b8860 2023-12-19T05:39:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.568+0000 7f77ceffd640 1 -- 172.21.15.120:0/4150481394 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f77d400acd0 con 0x7f77e00b8860 2023-12-19T05:39:20.578 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.568+0000 7f77ceffd640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f77c006a430 0x7f77c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.568+0000 7f77ceffd640 1 -- 172.21.15.120:0/4150481394 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77d4087ed0 con 0x7f77e00b8860 2023-12-19T05:39:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.568+0000 7f77de59c640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f77c006a430 0x7f77c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.568+0000 7f77de59c640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f77c006a430 0x7f77c006c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f77d8006fd0 tx=0x7f77d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:20.579 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.572+0000 7f77ceffd640 1 -- 172.21.15.120:0/4150481394 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f77d4053570 con 0x7f77e00b8860 2023-12-19T05:39:20.805 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:20.804+0000 7f77e4a17640 1 -- 172.21.15.120:0/4150481394 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f77e01e0180 con 0x7f77e00b8860 2023-12-19T05:39:21.748 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.747+0000 7f77ceffd640 1 -- 172.21.15.120:0/4150481394 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v47) v1 ==== 166+0+0 (secure 0 0 0) 0x7f77d4018020 con 0x7f77e00b8860 2023-12-19T05:39:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.750+0000 7f77e4a17640 1 -- 172.21.15.120:0/4150481394 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f77c006a430 msgr2=0x7f77c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.750+0000 7f77e4a17640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f77c006a430 0x7f77c006c8f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f77d8006fd0 tx=0x7f77d8008040 comp rx=0 tx=0).stop 2023-12-19T05:39:21.751 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.750+0000 7f77e4a17640 1 -- 172.21.15.120:0/4150481394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77e00b8860 msgr2=0x7f77e01dfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.750+0000 7f77e4a17640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77e00b8860 0x7f77e01dfb80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c8c0 tx=0x7f77d400cd80 comp rx=0 tx=0).stop 2023-12-19T05:39:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.750+0000 7f77e4a17640 1 -- 172.21.15.120:0/4150481394 shutdown_connections 2023-12-19T05:39:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.750+0000 7f77e4a17640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f77c006a430 0x7f77c006c8f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.750+0000 7f77e4a17640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f77e014b230 0x7f77e009d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.750+0000 7f77e4a17640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f77e00b8860 0x7f77e01dfb80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.750+0000 7f77e4a17640 1 --2- 172.21.15.120:0/4150481394 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f77e00b79b0 0x7f77e0148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.750+0000 7f77e4a17640 1 -- 172.21.15.120:0/4150481394 >> 172.21.15.120:0/4150481394 conn(0x7f77e00c0340 msgr2=0x7f77e0149ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.750+0000 7f77e4a17640 1 -- 172.21.15.120:0/4150481394 shutdown_connections 2023-12-19T05:39:21.752 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.750+0000 7f77e4a17640 1 -- 172.21.15.120:0/4150481394 wait complete. 2023-12-19T05:39:21.764 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T05:39:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.871+0000 7f98b317e640 1 Processor -- start 2023-12-19T05:39:21.873 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.871+0000 7f98b317e640 1 -- start start 2023-12-19T05:39:21.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.872+0000 7f98b317e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f98ac0bad20 0x7f98ac0b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.872+0000 7f98b317e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98ac142df0 0x7f98ac153270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.872+0000 7f98b317e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ac0b56d0 con 0x7f98ac142980 2023-12-19T05:39:21.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.872+0000 7f98b317e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac0b6070 con 0x7f98ac0bad20 2023-12-19T05:39:21.875 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.872+0000 7f98b317e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0b59b0 con 0x7f98ac142df0 2023-12-19T05:39:21.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.872+0000 7f98b0f1a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f98ac0bad20 0x7f98ac0b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.872+0000 7f98abfff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f98ac142980 0x7f98ac0b96d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40864/0 (socket says 172.21.15.120:40864) 2023-12-19T05:39:21.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.872+0000 7f98abfff640 1 -- 172.21.15.120:0/58574803 learned_addr learned my addr 172.21.15.120:0/58574803 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:21.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.872+0000 7f98b0f1a640 1 --2- 172.21.15.120:0/58574803 >> v2:172.21.15.120:3300/0 conn(0x7f98ac0bad20 0x7f98ac0b4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52566/0 (socket says 172.21.15.120:52566) 2023-12-19T05:39:21.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.872+0000 7f98b171b640 1 --2- 172.21.15.120:0/58574803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98ac142df0 0x7f98ac153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.872+0000 7f98b0f1a640 1 -- 172.21.15.120:0/58574803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98ac142df0 msgr2=0x7f98ac153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:21.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.872+0000 7f98b0f1a640 1 --2- 172.21.15.120:0/58574803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98ac142df0 0x7f98ac153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.872+0000 7f98b0f1a640 1 -- 172.21.15.120:0/58574803 >> v1:172.21.15.120:6789/0 conn(0x7f98ac142980 legacy=0x7f98ac0b96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.872+0000 7f98ab7fe640 1 -- 172.21.15.120:0/58574803 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1044198720 0 0) 0x7f98ac0b56d0 con 0x7f98ac142980 2023-12-19T05:39:21.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.873+0000 7f98b0f1a640 1 -- 172.21.15.120:0/58574803 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac0b5c90 con 0x7f98ac0bad20 2023-12-19T05:39:21.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.873+0000 7f98b171b640 1 --2- 172.21.15.120:0/58574803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98ac142df0 0x7f98ac153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:21.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.873+0000 7f98b0f1a640 1 --2- 172.21.15.120:0/58574803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98ac0bad20 0x7f98ac0b4d50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f989c0097a0 tx=0x7f989c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5815cf30a1e658 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:21.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.873+0000 7f98ab7fe640 1 -- 172.21.15.120:0/58574803 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c031830 con 0x7f98ac0bad20 2023-12-19T05:39:21.876 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.873+0000 7f98ab7fe640 1 -- 172.21.15.120:0/58574803 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c031990 con 0x7f98ac0bad20 2023-12-19T05:39:21.877 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.873+0000 7f98ab7fe640 1 -- 172.21.15.120:0/58574803 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c031d20 con 0x7f98ac0bad20 2023-12-19T05:39:21.877 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.874+0000 7f98b317e640 1 -- 172.21.15.120:0/58574803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98ac0bad20 msgr2=0x7f98ac0b4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.877 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.874+0000 7f98b317e640 1 --2- 172.21.15.120:0/58574803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98ac0bad20 0x7f98ac0b4d50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f989c0097a0 tx=0x7f989c02b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.877 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.874+0000 7f98b317e640 1 -- 172.21.15.120:0/58574803 shutdown_connections 2023-12-19T05:39:21.877 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.874+0000 7f98b317e640 1 --2- 172.21.15.120:0/58574803 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98ac142df0 0x7f98ac153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.877 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.874+0000 7f98b317e640 1 --2- 172.21.15.120:0/58574803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98ac0bad20 0x7f98ac0b4d50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.877 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.874+0000 7f98b317e640 1 -- 172.21.15.120:0/58574803 >> 172.21.15.120:0/58574803 conn(0x7f98ac069d00 msgr2=0x7f98ac06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:21.877 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.874+0000 7f98b317e640 1 -- 172.21.15.120:0/58574803 shutdown_connections 2023-12-19T05:39:21.877 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.874+0000 7f98b317e640 1 -- 172.21.15.120:0/58574803 wait complete. 2023-12-19T05:39:21.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.875+0000 7f98b317e640 1 Processor -- start 2023-12-19T05:39:21.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.875+0000 7f98b317e640 1 -- start start 2023-12-19T05:39:21.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98b317e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98ac0bad20 0x7f98ac0b3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98b317e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98ac142980 0x7f98ac143b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98b317e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98ac142df0 0x7f98ac137fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98b317e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac133420 con 0x7f98ac142980 2023-12-19T05:39:21.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98b317e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac145670 con 0x7f98ac0bad20 2023-12-19T05:39:21.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98b317e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac145910 con 0x7f98ac142df0 2023-12-19T05:39:21.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98abfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98ac142980 0x7f98ac143b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98abfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98ac142980 0x7f98ac143b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52576/0 (socket says 172.21.15.120:52576) 2023-12-19T05:39:21.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98abfff640 1 -- 172.21.15.120:0/2443235691 learned_addr learned my addr 172.21.15.120:0/2443235691 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:21.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98b171b640 1 --2- 172.21.15.120:0/2443235691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98ac142df0 0x7f98ac137fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98b0f1a640 1 --2- 172.21.15.120:0/2443235691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98ac0bad20 0x7f98ac0b3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98abfff640 1 -- 172.21.15.120:0/2443235691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98ac142df0 msgr2=0x7f98ac137fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98abfff640 1 --2- 172.21.15.120:0/2443235691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98ac142df0 0x7f98ac137fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98abfff640 1 -- 172.21.15.120:0/2443235691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98ac0bad20 msgr2=0x7f98ac0b3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:21.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98abfff640 1 --2- 172.21.15.120:0/2443235691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98ac0bad20 0x7f98ac0b3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:21.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98abfff640 1 -- 172.21.15.120:0/2443235691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c009400 con 0x7f98ac142980 2023-12-19T05:39:21.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98abfff640 1 --2- 172.21.15.120:0/2443235691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98ac142980 0x7f98ac143b40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f98a000c4d0 tx=0x7f98a000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:21.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98a97fa640 1 -- 172.21.15.120:0/2443235691 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a00074e0 con 0x7f98ac142980 2023-12-19T05:39:21.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98a97fa640 1 -- 172.21.15.120:0/2443235691 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a0007660 con 0x7f98ac142980 2023-12-19T05:39:21.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98b317e640 1 -- 172.21.15.120:0/2443235691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ac145bb0 con 0x7f98ac142980 2023-12-19T05:39:21.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98a97fa640 1 -- 172.21.15.120:0/2443235691 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a0004a20 con 0x7f98ac142980 2023-12-19T05:39:21.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.876+0000 7f98b317e640 1 -- 172.21.15.120:0/2443235691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac146170 con 0x7f98ac142980 2023-12-19T05:39:21.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.877+0000 7f98b317e640 1 -- 172.21.15.120:0/2443235691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ac1dda30 con 0x7f98ac142980 2023-12-19T05:39:21.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.878+0000 7f98a97fa640 1 -- 172.21.15.120:0/2443235691 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f98a0004b80 con 0x7f98ac142980 2023-12-19T05:39:21.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.878+0000 7f98a97fa640 1 --2- 172.21.15.120:0/2443235691 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f989806a430 0x7f989806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:21.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.878+0000 7f98a97fa640 1 -- 172.21.15.120:0/2443235691 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98a0087da0 con 0x7f98ac142980 2023-12-19T05:39:21.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.878+0000 7f98b0f1a640 1 --2- 172.21.15.120:0/2443235691 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f989806a430 0x7f989806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:21.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.878+0000 7f98b0f1a640 1 --2- 172.21.15.120:0/2443235691 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f989806a430 0x7f989806c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f989c036000 tx=0x7f989c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:21.883 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:21.882+0000 7f98a97fa640 1 -- 172.21.15.120:0/2443235691 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f98a0053420 con 0x7f98ac142980 2023-12-19T05:39:22.049 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.048+0000 7f98b317e640 1 -- 172.21.15.120:0/2443235691 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f98ac04e080 con 0x7f98ac142980 2023-12-19T05:39:22.054 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.053+0000 7f98a97fa640 1 -- 172.21.15.120:0/2443235691 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f98a00180c0 con 0x7f98ac142980 2023-12-19T05:39:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.055+0000 7f98b317e640 1 -- 172.21.15.120:0/2443235691 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f989806a430 msgr2=0x7f989806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.055+0000 7f98b317e640 1 --2- 172.21.15.120:0/2443235691 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f989806a430 0x7f989806c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f989c036000 tx=0x7f989c008030 comp rx=0 tx=0).stop 2023-12-19T05:39:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.055+0000 7f98b317e640 1 -- 172.21.15.120:0/2443235691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98ac142980 msgr2=0x7f98ac143b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.055+0000 7f98b317e640 1 --2- 172.21.15.120:0/2443235691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98ac142980 0x7f98ac143b40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f98a000c4d0 tx=0x7f98a000c990 comp rx=0 tx=0).stop 2023-12-19T05:39:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.055+0000 7f98b317e640 1 -- 172.21.15.120:0/2443235691 shutdown_connections 2023-12-19T05:39:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.055+0000 7f98b317e640 1 --2- 172.21.15.120:0/2443235691 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f989806a430 0x7f989806c8f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.055+0000 7f98b317e640 1 --2- 172.21.15.120:0/2443235691 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f98ac142df0 0x7f98ac137fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.055+0000 7f98b317e640 1 --2- 172.21.15.120:0/2443235691 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f98ac142980 0x7f98ac143b40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.055+0000 7f98b317e640 1 --2- 172.21.15.120:0/2443235691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98ac0bad20 0x7f98ac0b3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.055+0000 7f98b317e640 1 -- 172.21.15.120:0/2443235691 >> 172.21.15.120:0/2443235691 conn(0x7f98ac069d00 msgr2=0x7f98ac0ba040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.055+0000 7f98b317e640 1 -- 172.21.15.120:0/2443235691 shutdown_connections 2023-12-19T05:39:22.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.055+0000 7f98b317e640 1 -- 172.21.15.120:0/2443235691 wait complete. 2023-12-19T05:39:22.067 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T05:39:22.067 DEBUG:teuthology.orchestra.run.smithi120:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:39:22.140 DEBUG:teuthology.orchestra.run.smithi155:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:39:22.280 DEBUG:teuthology.orchestra.run.smithi188:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T05:39:22.402 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T05:39:22.402 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:39:22.402 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:22.455 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:39:22.455 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:22.506 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:39:22.506 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:22.555 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:22.656 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.655+0000 7fb803f77640 1 Processor -- start 2023-12-19T05:39:22.656 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.655+0000 7fb803f77640 1 -- start start 2023-12-19T05:39:22.660 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb803f77640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb7fc0b79b0 0x7fb7fc0b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.660 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb803f77640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc14b230 0x7fb7fc14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.660 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb803f77640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7fc0b96b0 con 0x7fb7fc0b8860 2023-12-19T05:39:22.660 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb803f77640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc14ae10 con 0x7fb7fc0b79b0 2023-12-19T05:39:22.660 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb803f77640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0bacc0 con 0x7fb7fc14b230 2023-12-19T05:39:22.660 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb801512640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb7fc0b8860 0x7fb7fc144ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40878/0 (socket says 172.21.15.120:40878) 2023-12-19T05:39:22.660 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb801512640 1 -- 172.21.15.120:0/3577090151 learned_addr learned my addr 172.21.15.120:0/3577090151 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:22.660 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb800d11640 1 -- 172.21.15.120:0/3577090151 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363961779 0 0) 0x7fb7fc0b96b0 con 0x7fb7fc0b8860 2023-12-19T05:39:22.660 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb801d13640 1 --2- 172.21.15.120:0/3577090151 >> v2:172.21.15.155:3300/0 conn(0x7fb7fc0b79b0 0x7fb7fc0b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.660 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb800d11640 1 -- 172.21.15.120:0/3577090151 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e8003520 con 0x7fb7fc0b8860 2023-12-19T05:39:22.660 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb802514640 1 --2- 172.21.15.120:0/3577090151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc14b230 0x7fb7fc14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.660 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb800d11640 1 -- 172.21.15.120:0/3577090151 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3779789415 0 0) 0x7fb7e8003520 con 0x7fb7fc0b8860 2023-12-19T05:39:22.660 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb800d11640 1 -- 172.21.15.120:0/3577090151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc14b230 msgr2=0x7fb7fc14b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:22.661 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb800d11640 1 --2- 172.21.15.120:0/3577090151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc14b230 0x7fb7fc14b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.661 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb800d11640 1 -- 172.21.15.120:0/3577090151 >> v2:172.21.15.155:3300/0 conn(0x7fb7fc0b79b0 msgr2=0x7fb7fc0b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:22.661 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb800d11640 1 --2- 172.21.15.120:0/3577090151 >> v2:172.21.15.155:3300/0 conn(0x7fb7fc0b79b0 0x7fb7fc0b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.661 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb800d11640 1 -- 172.21.15.120:0/3577090151 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0b90f0 con 0x7fb7fc0b8860 2023-12-19T05:39:22.661 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.656+0000 7fb800d11640 1 -- 172.21.15.120:0/3577090151 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7fb7ec001670 con 0x7fb7fc0b8860 2023-12-19T05:39:22.661 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb800d11640 1 -- 172.21.15.120:0/3577090151 >> v1:172.21.15.120:6789/0 conn(0x7fb7fc0b8860 legacy=0x7fb7fc144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.661 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb800d11640 1 --2- 172.21.15.120:0/3577090151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc14b230 0x7fb7e8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.661 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb800d11640 1 --2- 172.21.15.120:0/3577090151 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7e8003ef0 0x7fb7e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.661 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb800d11640 1 --2- 172.21.15.120:0/3577090151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7e8004d00 0x7fb7e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.661 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb800d11640 1 -- 172.21.15.120:0/3577090151 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc14ae10 con 0x7fb7e8003ef0 2023-12-19T05:39:22.661 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb800d11640 1 -- 172.21.15.120:0/3577090151 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e800b980 con 0x7fb7e8004d00 2023-12-19T05:39:22.661 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb800d11640 1 -- 172.21.15.120:0/3577090151 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e800bac0 con 0x7fb7fc14b230 2023-12-19T05:39:22.661 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb801512640 1 --2- 172.21.15.120:0/3577090151 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7e8003ef0 0x7fb7e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.661 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb801d13640 1 --2- 172.21.15.120:0/3577090151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc14b230 0x7fb7e8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.662 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb802514640 1 --2- 172.21.15.120:0/3577090151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7e8004d00 0x7fb7e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.662 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb801512640 1 -- 172.21.15.120:0/3577090151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc14b230 msgr2=0x7fb7e8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:22.662 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb801512640 1 --2- 172.21.15.120:0/3577090151 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc14b230 0x7fb7e8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.662 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb801512640 1 -- 172.21.15.120:0/3577090151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7e8004d00 msgr2=0x7fb7e8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:22.662 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb801512640 1 --2- 172.21.15.120:0/3577090151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7e8004d00 0x7fb7e8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.662 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.657+0000 7fb801512640 1 -- 172.21.15.120:0/3577090151 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e8003520 con 0x7fb7e8003ef0 2023-12-19T05:39:22.662 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.658+0000 7fb801512640 1 --2- 172.21.15.120:0/3577090151 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7e8003ef0 0x7fb7e80047c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00c290 tx=0x7fb7e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66fa724d6ce464c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:22.662 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.658+0000 7fb800d11640 1 -- 172.21.15.120:0/3577090151 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec005ad0 con 0x7fb7e8003ef0 2023-12-19T05:39:22.662 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.658+0000 7fb800d11640 1 -- 172.21.15.120:0/3577090151 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec005c30 con 0x7fb7e8003ef0 2023-12-19T05:39:22.662 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.658+0000 7fb800d11640 1 -- 172.21.15.120:0/3577090151 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec02c8c0 con 0x7fb7e8003ef0 2023-12-19T05:39:22.662 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.658+0000 7fb803f77640 1 -- 172.21.15.120:0/3577090151 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7e8003ef0 msgr2=0x7fb7e80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.662 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.658+0000 7fb803f77640 1 --2- 172.21.15.120:0/3577090151 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7e8003ef0 0x7fb7e80047c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00c290 tx=0x7fb7e80057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.662 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.658+0000 7fb802514640 1 -- 172.21.15.120:0/3577090151 reap_dead start 2023-12-19T05:39:22.662 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.658+0000 7fb803f77640 1 -- 172.21.15.120:0/3577090151 shutdown_connections 2023-12-19T05:39:22.663 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.658+0000 7fb803f77640 1 -- 172.21.15.120:0/3577090151 >> 172.21.15.120:0/3577090151 conn(0x7fb7fc0c0340 msgr2=0x7fb7fc0c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:22.663 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.658+0000 7fb803f77640 1 -- 172.21.15.120:0/3577090151 shutdown_connections 2023-12-19T05:39:22.663 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.658+0000 7fb803f77640 1 -- 172.21.15.120:0/3577090151 wait complete. 2023-12-19T05:39:22.665 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.659+0000 7fb803f77640 1 Processor -- start 2023-12-19T05:39:22.665 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.659+0000 7fb803f77640 1 -- start start 2023-12-19T05:39:22.665 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb803f77640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7e8003ef0 0x7fb7fc1490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.665 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb803f77640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc149620 0x7fb7fc145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.665 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb803f77640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7fc145b40 0x7fb7fc1e2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb803f77640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc147a10 con 0x7fb7fc145b40 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb803f77640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc145ff0 con 0x7fb7e8003ef0 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb803f77640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc147610 con 0x7fb7fc149620 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb802514640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7fc145b40 0x7fb7fc1e2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb802514640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7fc145b40 0x7fb7fc1e2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52594/0 (socket says 172.21.15.120:52594) 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb802514640 1 -- 172.21.15.120:0/3417677914 learned_addr learned my addr 172.21.15.120:0/3417677914 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb801512640 1 --2- 172.21.15.120:0/3417677914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc149620 0x7fb7fc145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb801d13640 1 --2- 172.21.15.120:0/3417677914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7e8003ef0 0x7fb7fc1490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb802514640 1 -- 172.21.15.120:0/3417677914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc149620 msgr2=0x7fb7fc145600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb802514640 1 --2- 172.21.15.120:0/3417677914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc149620 0x7fb7fc145600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb802514640 1 -- 172.21.15.120:0/3417677914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7e8003ef0 msgr2=0x7fb7fc1490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb802514640 1 --2- 172.21.15.120:0/3417677914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7e8003ef0 0x7fb7fc1490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb802514640 1 -- 172.21.15.120:0/3417677914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0b3ab0 con 0x7fb7fc145b40 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.660+0000 7fb802514640 1 --2- 172.21.15.120:0/3417677914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7fc145b40 0x7fb7fc1e2db0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc067290 tx=0x7fb7f400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:22.666 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.661+0000 7fb7f27fc640 1 -- 172.21.15.120:0/3417677914 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f400e040 con 0x7fb7fc145b40 2023-12-19T05:39:22.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.661+0000 7fb7f27fc640 1 -- 172.21.15.120:0/3417677914 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f400f040 con 0x7fb7fc145b40 2023-12-19T05:39:22.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.661+0000 7fb803f77640 1 -- 172.21.15.120:0/3417677914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc146ce0 con 0x7fb7fc145b40 2023-12-19T05:39:22.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.661+0000 7fb7f27fc640 1 -- 172.21.15.120:0/3417677914 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4015430 con 0x7fb7fc145b40 2023-12-19T05:39:22.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.661+0000 7fb803f77640 1 -- 172.21.15.120:0/3417677914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc1472a0 con 0x7fb7fc145b40 2023-12-19T05:39:22.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.662+0000 7fb803f77640 1 -- 172.21.15.120:0/3417677914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7fc066d30 con 0x7fb7fc145b40 2023-12-19T05:39:22.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.662+0000 7fb7f27fc640 1 -- 172.21.15.120:0/3417677914 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb7f4015590 con 0x7fb7fc145b40 2023-12-19T05:39:22.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.662+0000 7fb7f27fc640 1 --2- 172.21.15.120:0/3417677914 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb7e006a460 0x7fb7e006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.663+0000 7fb801d13640 1 --2- 172.21.15.120:0/3417677914 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb7e006a460 0x7fb7e006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.663+0000 7fb7f27fc640 1 -- 172.21.15.120:0/3417677914 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7f4089270 con 0x7fb7fc145b40 2023-12-19T05:39:22.667 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.663+0000 7fb801d13640 1 --2- 172.21.15.120:0/3417677914 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb7e006a460 0x7fb7e006c920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009b00 tx=0x7fb7f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:22.668 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.667+0000 7fb7f27fc640 1 -- 172.21.15.120:0/3417677914 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb7f40548f0 con 0x7fb7fc145b40 2023-12-19T05:39:22.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.835+0000 7fb803f77640 1 -- 172.21.15.120:0/3417677914 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7fc04e080 con 0x7fb7fc145b40 2023-12-19T05:39:22.837 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.836+0000 7fb7f27fc640 1 -- 172.21.15.120:0/3417677914 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fb7f4057f10 con 0x7fb7fc145b40 2023-12-19T05:39:22.837 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:22.838 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:22.840 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.838+0000 7fb803f77640 1 -- 172.21.15.120:0/3417677914 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb7e006a460 msgr2=0x7fb7e006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.840 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.838+0000 7fb803f77640 1 --2- 172.21.15.120:0/3417677914 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb7e006a460 0x7fb7e006c920 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009b00 tx=0x7fb7f8008040 comp rx=0 tx=0).stop 2023-12-19T05:39:22.840 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.838+0000 7fb803f77640 1 -- 172.21.15.120:0/3417677914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7fc145b40 msgr2=0x7fb7fc1e2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.840 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.838+0000 7fb803f77640 1 --2- 172.21.15.120:0/3417677914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7fc145b40 0x7fb7fc1e2db0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc067290 tx=0x7fb7f400f580 comp rx=0 tx=0).stop 2023-12-19T05:39:22.840 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.838+0000 7fb803f77640 1 -- 172.21.15.120:0/3417677914 shutdown_connections 2023-12-19T05:39:22.840 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.838+0000 7fb803f77640 1 --2- 172.21.15.120:0/3417677914 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb7e006a460 0x7fb7e006c920 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.840 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.838+0000 7fb803f77640 1 --2- 172.21.15.120:0/3417677914 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7fc145b40 0x7fb7fc1e2db0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.840 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.838+0000 7fb803f77640 1 --2- 172.21.15.120:0/3417677914 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7fc149620 0x7fb7fc145600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.840 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.838+0000 7fb803f77640 1 --2- 172.21.15.120:0/3417677914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7e8003ef0 0x7fb7fc1490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.840 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.838+0000 7fb803f77640 1 -- 172.21.15.120:0/3417677914 >> 172.21.15.120:0/3417677914 conn(0x7fb7fc0c0340 msgr2=0x7fb7fc0bfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:22.840 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.838+0000 7fb803f77640 1 -- 172.21.15.120:0/3417677914 shutdown_connections 2023-12-19T05:39:22.840 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.838+0000 7fb803f77640 1 -- 172.21.15.120:0/3417677914 wait complete. 2023-12-19T05:39:22.850 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:45.976868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:38:56.035188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:38:57.050130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:22.851 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.951+0000 7fa5b70e7640 1 Processor -- start 2023-12-19T05:39:22.952 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.951+0000 7fa5b70e7640 1 -- start start 2023-12-19T05:39:22.954 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5b70e7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b0144d70 0x7fa5b00b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.954 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5b70e7640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa5b014df70 0x7fa5b00b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.954 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5b70e7640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa5b00bc7e0 0x7fa5b00bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.954 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5b70e7640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b00b9f00 con 0x7fa5b014df70 2023-12-19T05:39:22.954 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5b70e7640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b00b84b0 con 0x7fa5b00bc7e0 2023-12-19T05:39:22.954 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5b70e7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b0145150 con 0x7fa5b0144d70 2023-12-19T05:39:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5a7fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa5b014df70 0x7fa5b00b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5a7fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa5b014df70 0x7fa5b00b8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52610/0 (socket says 172.21.15.120:52610) 2023-12-19T05:39:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5a7fff640 1 -- 172.21.15.120:0/905883756 learned_addr learned my addr 172.21.15.120:0/905883756 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5b5684640 1 --2- 172.21.15.120:0/905883756 >> v2:172.21.15.155:3300/0 conn(0x7fa5b00bc7e0 0x7fa5b00bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5b4e83640 1 --2- 172.21.15.120:0/905883756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b0144d70 0x7fa5b00b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5a7fff640 1 -- 172.21.15.120:0/905883756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b0144d70 msgr2=0x7fa5b00b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5a7fff640 1 --2- 172.21.15.120:0/905883756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b0144d70 0x7fa5b00b7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5a7fff640 1 -- 172.21.15.120:0/905883756 >> v2:172.21.15.155:3300/0 conn(0x7fa5b00bc7e0 msgr2=0x7fa5b00bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5a7fff640 1 --2- 172.21.15.120:0/905883756 >> v2:172.21.15.155:3300/0 conn(0x7fa5b00bc7e0 0x7fa5b00bcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5a7fff640 1 -- 172.21.15.120:0/905883756 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b00b9080 con 0x7fa5b014df70 2023-12-19T05:39:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.952+0000 7fa5b5684640 1 --2- 172.21.15.120:0/905883756 >> v2:172.21.15.155:3300/0 conn(0x7fa5b00bc7e0 0x7fa5b00bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.953+0000 7fa5a7fff640 1 --2- 172.21.15.120:0/905883756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5b014df70 0x7fa5b00b8860 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00b6b90 tx=0x7fa5a002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb5e7d2ec39d25f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.953+0000 7fa5a77fe640 1 -- 172.21.15.120:0/905883756 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0030840 con 0x7fa5b014df70 2023-12-19T05:39:22.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.953+0000 7fa5a77fe640 1 -- 172.21.15.120:0/905883756 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a00309a0 con 0x7fa5b014df70 2023-12-19T05:39:22.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.953+0000 7fa5a77fe640 1 -- 172.21.15.120:0/905883756 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a0030d30 con 0x7fa5b014df70 2023-12-19T05:39:22.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.953+0000 7fa5b70e7640 1 -- 172.21.15.120:0/905883756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5b014df70 msgr2=0x7fa5b00b8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.953+0000 7fa5b70e7640 1 --2- 172.21.15.120:0/905883756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5b014df70 0x7fa5b00b8860 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00b6b90 tx=0x7fa5a002b980 comp rx=0 tx=0).stop 2023-12-19T05:39:22.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.953+0000 7fa5b70e7640 1 -- 172.21.15.120:0/905883756 shutdown_connections 2023-12-19T05:39:22.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.953+0000 7fa5b70e7640 1 --2- 172.21.15.120:0/905883756 >> v2:172.21.15.155:3300/0 conn(0x7fa5b00bc7e0 0x7fa5b00bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.953+0000 7fa5b70e7640 1 --2- 172.21.15.120:0/905883756 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5b014df70 0x7fa5b00b8860 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.953+0000 7fa5b70e7640 1 --2- 172.21.15.120:0/905883756 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b0144d70 0x7fa5b00b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.953+0000 7fa5b70e7640 1 -- 172.21.15.120:0/905883756 >> 172.21.15.120:0/905883756 conn(0x7fa5b0071430 msgr2=0x7fa5b0071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:22.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.953+0000 7fa5b70e7640 1 -- 172.21.15.120:0/905883756 shutdown_connections 2023-12-19T05:39:22.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.954+0000 7fa5b70e7640 1 -- 172.21.15.120:0/905883756 wait complete. 2023-12-19T05:39:22.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.954+0000 7fa5b70e7640 1 Processor -- start 2023-12-19T05:39:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.955+0000 7fa5b70e7640 1 -- start start 2023-12-19T05:39:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.955+0000 7fa5b70e7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b00bc7e0 0x7fa5b0145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.955+0000 7fa5b70e7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b0144d70 0x7fa5b00b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.955+0000 7fa5b70e7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5b014df70 0x7fa5b0147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.955+0000 7fa5b70e7640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b01475f0 con 0x7fa5b014df70 2023-12-19T05:39:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.955+0000 7fa5b70e7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b00b1c50 con 0x7fa5b0144d70 2023-12-19T05:39:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.955+0000 7fa5b70e7640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b0148310 con 0x7fa5b00bc7e0 2023-12-19T05:39:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.955+0000 7fa5b5684640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5b014df70 0x7fa5b0147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.955+0000 7fa5b5684640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5b014df70 0x7fa5b0147dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52612/0 (socket says 172.21.15.120:52612) 2023-12-19T05:39:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.955+0000 7fa5b5684640 1 -- 172.21.15.120:0/3271001924 learned_addr learned my addr 172.21.15.120:0/3271001924 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.956+0000 7fa5b5684640 1 -- 172.21.15.120:0/3271001924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b00bc7e0 msgr2=0x7fa5b0145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.956+0000 7fa5b4e83640 1 --2- 172.21.15.120:0/3271001924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b00bc7e0 0x7fa5b0145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.956+0000 7fa5a7fff640 1 --2- 172.21.15.120:0/3271001924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b0144d70 0x7fa5b00b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.956+0000 7fa5b5684640 1 --2- 172.21.15.120:0/3271001924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b00bc7e0 0x7fa5b0145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.956+0000 7fa5b5684640 1 -- 172.21.15.120:0/3271001924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b0144d70 msgr2=0x7fa5b00b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:22.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.956+0000 7fa5b5684640 1 --2- 172.21.15.120:0/3271001924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b0144d70 0x7fa5b00b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:22.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.956+0000 7fa5b5684640 1 -- 172.21.15.120:0/3271001924 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a00094d0 con 0x7fa5b014df70 2023-12-19T05:39:22.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.956+0000 7fa5b5684640 1 --2- 172.21.15.120:0/3271001924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5b014df70 0x7fa5b0147dd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8007e10 tx=0x7fa5a800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:22.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.956+0000 7fa5a57fa640 1 -- 172.21.15.120:0/3271001924 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8003b90 con 0x7fa5b014df70 2023-12-19T05:39:22.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.956+0000 7fa5a57fa640 1 -- 172.21.15.120:0/3271001924 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a800f040 con 0x7fa5b014df70 2023-12-19T05:39:22.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.956+0000 7fa5b70e7640 1 -- 172.21.15.120:0/3271001924 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b0145930 con 0x7fa5b014df70 2023-12-19T05:39:22.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.956+0000 7fa5a57fa640 1 -- 172.21.15.120:0/3271001924 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a800de80 con 0x7fa5b014df70 2023-12-19T05:39:22.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.956+0000 7fa5b70e7640 1 -- 172.21.15.120:0/3271001924 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b0145ef0 con 0x7fa5b014df70 2023-12-19T05:39:22.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.957+0000 7fa5b70e7640 1 -- 172.21.15.120:0/3271001924 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b014a3f0 con 0x7fa5b014df70 2023-12-19T05:39:22.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.957+0000 7fa5a57fa640 1 -- 172.21.15.120:0/3271001924 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa5a8004030 con 0x7fa5b014df70 2023-12-19T05:39:22.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.958+0000 7fa5a57fa640 1 --2- 172.21.15.120:0/3271001924 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa59c06a430 0x7fa59c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:22.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.958+0000 7fa5a57fa640 1 -- 172.21.15.120:0/3271001924 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5a8088be0 con 0x7fa5b014df70 2023-12-19T05:39:22.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.958+0000 7fa5b4e83640 1 --2- 172.21.15.120:0/3271001924 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa59c06a430 0x7fa59c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:22.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.958+0000 7fa5b4e83640 1 --2- 172.21.15.120:0/3271001924 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa59c06a430 0x7fa59c06c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac006fd0 tx=0x7fa5ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:22.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:22.962+0000 7fa5a57fa640 1 -- 172.21.15.120:0/3271001924 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa5b014a3f0 con 0x7fa5b014df70 2023-12-19T05:39:23.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.128+0000 7fa5b70e7640 1 -- 172.21.15.120:0/3271001924 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5b014a3f0 con 0x7fa5b014df70 2023-12-19T05:39:23.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.128+0000 7fa5a57fa640 1 -- 172.21.15.120:0/3271001924 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5b014a3f0 con 0x7fa5b014df70 2023-12-19T05:39:23.130 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2023-12-19T05:39:23.131 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.130+0000 7fa5b70e7640 1 -- 172.21.15.120:0/3271001924 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa59c06a430 msgr2=0x7fa59c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.130+0000 7fa5b70e7640 1 --2- 172.21.15.120:0/3271001924 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa59c06a430 0x7fa59c06c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac006fd0 tx=0x7fa5ac008040 comp rx=0 tx=0).stop 2023-12-19T05:39:23.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.130+0000 7fa5b70e7640 1 -- 172.21.15.120:0/3271001924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5b014df70 msgr2=0x7fa5b0147dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.130+0000 7fa5b70e7640 1 --2- 172.21.15.120:0/3271001924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5b014df70 0x7fa5b0147dd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8007e10 tx=0x7fa5a800d4a0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.130+0000 7fa5b70e7640 1 -- 172.21.15.120:0/3271001924 shutdown_connections 2023-12-19T05:39:23.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.130+0000 7fa5b70e7640 1 --2- 172.21.15.120:0/3271001924 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa59c06a430 0x7fa59c06c8f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.130+0000 7fa5b70e7640 1 --2- 172.21.15.120:0/3271001924 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa5b014df70 0x7fa5b0147dd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.130+0000 7fa5b70e7640 1 --2- 172.21.15.120:0/3271001924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa5b0144d70 0x7fa5b00b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.130+0000 7fa5b70e7640 1 --2- 172.21.15.120:0/3271001924 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa5b00bc7e0 0x7fa5b0145330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.130+0000 7fa5b70e7640 1 -- 172.21.15.120:0/3271001924 >> 172.21.15.120:0/3271001924 conn(0x7fa5b0071430 msgr2=0x7fa5b014bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:23.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.130+0000 7fa5b70e7640 1 -- 172.21.15.120:0/3271001924 shutdown_connections 2023-12-19T05:39:23.132 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.130+0000 7fa5b70e7640 1 -- 172.21.15.120:0/3271001924 wait complete. 2023-12-19T05:39:23.142 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:23.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.242+0000 7f0f71718640 1 Processor -- start 2023-12-19T05:39:23.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.242+0000 7f0f71718640 1 -- start start 2023-12-19T05:39:23.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.243+0000 7f0f71718640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f6c0712b0 0x7f0f6c06a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.243+0000 7f0f71718640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0f6c06a620 0x7f0f6c1553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.243+0000 7f0f71718640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6c06ba10 con 0x7f0f6c069d00 2023-12-19T05:39:23.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.243+0000 7f0f71718640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c145270 con 0x7f0f6c06a620 2023-12-19T05:39:23.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.243+0000 7f0f71718640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0b41f0 con 0x7f0f6c0712b0 2023-12-19T05:39:23.246 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.243+0000 7f0f6b7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0f6c06a620 0x7f0f6c1553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.246 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.243+0000 7f0f6affd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f0f6c069d00 0x7f0f6c14aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40884/0 (socket says 172.21.15.120:40884) 2023-12-19T05:39:23.246 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.243+0000 7f0f6affd640 1 -- 172.21.15.120:0/1077668205 learned_addr learned my addr 172.21.15.120:0/1077668205 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:23.246 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.243+0000 7f0f6a7fc640 1 --2- 172.21.15.120:0/1077668205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f6c0712b0 0x7f0f6c06a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.246 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.243+0000 7f0f6b7fe640 1 -- 172.21.15.120:0/1077668205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f6c0712b0 msgr2=0x7f0f6c06a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:23.246 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.243+0000 7f0f6b7fe640 1 --2- 172.21.15.120:0/1077668205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f6c0712b0 0x7f0f6c06a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.246 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.243+0000 7f0f6b7fe640 1 -- 172.21.15.120:0/1077668205 >> v1:172.21.15.120:6789/0 conn(0x7f0f6c069d00 legacy=0x7f0f6c14aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.246 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.243+0000 7f0f6b7fe640 1 -- 172.21.15.120:0/1077668205 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c070e20 con 0x7f0f6c06a620 2023-12-19T05:39:23.246 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.243+0000 7f0f69ffb640 1 -- 172.21.15.120:0/1077668205 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034964610 0 0) 0x7f0f6c06ba10 con 0x7f0f6c069d00 2023-12-19T05:39:23.246 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.244+0000 7f0f6b7fe640 1 --2- 172.21.15.120:0/1077668205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f6c06a620 0x7f0f6c1553e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009800 tx=0x7f0f6402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3c0a4ea0a48b40 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.246 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.244+0000 7f0f69ffb640 1 -- 172.21.15.120:0/1077668205 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64031800 con 0x7f0f6c06a620 2023-12-19T05:39:23.246 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.244+0000 7f0f69ffb640 1 -- 172.21.15.120:0/1077668205 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f64031960 con 0x7f0f6c06a620 2023-12-19T05:39:23.246 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.244+0000 7f0f69ffb640 1 -- 172.21.15.120:0/1077668205 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64031cf0 con 0x7f0f6c06a620 2023-12-19T05:39:23.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.245+0000 7f0f71718640 1 -- 172.21.15.120:0/1077668205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f6c06a620 msgr2=0x7f0f6c1553e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.245+0000 7f0f71718640 1 --2- 172.21.15.120:0/1077668205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f6c06a620 0x7f0f6c1553e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0f64009800 tx=0x7f0f6402b8a0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.245+0000 7f0f71718640 1 -- 172.21.15.120:0/1077668205 shutdown_connections 2023-12-19T05:39:23.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.245+0000 7f0f71718640 1 --2- 172.21.15.120:0/1077668205 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f6c06a620 0x7f0f6c1553e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.245+0000 7f0f71718640 1 --2- 172.21.15.120:0/1077668205 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f6c0712b0 0x7f0f6c06a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.245+0000 7f0f71718640 1 -- 172.21.15.120:0/1077668205 >> 172.21.15.120:0/1077668205 conn(0x7f0f6c0bd070 msgr2=0x7f0f6c0bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:23.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.245+0000 7f0f71718640 1 -- 172.21.15.120:0/1077668205 shutdown_connections 2023-12-19T05:39:23.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.245+0000 7f0f71718640 1 -- 172.21.15.120:0/1077668205 wait complete. 2023-12-19T05:39:23.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.246+0000 7f0f71718640 1 Processor -- start 2023-12-19T05:39:23.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.246+0000 7f0f71718640 1 -- start start 2023-12-19T05:39:23.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f71718640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f6c069d00 0x7f0f6c0b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f71718640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f6c0712b0 0x7f0f6c14dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f71718640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f6c14bf50 0x7f0f6c14c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f71718640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c14e220 con 0x7f0f6c14bf50 2023-12-19T05:39:23.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f71718640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c148000 con 0x7f0f6c0712b0 2023-12-19T05:39:23.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f71718640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c1df800 con 0x7f0f6c069d00 2023-12-19T05:39:23.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f6b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f6c14bf50 0x7f0f6c14c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f6b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f6c14bf50 0x7f0f6c14c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52642/0 (socket says 172.21.15.120:52642) 2023-12-19T05:39:23.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f6b7fe640 1 -- 172.21.15.120:0/3751992114 learned_addr learned my addr 172.21.15.120:0/3751992114 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:23.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f6affd640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f6c069d00 0x7f0f6c0b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f6a7fc640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f6c0712b0 0x7f0f6c14dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f6b7fe640 1 -- 172.21.15.120:0/3751992114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f6c069d00 msgr2=0x7f0f6c0b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f6b7fe640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f6c069d00 0x7f0f6c0b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f6b7fe640 1 -- 172.21.15.120:0/3751992114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f6c0712b0 msgr2=0x7f0f6c14dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f6b7fe640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f6c0712b0 0x7f0f6c14dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f6b7fe640 1 -- 172.21.15.120:0/3751992114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f64009400 con 0x7f0f6c14bf50 2023-12-19T05:39:23.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f6a7fc640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f6c0712b0 0x7f0f6c14dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:23.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f6b7fe640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f6c14bf50 0x7f0f6c14c970 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0f6402beb0 tx=0x7f0f640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f537fe640 1 -- 172.21.15.120:0/3751992114 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6403bcb0 con 0x7f0f6c14bf50 2023-12-19T05:39:23.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f537fe640 1 -- 172.21.15.120:0/3751992114 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6403be30 con 0x7f0f6c14bf50 2023-12-19T05:39:23.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f71718640 1 -- 172.21.15.120:0/3751992114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c1dfa50 con 0x7f0f6c14bf50 2023-12-19T05:39:23.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f537fe640 1 -- 172.21.15.120:0/3751992114 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64045630 con 0x7f0f6c14bf50 2023-12-19T05:39:23.251 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.247+0000 7f0f71718640 1 -- 172.21.15.120:0/3751992114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c1e0010 con 0x7f0f6c14bf50 2023-12-19T05:39:23.252 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.248+0000 7f0f71718640 1 -- 172.21.15.120:0/3751992114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c1e0200 con 0x7f0f6c14bf50 2023-12-19T05:39:23.252 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.249+0000 7f0f537fe640 1 -- 172.21.15.120:0/3751992114 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f64045790 con 0x7f0f6c14bf50 2023-12-19T05:39:23.252 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.249+0000 7f0f537fe640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f0f5806a430 0x7f0f5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.252 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.249+0000 7f0f6affd640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f0f5806a430 0x7f0f5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.252 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.249+0000 7f0f537fe640 1 -- 172.21.15.120:0/3751992114 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f6402e070 con 0x7f0f6c14bf50 2023-12-19T05:39:23.253 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.250+0000 7f0f6affd640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f0f5806a430 0x7f0f5806c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0012e0 tx=0x7f0f5c001630 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.254 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.253+0000 7f0f537fe640 1 -- 172.21.15.120:0/3751992114 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0f640764f0 con 0x7f0f6c14bf50 2023-12-19T05:39:23.419 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.418+0000 7f0f71718640 1 -- 172.21.15.120:0/3751992114 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f6c04e080 con 0x7f0f6c14bf50 2023-12-19T05:39:23.420 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.419+0000 7f0f537fe640 1 -- 172.21.15.120:0/3751992114 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f640350a0 con 0x7f0f6c14bf50 2023-12-19T05:39:23.420 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2023-12-19T05:39:23.422 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.420+0000 7f0f71718640 1 -- 172.21.15.120:0/3751992114 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f0f5806a430 msgr2=0x7f0f5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.422 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.420+0000 7f0f71718640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f0f5806a430 0x7f0f5806c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0012e0 tx=0x7f0f5c001630 comp rx=0 tx=0).stop 2023-12-19T05:39:23.422 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.420+0000 7f0f71718640 1 -- 172.21.15.120:0/3751992114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f6c14bf50 msgr2=0x7f0f6c14c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.422 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.420+0000 7f0f71718640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f6c14bf50 0x7f0f6c14c970 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0f6402beb0 tx=0x7f0f640046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.422 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.420+0000 7f0f71718640 1 -- 172.21.15.120:0/3751992114 shutdown_connections 2023-12-19T05:39:23.422 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.420+0000 7f0f71718640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f0f5806a430 0x7f0f5806c8f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.422 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.420+0000 7f0f71718640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0f6c14bf50 0x7f0f6c14c970 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.422 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.420+0000 7f0f71718640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f6c0712b0 0x7f0f6c14dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.422 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.420+0000 7f0f71718640 1 --2- 172.21.15.120:0/3751992114 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0f6c069d00 0x7f0f6c0b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.422 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.420+0000 7f0f71718640 1 -- 172.21.15.120:0/3751992114 >> 172.21.15.120:0/3751992114 conn(0x7f0f6c0bd070 msgr2=0x7f0f6c0ba3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:23.422 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.420+0000 7f0f71718640 1 -- 172.21.15.120:0/3751992114 shutdown_connections 2023-12-19T05:39:23.422 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.420+0000 7f0f71718640 1 -- 172.21.15.120:0/3751992114 wait complete. 2023-12-19T05:39:23.432 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:23.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.532+0000 7fb7c7381640 1 Processor -- start 2023-12-19T05:39:23.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.533+0000 7fb7c7381640 1 -- start start 2023-12-19T05:39:23.535 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.533+0000 7fb7c7381640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb7c0070f50 0x7fb7c014e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.535 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.533+0000 7fb7c7381640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb7c00ba0d0 0x7fb7c014e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.535 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.533+0000 7fb7c7381640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c0071e30 con 0x7fb7c0071330 2023-12-19T05:39:23.535 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.533+0000 7fb7c7381640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c006bbf0 con 0x7fb7c0070f50 2023-12-19T05:39:23.535 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.533+0000 7fb7c7381640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c006af40 con 0x7fb7c00ba0d0 2023-12-19T05:39:23.535 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.534+0000 7fb7c511d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb7c0070f50 0x7fb7c014e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.536 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.534+0000 7fb7c591e640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb7c0071330 0x7fb7c014ab10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40888/0 (socket says 172.21.15.120:40888) 2023-12-19T05:39:23.536 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.534+0000 7fb7c591e640 1 -- 172.21.15.120:0/3229990226 learned_addr learned my addr 172.21.15.120:0/3229990226 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:23.536 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.534+0000 7fb7c491c640 1 --2- 172.21.15.120:0/3229990226 >> v2:172.21.15.155:3300/0 conn(0x7fb7c00ba0d0 0x7fb7c014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.536 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.534+0000 7fb7c511d640 1 -- 172.21.15.120:0/3229990226 >> v2:172.21.15.155:3300/0 conn(0x7fb7c00ba0d0 msgr2=0x7fb7c014e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:23.536 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.534+0000 7fb7c511d640 1 --2- 172.21.15.120:0/3229990226 >> v2:172.21.15.155:3300/0 conn(0x7fb7c00ba0d0 0x7fb7c014e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.536 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.534+0000 7fb7c511d640 1 -- 172.21.15.120:0/3229990226 >> v1:172.21.15.120:6789/0 conn(0x7fb7c0071330 legacy=0x7fb7c014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.536 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.534+0000 7fb7c511d640 1 -- 172.21.15.120:0/3229990226 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c006b220 con 0x7fb7c0070f50 2023-12-19T05:39:23.536 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.534+0000 7fb7b3fff640 1 -- 172.21.15.120:0/3229990226 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70414791 0 0) 0x7fb7c0071e30 con 0x7fb7c0071330 2023-12-19T05:39:23.537 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.535+0000 7fb7c511d640 1 --2- 172.21.15.120:0/3229990226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c0070f50 0x7fb7c014e110 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb7c004e7c0 tx=0x7fb7b402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1022e5568572641 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.535+0000 7fb7b3fff640 1 -- 172.21.15.120:0/3229990226 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b402e070 con 0x7fb7c0070f50 2023-12-19T05:39:23.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.535+0000 7fb7b3fff640 1 -- 172.21.15.120:0/3229990226 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b40315a0 con 0x7fb7c0070f50 2023-12-19T05:39:23.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.535+0000 7fb7b3fff640 1 -- 172.21.15.120:0/3229990226 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4031930 con 0x7fb7c0070f50 2023-12-19T05:39:23.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.535+0000 7fb7c7381640 1 -- 172.21.15.120:0/3229990226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c0070f50 msgr2=0x7fb7c014e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.535+0000 7fb7c7381640 1 --2- 172.21.15.120:0/3229990226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c0070f50 0x7fb7c014e110 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb7c004e7c0 tx=0x7fb7b402b840 comp rx=0 tx=0).stop 2023-12-19T05:39:23.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.535+0000 7fb7c7381640 1 -- 172.21.15.120:0/3229990226 shutdown_connections 2023-12-19T05:39:23.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.535+0000 7fb7c7381640 1 --2- 172.21.15.120:0/3229990226 >> v2:172.21.15.155:3300/0 conn(0x7fb7c00ba0d0 0x7fb7c014e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.535+0000 7fb7c7381640 1 --2- 172.21.15.120:0/3229990226 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c0070f50 0x7fb7c014e110 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.535+0000 7fb7c7381640 1 -- 172.21.15.120:0/3229990226 >> 172.21.15.120:0/3229990226 conn(0x7fb7c00be180 msgr2=0x7fb7c00be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:23.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.535+0000 7fb7c7381640 1 -- 172.21.15.120:0/3229990226 shutdown_connections 2023-12-19T05:39:23.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.535+0000 7fb7c7381640 1 -- 172.21.15.120:0/3229990226 wait complete. 2023-12-19T05:39:23.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.536+0000 7fb7c7381640 1 Processor -- start 2023-12-19T05:39:23.538 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.536+0000 7fb7c7381640 1 -- start start 2023-12-19T05:39:23.540 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c7381640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c0070f50 0x7fb7c014adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c7381640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7c0071330 0x7fb7c01e0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c7381640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c00ba0d0 0x7fb7c0145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c7381640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c014b850 con 0x7fb7c0070f50 2023-12-19T05:39:23.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c7381640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c01e0200 con 0x7fb7c00ba0d0 2023-12-19T05:39:23.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c7381640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c014b300 con 0x7fb7c0071330 2023-12-19T05:39:23.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c511d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c0070f50 0x7fb7c014adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c511d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c0070f50 0x7fb7c014adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52660/0 (socket says 172.21.15.120:52660) 2023-12-19T05:39:23.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c511d640 1 -- 172.21.15.120:0/2441092396 learned_addr learned my addr 172.21.15.120:0/2441092396 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:23.541 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c511d640 1 -- 172.21.15.120:0/2441092396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7c0071330 msgr2=0x7fb7c01e0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c511d640 1 --2- 172.21.15.120:0/2441092396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7c0071330 0x7fb7c01e0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c511d640 1 -- 172.21.15.120:0/2441092396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c00ba0d0 msgr2=0x7fb7c0145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c511d640 1 --2- 172.21.15.120:0/2441092396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c00ba0d0 0x7fb7c0145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c511d640 1 -- 172.21.15.120:0/2441092396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b4009400 con 0x7fb7c0070f50 2023-12-19T05:39:23.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.537+0000 7fb7c511d640 1 --2- 172.21.15.120:0/2441092396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c0070f50 0x7fb7c014adc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4034040 tx=0x7fb7b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.538+0000 7fb7b1ffb640 1 -- 172.21.15.120:0/2441092396 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4004230 con 0x7fb7c0070f50 2023-12-19T05:39:23.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.538+0000 7fb7b1ffb640 1 -- 172.21.15.120:0/2441092396 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b4031f00 con 0x7fb7c0070f50 2023-12-19T05:39:23.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.538+0000 7fb7c7381640 1 -- 172.21.15.120:0/2441092396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c01e1130 con 0x7fb7c0070f50 2023-12-19T05:39:23.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.538+0000 7fb7b1ffb640 1 -- 172.21.15.120:0/2441092396 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4032640 con 0x7fb7c0070f50 2023-12-19T05:39:23.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.538+0000 7fb7c7381640 1 -- 172.21.15.120:0/2441092396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c01e03f0 con 0x7fb7c0070f50 2023-12-19T05:39:23.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.539+0000 7fb7c7381640 1 -- 172.21.15.120:0/2441092396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c004e080 con 0x7fb7c0070f50 2023-12-19T05:39:23.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.539+0000 7fb7b1ffb640 1 -- 172.21.15.120:0/2441092396 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb7b40327a0 con 0x7fb7c0070f50 2023-12-19T05:39:23.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.540+0000 7fb7b1ffb640 1 --2- 172.21.15.120:0/2441092396 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb7a406a460 0x7fb7a406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.542 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.540+0000 7fb7b1ffb640 1 -- 172.21.15.120:0/2441092396 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7b40aa840 con 0x7fb7c0070f50 2023-12-19T05:39:23.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.540+0000 7fb7c491c640 1 --2- 172.21.15.120:0/2441092396 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb7a406a460 0x7fb7a406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.543 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.540+0000 7fb7c491c640 1 --2- 172.21.15.120:0/2441092396 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb7a406a460 0x7fb7a406c920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0141f70 tx=0x7fb7bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.545 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.544+0000 7fb7b1ffb640 1 -- 172.21.15.120:0/2441092396 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb7b4075ec0 con 0x7fb7c0070f50 2023-12-19T05:39:23.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.711+0000 7fb7c7381640 1 -- 172.21.15.120:0/2441092396 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7c006c570 con 0x7fb7c0070f50 2023-12-19T05:39:23.712 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.711+0000 7fb7b1ffb640 1 -- 172.21.15.120:0/2441092396 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7b40794e0 con 0x7fb7c0070f50 2023-12-19T05:39:23.713 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2023-12-19T05:39:23.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.713+0000 7fb7c7381640 1 -- 172.21.15.120:0/2441092396 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb7a406a460 msgr2=0x7fb7a406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.713+0000 7fb7c7381640 1 --2- 172.21.15.120:0/2441092396 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb7a406a460 0x7fb7a406c920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0141f70 tx=0x7fb7bc008040 comp rx=0 tx=0).stop 2023-12-19T05:39:23.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.713+0000 7fb7c7381640 1 -- 172.21.15.120:0/2441092396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c0070f50 msgr2=0x7fb7c014adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.713+0000 7fb7c7381640 1 --2- 172.21.15.120:0/2441092396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c0070f50 0x7fb7c014adc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4034040 tx=0x7fb7b40046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.713+0000 7fb7c7381640 1 -- 172.21.15.120:0/2441092396 shutdown_connections 2023-12-19T05:39:23.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.713+0000 7fb7c7381640 1 --2- 172.21.15.120:0/2441092396 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb7a406a460 0x7fb7a406c920 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.713+0000 7fb7c7381640 1 --2- 172.21.15.120:0/2441092396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7c00ba0d0 0x7fb7c0145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.713+0000 7fb7c7381640 1 --2- 172.21.15.120:0/2441092396 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb7c0071330 0x7fb7c01e0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.713+0000 7fb7c7381640 1 --2- 172.21.15.120:0/2441092396 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb7c0070f50 0x7fb7c014adc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.713+0000 7fb7c7381640 1 -- 172.21.15.120:0/2441092396 >> 172.21.15.120:0/2441092396 conn(0x7fb7c00be180 msgr2=0x7fb7c014be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:23.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.713+0000 7fb7c7381640 1 -- 172.21.15.120:0/2441092396 shutdown_connections 2023-12-19T05:39:23.715 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.713+0000 7fb7c7381640 1 -- 172.21.15.120:0/2441092396 wait complete. 2023-12-19T05:39:23.726 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T05:39:23.826 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.824+0000 7f6963edf640 1 Processor -- start 2023-12-19T05:39:23.826 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.824+0000 7f6963edf640 1 -- start start 2023-12-19T05:39:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.825+0000 7f6963edf640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f695c0b4790 0x7f695c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.825+0000 7f6963edf640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f695c14ab90 0x7f695c1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.825+0000 7f6963edf640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695c14b020 con 0x7f695c06ca80 2023-12-19T05:39:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.825+0000 7f6963edf640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695c0b4b70 con 0x7f695c14ab90 2023-12-19T05:39:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.825+0000 7f6963edf640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c06d820 con 0x7f695c0b4790 2023-12-19T05:39:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.825+0000 7f696147a640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f695c06ca80 0x7f695c06ae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40896/0 (socket says 172.21.15.120:40896) 2023-12-19T05:39:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.825+0000 7f696147a640 1 -- 172.21.15.120:0/3466233690 learned_addr learned my addr 172.21.15.120:0/3466233690 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.825+0000 7f6960c79640 1 -- 172.21.15.120:0/3466233690 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178116256 0 0) 0x7f695c14b020 con 0x7f695c06ca80 2023-12-19T05:39:23.829 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.825+0000 7f6960c79640 1 -- 172.21.15.120:0/3466233690 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6948003520 con 0x7f695c06ca80 2023-12-19T05:39:23.830 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.825+0000 7f6961c7b640 1 --2- 172.21.15.120:0/3466233690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f695c0b4790 0x7f695c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.830 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.825+0000 7f696247c640 1 --2- 172.21.15.120:0/3466233690 >> v2:172.21.15.155:3300/0 conn(0x7f695c14ab90 0x7f695c1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.830 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6960c79640 1 -- 172.21.15.120:0/3466233690 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4255167065 0 0) 0x7f6948003520 con 0x7f695c06ca80 2023-12-19T05:39:23.830 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6960c79640 1 -- 172.21.15.120:0/3466233690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f695c0b4790 msgr2=0x7f695c06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:23.830 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6960c79640 1 --2- 172.21.15.120:0/3466233690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f695c0b4790 0x7f695c06ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.830 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6960c79640 1 -- 172.21.15.120:0/3466233690 >> v2:172.21.15.155:3300/0 conn(0x7f695c14ab90 msgr2=0x7f695c1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:23.830 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6960c79640 1 --2- 172.21.15.120:0/3466233690 >> v2:172.21.15.155:3300/0 conn(0x7f695c14ab90 0x7f695c1553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.830 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6960c79640 1 -- 172.21.15.120:0/3466233690 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c06b520 con 0x7f695c06ca80 2023-12-19T05:39:23.830 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6960c79640 1 -- 172.21.15.120:0/3466233690 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f694c001670 con 0x7f695c06ca80 2023-12-19T05:39:23.830 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6960c79640 1 -- 172.21.15.120:0/3466233690 >> v1:172.21.15.120:6789/0 conn(0x7f695c06ca80 legacy=0x7f695c06ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.830 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6960c79640 1 --2- 172.21.15.120:0/3466233690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f695c0b4790 0x7f6948003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.830 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6960c79640 1 --2- 172.21.15.120:0/3466233690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6948003ef0 0x7f69480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.830 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6960c79640 1 --2- 172.21.15.120:0/3466233690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6948004d00 0x7f6948005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.831 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6960c79640 1 -- 172.21.15.120:0/3466233690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c0b4b70 con 0x7f6948003ef0 2023-12-19T05:39:23.831 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6960c79640 1 -- 172.21.15.120:0/3466233690 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c06d820 con 0x7f6948004d00 2023-12-19T05:39:23.831 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6960c79640 1 -- 172.21.15.120:0/3466233690 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694800b980 con 0x7f695c0b4790 2023-12-19T05:39:23.831 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f696147a640 1 --2- 172.21.15.120:0/3466233690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6948003ef0 0x7f69480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.831 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f6961c7b640 1 --2- 172.21.15.120:0/3466233690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f695c0b4790 0x7f6948003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.831 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f696247c640 1 --2- 172.21.15.120:0/3466233690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6948004d00 0x7f6948005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.831 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f696147a640 1 -- 172.21.15.120:0/3466233690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f695c0b4790 msgr2=0x7f6948003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:23.831 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f696147a640 1 --2- 172.21.15.120:0/3466233690 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f695c0b4790 0x7f6948003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.831 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f696147a640 1 -- 172.21.15.120:0/3466233690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6948004d00 msgr2=0x7f6948005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:23.831 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f696147a640 1 --2- 172.21.15.120:0/3466233690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6948004d00 0x7f6948005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.831 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.826+0000 7f696147a640 1 -- 172.21.15.120:0/3466233690 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6948003520 con 0x7f6948003ef0 2023-12-19T05:39:23.831 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.827+0000 7f696147a640 1 --2- 172.21.15.120:0/3466233690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6948003ef0 0x7f69480047c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f694c00c290 tx=0x7f69480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e3c9d72626605 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.831 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.827+0000 7f6960c79640 1 -- 172.21.15.120:0/3466233690 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c005ad0 con 0x7f6948003ef0 2023-12-19T05:39:23.831 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.827+0000 7f6960c79640 1 -- 172.21.15.120:0/3466233690 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c005c30 con 0x7f6948003ef0 2023-12-19T05:39:23.832 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.827+0000 7f6960c79640 1 -- 172.21.15.120:0/3466233690 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c02c8c0 con 0x7f6948003ef0 2023-12-19T05:39:23.832 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.827+0000 7f6963edf640 1 -- 172.21.15.120:0/3466233690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6948003ef0 msgr2=0x7f69480047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.832 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.828+0000 7f6963edf640 1 --2- 172.21.15.120:0/3466233690 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6948003ef0 0x7f69480047c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f694c00c290 tx=0x7f69480057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.832 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.828+0000 7f696247c640 1 -- 172.21.15.120:0/3466233690 reap_dead start 2023-12-19T05:39:23.832 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.828+0000 7f6963edf640 1 -- 172.21.15.120:0/3466233690 shutdown_connections 2023-12-19T05:39:23.832 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.828+0000 7f6963edf640 1 -- 172.21.15.120:0/3466233690 >> 172.21.15.120:0/3466233690 conn(0x7f695c0bacb0 msgr2=0x7f695c0bb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:23.832 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.828+0000 7f6963edf640 1 -- 172.21.15.120:0/3466233690 shutdown_connections 2023-12-19T05:39:23.832 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.828+0000 7f6963edf640 1 -- 172.21.15.120:0/3466233690 wait complete. 2023-12-19T05:39:23.835 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.829+0000 7f6963edf640 1 Processor -- start 2023-12-19T05:39:23.835 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.829+0000 7f6963edf640 1 -- start start 2023-12-19T05:39:23.835 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.829+0000 7f6963edf640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6948003ef0 0x7f695c142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.835 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.829+0000 7f6963edf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f695c143a70 0x7f695c141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.835 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.829+0000 7f6963edf640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f695c13cc30 0x7f695c13d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.835 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.829+0000 7f6963edf640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c141160 con 0x7f695c13cc30 2023-12-19T05:39:23.835 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.829+0000 7f6963edf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695c143070 con 0x7f695c143a70 2023-12-19T05:39:23.835 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.829+0000 7f6963edf640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c1432e0 con 0x7f6948003ef0 2023-12-19T05:39:23.835 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.829+0000 7f696247c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f695c13cc30 0x7f695c13d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.835 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.829+0000 7f696247c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f695c13cc30 0x7f695c13d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52670/0 (socket says 172.21.15.120:52670) 2023-12-19T05:39:23.835 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.829+0000 7f696247c640 1 -- 172.21.15.120:0/2254183410 learned_addr learned my addr 172.21.15.120:0/2254183410 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:23.835 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.830+0000 7f6961c7b640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6948003ef0 0x7f695c142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.835 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.830+0000 7f696247c640 1 -- 172.21.15.120:0/2254183410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6948003ef0 msgr2=0x7f695c142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.830+0000 7f696247c640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6948003ef0 0x7f695c142b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.830+0000 7f696147a640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f695c143a70 0x7f695c141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.830+0000 7f696247c640 1 -- 172.21.15.120:0/2254183410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f695c143a70 msgr2=0x7f695c141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:23.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.830+0000 7f696247c640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f695c143a70 0x7f695c141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:23.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.830+0000 7f696247c640 1 -- 172.21.15.120:0/2254183410 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c1413b0 con 0x7f695c13cc30 2023-12-19T05:39:23.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.830+0000 7f696147a640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f695c143a70 0x7f695c141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:23.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.830+0000 7f696247c640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f695c13cc30 0x7f695c13d0b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f695c0bc0a0 tx=0x7f695400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.830+0000 7f69527fc640 1 -- 172.21.15.120:0/2254183410 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695400e040 con 0x7f695c13cc30 2023-12-19T05:39:23.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.830+0000 7f69527fc640 1 -- 172.21.15.120:0/2254183410 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695400f040 con 0x7f695c13cc30 2023-12-19T05:39:23.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.830+0000 7f69527fc640 1 -- 172.21.15.120:0/2254183410 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954015430 con 0x7f695c13cc30 2023-12-19T05:39:23.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.830+0000 7f6963edf640 1 -- 172.21.15.120:0/2254183410 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695c141690 con 0x7f695c13cc30 2023-12-19T05:39:23.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.830+0000 7f6963edf640 1 -- 172.21.15.120:0/2254183410 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695c13d5f0 con 0x7f695c13cc30 2023-12-19T05:39:23.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.831+0000 7f6963edf640 1 -- 172.21.15.120:0/2254183410 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695c04e080 con 0x7f695c13cc30 2023-12-19T05:39:23.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.831+0000 7f69527fc640 1 -- 172.21.15.120:0/2254183410 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6954015590 con 0x7f695c13cc30 2023-12-19T05:39:23.837 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.832+0000 7f69527fc640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f694006a430 0x7f694006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:23.837 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.832+0000 7f6961c7b640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f694006a430 0x7f694006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:23.837 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.832+0000 7f69527fc640 1 -- 172.21.15.120:0/2254183410 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6954089420 con 0x7f695c13cc30 2023-12-19T05:39:23.837 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.832+0000 7f6961c7b640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f694006a430 0x7f694006c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f69580098a0 tx=0x7f6958008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:23.837 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:23.836+0000 7f69527fc640 1 -- 172.21.15.120:0/2254183410 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6954054aa0 con 0x7f695c13cc30 2023-12-19T05:39:24.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.014+0000 7f6963edf640 1 -- 172.21.15.120:0/2254183410 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f695c06bae0 con 0x7f695c13cc30 2023-12-19T05:39:24.016 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.015+0000 7f69527fc640 1 -- 172.21.15.120:0/2254183410 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f69540580c0 con 0x7f695c13cc30 2023-12-19T05:39:24.016 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2023-12-19T05:39:24.018 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.017+0000 7f6963edf640 1 -- 172.21.15.120:0/2254183410 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f694006a430 msgr2=0x7f694006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.018 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.017+0000 7f6963edf640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f694006a430 0x7f694006c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f69580098a0 tx=0x7f6958008040 comp rx=0 tx=0).stop 2023-12-19T05:39:24.018 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.017+0000 7f6963edf640 1 -- 172.21.15.120:0/2254183410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f695c13cc30 msgr2=0x7f695c13d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.018 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.017+0000 7f6963edf640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f695c13cc30 0x7f695c13d0b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f695c0bc0a0 tx=0x7f695400f580 comp rx=0 tx=0).stop 2023-12-19T05:39:24.018 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.017+0000 7f6963edf640 1 -- 172.21.15.120:0/2254183410 shutdown_connections 2023-12-19T05:39:24.018 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.017+0000 7f6963edf640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f694006a430 0x7f694006c8f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.018 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.017+0000 7f6963edf640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f695c13cc30 0x7f695c13d0b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.018 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.017+0000 7f6963edf640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f695c143a70 0x7f695c141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.017+0000 7f6963edf640 1 --2- 172.21.15.120:0/2254183410 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6948003ef0 0x7f695c142b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.017+0000 7f6963edf640 1 -- 172.21.15.120:0/2254183410 >> 172.21.15.120:0/2254183410 conn(0x7f695c0bacb0 msgr2=0x7f695c0bc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:24.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.017+0000 7f6963edf640 1 -- 172.21.15.120:0/2254183410 shutdown_connections 2023-12-19T05:39:24.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.017+0000 7f6963edf640 1 -- 172.21.15.120:0/2254183410 wait complete. 2023-12-19T05:39:24.029 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T05:39:24.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:24.029 DEBUG:teuthology.orchestra.run.smithi188:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-19T05:39:24.135 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi188.front.sepia.ceph.com 2023-12-19T05:39:24.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:24.135 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T05:39:24.193 INFO:tasks.cephfs.cephfs_test_case:[] 2023-12-19T05:39:24.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:39:24.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.291+0000 7f459b59f640 1 Processor -- start 2023-12-19T05:39:24.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.291+0000 7f459b59f640 1 -- start start 2023-12-19T05:39:24.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.292+0000 7f459b59f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f459406b6a0 0x7f45940702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.292+0000 7f459b59f640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45940b93c0 con 0x7f45940b68b0 2023-12-19T05:39:24.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.292+0000 7f459b59f640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4594070800 con 0x7f45940b95d0 2023-12-19T05:39:24.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.292+0000 7f459b59f640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4594071a30 con 0x7f459406b6a0 2023-12-19T05:39:24.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.292+0000 7f4599b3c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f459406b6a0 0x7f45940702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.292+0000 7f459933b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f45940b68b0 0x7f45941426f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40906/0 (socket says 172.21.15.120:40906) 2023-12-19T05:39:24.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.292+0000 7f459933b640 1 -- 172.21.15.120:0/1744586573 learned_addr learned my addr 172.21.15.120:0/1744586573 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:24.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.292+0000 7f4599b3c640 1 -- 172.21.15.120:0/1744586573 >> v1:172.21.15.155:6789/0 conn(0x7f45940b95d0 legacy=0x7f459406af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.292+0000 7f4599b3c640 1 -- 172.21.15.120:0/1744586573 >> v1:172.21.15.120:6789/0 conn(0x7f45940b68b0 legacy=0x7f45941426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.292+0000 7f458bfff640 1 -- 172.21.15.120:0/1744586573 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190034438 0 0) 0x7f45940b93c0 con 0x7f45940b68b0 2023-12-19T05:39:24.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.292+0000 7f4599b3c640 1 -- 172.21.15.120:0/1744586573 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4594071090 con 0x7f459406b6a0 2023-12-19T05:39:24.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.293+0000 7f4599b3c640 1 --2- 172.21.15.120:0/1744586573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f459406b6a0 0x7f45940702c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f458c009d90 tx=0x7f458c02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939b2a29916fcf72 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.293+0000 7f458bfff640 1 -- 172.21.15.120:0/1744586573 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c02cd80 con 0x7f459406b6a0 2023-12-19T05:39:24.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.293+0000 7f458bfff640 1 -- 172.21.15.120:0/1744586573 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c034440 con 0x7f459406b6a0 2023-12-19T05:39:24.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.293+0000 7f458bfff640 1 -- 172.21.15.120:0/1744586573 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c0347d0 con 0x7f459406b6a0 2023-12-19T05:39:24.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.293+0000 7f459b59f640 1 -- 172.21.15.120:0/1744586573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f459406b6a0 msgr2=0x7f45940702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.293+0000 7f459b59f640 1 --2- 172.21.15.120:0/1744586573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f459406b6a0 0x7f45940702c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f458c009d90 tx=0x7f458c02bfd0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.293+0000 7f459b59f640 1 -- 172.21.15.120:0/1744586573 shutdown_connections 2023-12-19T05:39:24.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.293+0000 7f459b59f640 1 --2- 172.21.15.120:0/1744586573 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f459406b6a0 0x7f45940702c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.293+0000 7f459b59f640 1 -- 172.21.15.120:0/1744586573 >> 172.21.15.120:0/1744586573 conn(0x7f45940bcfd0 msgr2=0x7f45940bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:24.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.294+0000 7f459b59f640 1 -- 172.21.15.120:0/1744586573 shutdown_connections 2023-12-19T05:39:24.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.294+0000 7f459b59f640 1 -- 172.21.15.120:0/1744586573 wait complete. 2023-12-19T05:39:24.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.294+0000 7f459b59f640 1 Processor -- start 2023-12-19T05:39:24.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f459b59f640 1 -- start start 2023-12-19T05:39:24.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f459b59f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459406b6a0 0x7f4594148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f459b59f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45940b68b0 0x7f45941de060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f459b59f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45940b95d0 0x7f45940b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f459b59f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45940b36a0 con 0x7f45940b68b0 2023-12-19T05:39:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f459b59f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4594147a30 con 0x7f45940b95d0 2023-12-19T05:39:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f459b59f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45941474f0 con 0x7f459406b6a0 2023-12-19T05:39:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f4598b3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45940b68b0 0x7f45941de060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f4598b3a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45940b68b0 0x7f45941de060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52686/0 (socket says 172.21.15.120:52686) 2023-12-19T05:39:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f4598b3a640 1 -- 172.21.15.120:0/546994212 learned_addr learned my addr 172.21.15.120:0/546994212 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f4598b3a640 1 -- 172.21.15.120:0/546994212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459406b6a0 msgr2=0x7f4594148b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f4598b3a640 1 --2- 172.21.15.120:0/546994212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459406b6a0 0x7f4594148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f4598b3a640 1 -- 172.21.15.120:0/546994212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45940b95d0 msgr2=0x7f45940b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f4598b3a640 1 --2- 172.21.15.120:0/546994212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45940b95d0 0x7f45940b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.295+0000 7f4598b3a640 1 -- 172.21.15.120:0/546994212 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c009a70 con 0x7f45940b68b0 2023-12-19T05:39:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.296+0000 7f4598b3a640 1 --2- 172.21.15.120:0/546994212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45940b68b0 0x7f45941de060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f458400c400 tx=0x7f458400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.296+0000 7f4589ffb640 1 -- 172.21.15.120:0/546994212 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45840052d0 con 0x7f45940b68b0 2023-12-19T05:39:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.296+0000 7f4589ffb640 1 -- 172.21.15.120:0/546994212 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4584005430 con 0x7f45940b68b0 2023-12-19T05:39:24.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.296+0000 7f4589ffb640 1 -- 172.21.15.120:0/546994212 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584003830 con 0x7f45940b68b0 2023-12-19T05:39:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.296+0000 7f459b59f640 1 -- 172.21.15.120:0/546994212 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45941dd860 con 0x7f45940b68b0 2023-12-19T05:39:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.296+0000 7f459b59f640 1 -- 172.21.15.120:0/546994212 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4594148700 con 0x7f45940b68b0 2023-12-19T05:39:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.297+0000 7f459b59f640 1 -- 172.21.15.120:0/546994212 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459404e080 con 0x7f45940b68b0 2023-12-19T05:39:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.297+0000 7f4589ffb640 1 -- 172.21.15.120:0/546994212 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4584003990 con 0x7f45940b68b0 2023-12-19T05:39:24.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.298+0000 7f4589ffb640 1 --2- 172.21.15.120:0/546994212 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f457806a430 0x7f457806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.301 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.298+0000 7f4589ffb640 1 -- 172.21.15.120:0/546994212 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4584087ec0 con 0x7f45940b68b0 2023-12-19T05:39:24.301 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.298+0000 7f459933b640 1 --2- 172.21.15.120:0/546994212 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f457806a430 0x7f457806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.301 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.298+0000 7f459933b640 1 --2- 172.21.15.120:0/546994212 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f457806a430 0x7f457806c8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4590007fd0 tx=0x7f4590007900 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.303 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.302+0000 7f4589ffb640 1 -- 172.21.15.120:0/546994212 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f45840534b0 con 0x7f45940b68b0 2023-12-19T05:39:24.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.505+0000 7f459b59f640 1 -- 172.21.15.120:0/546994212 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45940bd450 con 0x7f45940b68b0 2023-12-19T05:39:24.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.505+0000 7f4589ffb640 1 -- 172.21.15.120:0/546994212 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3892 (secure 0 0 0) 0x7f4584056ad0 con 0x7f45940b68b0 2023-12-19T05:39:24.507 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:24.507 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/753508604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":753508604},{"type":"v1","addr":"172.21.15.155:6833","nonce":753508604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/3314096579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":3314096579},{"type":"v1","addr":"172.21.15.120:6836","nonce":3314096579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:38:58.081682+0000","modified":"2023-12-19T05:39:00.753884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/1608902018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":1608902018},{"type":"v1","addr":"172.21.15.120:6837","nonce":1608902018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:39:24.507 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2023-12-19T05:39:24.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.507+0000 7f459b59f640 1 -- 172.21.15.120:0/546994212 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f457806a430 msgr2=0x7f457806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.507+0000 7f459b59f640 1 --2- 172.21.15.120:0/546994212 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f457806a430 0x7f457806c8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4590007fd0 tx=0x7f4590007900 comp rx=0 tx=0).stop 2023-12-19T05:39:24.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.507+0000 7f459b59f640 1 -- 172.21.15.120:0/546994212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45940b68b0 msgr2=0x7f45941de060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.507+0000 7f459b59f640 1 --2- 172.21.15.120:0/546994212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45940b68b0 0x7f45941de060 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f458400c400 tx=0x7f458400c8c0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.507+0000 7f459b59f640 1 -- 172.21.15.120:0/546994212 shutdown_connections 2023-12-19T05:39:24.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.507+0000 7f459b59f640 1 --2- 172.21.15.120:0/546994212 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f457806a430 0x7f457806c8f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.507+0000 7f459b59f640 1 --2- 172.21.15.120:0/546994212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45940b95d0 0x7f45940b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.507+0000 7f459b59f640 1 --2- 172.21.15.120:0/546994212 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f45940b68b0 0x7f45941de060 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.507+0000 7f459b59f640 1 --2- 172.21.15.120:0/546994212 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f459406b6a0 0x7f4594148b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.507+0000 7f459b59f640 1 -- 172.21.15.120:0/546994212 >> 172.21.15.120:0/546994212 conn(0x7f45940bcfd0 msgr2=0x7f45940baed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:24.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.507+0000 7f459b59f640 1 -- 172.21.15.120:0/546994212 shutdown_connections 2023-12-19T05:39:24.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.507+0000 7f459b59f640 1 -- 172.21.15.120:0/546994212 wait complete. 2023-12-19T05:39:24.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:24.618 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.617+0000 7fe2dbbfd640 1 Processor -- start 2023-12-19T05:39:24.618 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.617+0000 7fe2dbbfd640 1 -- start start 2023-12-19T05:39:24.619 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.617+0000 7fe2dbbfd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe2d4071730 0x7fe2d406a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.619 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.617+0000 7fe2dbbfd640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d40707b0 con 0x7fe2d4071250 2023-12-19T05:39:24.619 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.617+0000 7fe2dbbfd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d406a950 con 0x7fe2d40b6c30 2023-12-19T05:39:24.619 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.617+0000 7fe2dbbfd640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d41451d0 con 0x7fe2d4071730 2023-12-19T05:39:24.619 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.618+0000 7fe2d9198640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe2d4071250 0x7fe2d4069d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40918/0 (socket says 172.21.15.120:40918) 2023-12-19T05:39:24.619 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.618+0000 7fe2d9198640 1 -- 172.21.15.120:0/3065521336 learned_addr learned my addr 172.21.15.120:0/3065521336 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:24.620 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.618+0000 7fe2da19a640 1 --2- 172.21.15.120:0/3065521336 >> v2:172.21.15.155:3300/0 conn(0x7fe2d4071730 0x7fe2d406a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.620 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.618+0000 7fe2d8997640 1 -- 172.21.15.120:0/3065521336 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886304017 0 0) 0x7fe2d40707b0 con 0x7fe2d4071250 2023-12-19T05:39:24.620 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.618+0000 7fe2d8997640 1 -- 172.21.15.120:0/3065521336 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2c0003520 con 0x7fe2d4071250 2023-12-19T05:39:24.620 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.618+0000 7fe2da19a640 1 -- 172.21.15.120:0/3065521336 >> v1:172.21.15.155:6789/0 conn(0x7fe2d40b6c30 legacy=0x7fe2d414a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.620 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.618+0000 7fe2da19a640 1 -- 172.21.15.120:0/3065521336 >> v1:172.21.15.120:6789/0 conn(0x7fe2d4071250 legacy=0x7fe2d4069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.620 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.618+0000 7fe2da19a640 1 -- 172.21.15.120:0/3065521336 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d4070a50 con 0x7fe2d4071730 2023-12-19T05:39:24.621 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.619+0000 7fe2da19a640 1 --2- 172.21.15.120:0/3065521336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2d4071730 0x7fe2d406a410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009d90 tx=0x7fe2cc02bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef1bc83d558321ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.621 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.619+0000 7fe2d8997640 1 -- 172.21.15.120:0/3065521336 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc02cd80 con 0x7fe2d4071730 2023-12-19T05:39:24.621 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.619+0000 7fe2d8997640 1 -- 172.21.15.120:0/3065521336 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc034440 con 0x7fe2d4071730 2023-12-19T05:39:24.622 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.619+0000 7fe2d8997640 1 -- 172.21.15.120:0/3065521336 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0347b0 con 0x7fe2d4071730 2023-12-19T05:39:24.622 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.619+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/3065521336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2d4071730 msgr2=0x7fe2d406a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.622 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.619+0000 7fe2dbbfd640 1 --2- 172.21.15.120:0/3065521336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2d4071730 0x7fe2d406a410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009d90 tx=0x7fe2cc02bfd0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.622 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.619+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/3065521336 shutdown_connections 2023-12-19T05:39:24.622 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.619+0000 7fe2dbbfd640 1 --2- 172.21.15.120:0/3065521336 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2d4071730 0x7fe2d406a410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.622 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.619+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/3065521336 >> 172.21.15.120:0/3065521336 conn(0x7fe2d40bcfd0 msgr2=0x7fe2d40bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:24.622 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.620+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/3065521336 shutdown_connections 2023-12-19T05:39:24.622 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.620+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/3065521336 wait complete. 2023-12-19T05:39:24.622 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.621+0000 7fe2dbbfd640 1 Processor -- start 2023-12-19T05:39:24.622 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.621+0000 7fe2dbbfd640 1 -- start start 2023-12-19T05:39:24.624 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.621+0000 7fe2dbbfd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2d4071250 0x7fe2d40b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.624 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.621+0000 7fe2dbbfd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2d4071730 0x7fe2d414c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.624 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.621+0000 7fe2dbbfd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2d40b6c30 0x7fe2d41e2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.624 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.621+0000 7fe2dbbfd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d414c530 con 0x7fe2d4071730 2023-12-19T05:39:24.624 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.621+0000 7fe2dbbfd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d4146490 con 0x7fe2d4071250 2023-12-19T05:39:24.624 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.621+0000 7fe2dbbfd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d414c200 con 0x7fe2d40b6c30 2023-12-19T05:39:24.624 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.621+0000 7fe2d9198640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2d4071730 0x7fe2d414c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.621+0000 7fe2d9198640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2d4071730 0x7fe2d414c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52692/0 (socket says 172.21.15.120:52692) 2023-12-19T05:39:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.621+0000 7fe2d9198640 1 -- 172.21.15.120:0/1635539488 learned_addr learned my addr 172.21.15.120:0/1635539488 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.621+0000 7fe2da19a640 1 --2- 172.21.15.120:0/1635539488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2d40b6c30 0x7fe2d41e2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.621+0000 7fe2d9999640 1 --2- 172.21.15.120:0/1635539488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2d4071250 0x7fe2d40b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.622+0000 7fe2d9198640 1 -- 172.21.15.120:0/1635539488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2d40b6c30 msgr2=0x7fe2d41e2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.622+0000 7fe2d9198640 1 --2- 172.21.15.120:0/1635539488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2d40b6c30 0x7fe2d41e2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.622+0000 7fe2d9198640 1 -- 172.21.15.120:0/1635539488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2d4071250 msgr2=0x7fe2d40b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.622+0000 7fe2d9198640 1 --2- 172.21.15.120:0/1635539488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2d4071250 0x7fe2d40b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.622+0000 7fe2d9198640 1 -- 172.21.15.120:0/1635539488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc009a70 con 0x7fe2d4071730 2023-12-19T05:39:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.622+0000 7fe2d9198640 1 --2- 172.21.15.120:0/1635539488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2d4071730 0x7fe2d414c9c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c500 tx=0x7fe2c400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.625 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.622+0000 7fe2ca7fc640 1 -- 172.21.15.120:0/1635539488 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4005ce0 con 0x7fe2d4071730 2023-12-19T05:39:24.626 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.622+0000 7fe2ca7fc640 1 -- 172.21.15.120:0/1635539488 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c4005e40 con 0x7fe2d4071730 2023-12-19T05:39:24.626 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.622+0000 7fe2ca7fc640 1 -- 172.21.15.120:0/1635539488 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4007330 con 0x7fe2d4071730 2023-12-19T05:39:24.626 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.622+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/1635539488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d414e130 con 0x7fe2d4071730 2023-12-19T05:39:24.626 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.622+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/1635539488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d414df00 con 0x7fe2d4071730 2023-12-19T05:39:24.626 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.623+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/1635539488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d414c6a0 con 0x7fe2d4071730 2023-12-19T05:39:24.626 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.623+0000 7fe2ca7fc640 1 -- 172.21.15.120:0/1635539488 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe2c4007550 con 0x7fe2d4071730 2023-12-19T05:39:24.627 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.624+0000 7fe2ca7fc640 1 --2- 172.21.15.120:0/1635539488 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe2b806a430 0x7fe2b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.627 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.624+0000 7fe2d9999640 1 --2- 172.21.15.120:0/1635539488 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe2b806a430 0x7fe2b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.627 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.624+0000 7fe2ca7fc640 1 -- 172.21.15.120:0/1635539488 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2c4087f10 con 0x7fe2d4071730 2023-12-19T05:39:24.627 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.624+0000 7fe2d9999640 1 --2- 172.21.15.120:0/1635539488 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe2b806a430 0x7fe2b806c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00016e0 tx=0x7fe2d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.629 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.628+0000 7fe2ca7fc640 1 -- 172.21.15.120:0/1635539488 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe2c4053670 con 0x7fe2d4071730 2023-12-19T05:39:24.798 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.797+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/1635539488 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2d4143200 con 0x7fe2d4071730 2023-12-19T05:39:24.799 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.798+0000 7fe2ca7fc640 1 -- 172.21.15.120:0/1635539488 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fe2c4017090 con 0x7fe2d4071730 2023-12-19T05:39:24.800 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:24.800 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.800+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/1635539488 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe2b806a430 msgr2=0x7fe2b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.800+0000 7fe2dbbfd640 1 --2- 172.21.15.120:0/1635539488 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe2b806a430 0x7fe2b806c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00016e0 tx=0x7fe2d0009040 comp rx=0 tx=0).stop 2023-12-19T05:39:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.800+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/1635539488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2d4071730 msgr2=0x7fe2d414c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.800+0000 7fe2dbbfd640 1 --2- 172.21.15.120:0/1635539488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2d4071730 0x7fe2d414c9c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400c500 tx=0x7fe2c400c9c0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.800+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/1635539488 shutdown_connections 2023-12-19T05:39:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.800+0000 7fe2dbbfd640 1 --2- 172.21.15.120:0/1635539488 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe2b806a430 0x7fe2b806c8f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.800+0000 7fe2dbbfd640 1 --2- 172.21.15.120:0/1635539488 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe2d40b6c30 0x7fe2d41e2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.800+0000 7fe2dbbfd640 1 --2- 172.21.15.120:0/1635539488 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2d4071730 0x7fe2d414c9c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.800+0000 7fe2dbbfd640 1 --2- 172.21.15.120:0/1635539488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2d4071250 0x7fe2d40b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.800+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/1635539488 >> 172.21.15.120:0/1635539488 conn(0x7fe2d40bcfd0 msgr2=0x7fe2d4144710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.800+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/1635539488 shutdown_connections 2023-12-19T05:39:24.802 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.800+0000 7fe2dbbfd640 1 -- 172.21.15.120:0/1635539488 wait complete. 2023-12-19T05:39:24.812 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:45.976868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:38:56.035188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:38:57.050130+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:24.813 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:24.914 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.912+0000 7f3954d5c640 1 Processor -- start 2023-12-19T05:39:24.914 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.912+0000 7f3954d5c640 1 -- start start 2023-12-19T05:39:24.915 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.913+0000 7f3954d5c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f39501543e0 0x7f39501567d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.915 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.913+0000 7f3954d5c640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f395006ba10 con 0x7f39500712b0 2023-12-19T05:39:24.915 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.913+0000 7f3954d5c640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3950070e20 con 0x7f3950069d00 2023-12-19T05:39:24.915 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.913+0000 7f3954d5c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3950145270 con 0x7f39501543e0 2023-12-19T05:39:24.915 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.913+0000 7f394ed9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f39501543e0 0x7f39501567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.915 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.913+0000 7f394ed9d640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f39501543e0 0x7f39501567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52708/0 (socket says 172.21.15.120:52708) 2023-12-19T05:39:24.915 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.913+0000 7f394ed9d640 1 -- 172.21.15.120:0/1981786956 learned_addr learned my addr 172.21.15.120:0/1981786956 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:24.915 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.914+0000 7f394ed9d640 1 -- 172.21.15.120:0/1981786956 >> v1:172.21.15.155:6789/0 conn(0x7f3950069d00 legacy=0x7f395014aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:24.915 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.914+0000 7f394ed9d640 1 -- 172.21.15.120:0/1981786956 >> v1:172.21.15.120:6789/0 conn(0x7f39500712b0 legacy=0x7f395006a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.915 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.914+0000 7f394ed9d640 1 -- 172.21.15.120:0/1981786956 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3950070af0 con 0x7f39501543e0 2023-12-19T05:39:24.916 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.914+0000 7f394ed9d640 1 --2- 172.21.15.120:0/1981786956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39501543e0 0x7f39501567d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3948009e50 tx=0x7f394802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7479acd9eedb7af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.917 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.914+0000 7f394dd9b640 1 -- 172.21.15.120:0/1981786956 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394802cb20 con 0x7f39501543e0 2023-12-19T05:39:24.917 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.914+0000 7f394dd9b640 1 -- 172.21.15.120:0/1981786956 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394802cc80 con 0x7f39501543e0 2023-12-19T05:39:24.917 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.914+0000 7f394dd9b640 1 -- 172.21.15.120:0/1981786956 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39480343f0 con 0x7f39501543e0 2023-12-19T05:39:24.917 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.915+0000 7f3954d5c640 1 -- 172.21.15.120:0/1981786956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39501543e0 msgr2=0x7f39501567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.917 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.915+0000 7f3954d5c640 1 --2- 172.21.15.120:0/1981786956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39501543e0 0x7f39501567d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3948009e50 tx=0x7f394802bf80 comp rx=0 tx=0).stop 2023-12-19T05:39:24.917 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.915+0000 7f3954d5c640 1 -- 172.21.15.120:0/1981786956 shutdown_connections 2023-12-19T05:39:24.917 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.915+0000 7f3954d5c640 1 --2- 172.21.15.120:0/1981786956 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39501543e0 0x7f39501567d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.917 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.915+0000 7f3954d5c640 1 -- 172.21.15.120:0/1981786956 >> 172.21.15.120:0/1981786956 conn(0x7f39500bd070 msgr2=0x7f39500bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:24.917 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.915+0000 7f3954d5c640 1 -- 172.21.15.120:0/1981786956 shutdown_connections 2023-12-19T05:39:24.917 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.915+0000 7f3954d5c640 1 -- 172.21.15.120:0/1981786956 wait complete. 2023-12-19T05:39:24.919 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.916+0000 7f3954d5c640 1 Processor -- start 2023-12-19T05:39:24.919 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.916+0000 7f3954d5c640 1 -- start start 2023-12-19T05:39:24.919 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3954d5c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3950069d00 0x7f39501431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.919 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3954d5c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39500712b0 0x7f395013f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.919 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3954d5c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39501543e0 0x7f395013f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.919 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3954d5c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3950146d40 con 0x7f39500712b0 2023-12-19T05:39:24.919 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3954d5c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3950143700 con 0x7f39501543e0 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3954d5c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3950147a00 con 0x7f3950069d00 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3947fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39500712b0 0x7f395013f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3947fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39500712b0 0x7f395013f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52718/0 (socket says 172.21.15.120:52718) 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3947fff640 1 -- 172.21.15.120:0/2339233420 learned_addr learned my addr 172.21.15.120:0/2339233420 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f394ed9d640 1 --2- 172.21.15.120:0/2339233420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39501543e0 0x7f395013f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f394e59c640 1 --2- 172.21.15.120:0/2339233420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3950069d00 0x7f39501431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3947fff640 1 -- 172.21.15.120:0/2339233420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3950069d00 msgr2=0x7f39501431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3947fff640 1 --2- 172.21.15.120:0/2339233420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3950069d00 0x7f39501431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3947fff640 1 -- 172.21.15.120:0/2339233420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39501543e0 msgr2=0x7f395013f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3947fff640 1 --2- 172.21.15.120:0/2339233420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39501543e0 0x7f395013f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3947fff640 1 -- 172.21.15.120:0/2339233420 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3948009b30 con 0x7f39500712b0 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3947fff640 1 --2- 172.21.15.120:0/2339233420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39500712b0 0x7f395013f080 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f393800c450 tx=0x7f393800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.917+0000 7f3946ffd640 1 -- 172.21.15.120:0/2339233420 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39380052d0 con 0x7f39500712b0 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.918+0000 7f3946ffd640 1 -- 172.21.15.120:0/2339233420 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3938005430 con 0x7f39500712b0 2023-12-19T05:39:24.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.918+0000 7f3954d5c640 1 -- 172.21.15.120:0/2339233420 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39501dfcf0 con 0x7f39500712b0 2023-12-19T05:39:24.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.918+0000 7f3946ffd640 1 -- 172.21.15.120:0/2339233420 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938012870 con 0x7f39500712b0 2023-12-19T05:39:24.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.918+0000 7f3954d5c640 1 -- 172.21.15.120:0/2339233420 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39501e0080 con 0x7f39500712b0 2023-12-19T05:39:24.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.919+0000 7f3954d5c640 1 -- 172.21.15.120:0/2339233420 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f395004e080 con 0x7f39500712b0 2023-12-19T05:39:24.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.919+0000 7f3946ffd640 1 -- 172.21.15.120:0/2339233420 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f39380129d0 con 0x7f39500712b0 2023-12-19T05:39:24.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.919+0000 7f3946ffd640 1 --2- 172.21.15.120:0/2339233420 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f393006a430 0x7f393006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:24.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.919+0000 7f3946ffd640 1 -- 172.21.15.120:0/2339233420 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3938088280 con 0x7f39500712b0 2023-12-19T05:39:24.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.919+0000 7f394e59c640 1 --2- 172.21.15.120:0/2339233420 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f393006a430 0x7f393006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:24.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.920+0000 7f394e59c640 1 --2- 172.21.15.120:0/2339233420 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f393006a430 0x7f393006c8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3940006fd0 tx=0x7f3940009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:24.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:24.923+0000 7f3946ffd640 1 -- 172.21.15.120:0/2339233420 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f39380539b0 con 0x7f39500712b0 2023-12-19T05:39:25.090 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.088+0000 7f3954d5c640 1 -- 172.21.15.120:0/2339233420 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39500ba220 con 0x7f39500712b0 2023-12-19T05:39:25.090 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.089+0000 7f3946ffd640 1 -- 172.21.15.120:0/2339233420 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3938056fd0 con 0x7f39500712b0 2023-12-19T05:39:25.090 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2023-12-19T05:39:25.092 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.091+0000 7f3954d5c640 1 -- 172.21.15.120:0/2339233420 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f393006a430 msgr2=0x7f393006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.092 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.091+0000 7f3954d5c640 1 --2- 172.21.15.120:0/2339233420 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f393006a430 0x7f393006c8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3940006fd0 tx=0x7f3940009060 comp rx=0 tx=0).stop 2023-12-19T05:39:25.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.091+0000 7f3954d5c640 1 -- 172.21.15.120:0/2339233420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39500712b0 msgr2=0x7f395013f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.091+0000 7f3954d5c640 1 --2- 172.21.15.120:0/2339233420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39500712b0 0x7f395013f080 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f393800c450 tx=0x7f393800c910 comp rx=0 tx=0).stop 2023-12-19T05:39:25.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.091+0000 7f3954d5c640 1 -- 172.21.15.120:0/2339233420 shutdown_connections 2023-12-19T05:39:25.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.091+0000 7f3954d5c640 1 --2- 172.21.15.120:0/2339233420 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f393006a430 0x7f393006c8f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.091+0000 7f3954d5c640 1 --2- 172.21.15.120:0/2339233420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f39501543e0 0x7f395013f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.091+0000 7f3954d5c640 1 --2- 172.21.15.120:0/2339233420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f39500712b0 0x7f395013f080 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.091+0000 7f3954d5c640 1 --2- 172.21.15.120:0/2339233420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3950069d00 0x7f39501431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.091+0000 7f3954d5c640 1 -- 172.21.15.120:0/2339233420 >> 172.21.15.120:0/2339233420 conn(0x7f39500bd070 msgr2=0x7f39500bd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:25.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.091+0000 7f3954d5c640 1 -- 172.21.15.120:0/2339233420 shutdown_connections 2023-12-19T05:39:25.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.091+0000 7f3954d5c640 1 -- 172.21.15.120:0/2339233420 wait complete. 2023-12-19T05:39:25.103 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T05:39:25.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.204+0000 7f3ad87f0640 1 Processor -- start 2023-12-19T05:39:25.205 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.204+0000 7f3ad87f0640 1 -- start start 2023-12-19T05:39:25.206 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.205+0000 7f3ad87f0640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3ad0069f70 0x7f3ad014aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.206 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.205+0000 7f3ad87f0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ad0071970 0x7f3ad00710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.206 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.205+0000 7f3ad87f0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3ad00b6680 0x7f3ad00b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.206 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.205+0000 7f3ad87f0640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad006fef0 con 0x7f3ad0069f70 2023-12-19T05:39:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.205+0000 7f3ad87f0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad00b40b0 con 0x7f3ad00b6680 2023-12-19T05:39:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.205+0000 7f3ad87f0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad0071dd0 con 0x7f3ad0071970 2023-12-19T05:39:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.205+0000 7f3ad658c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3ad0069f70 0x7f3ad014aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.205+0000 7f3ad658c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3ad0069f70 0x7f3ad014aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52726/0 (socket says 172.21.15.120:52726) 2023-12-19T05:39:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.205+0000 7f3ad658c640 1 -- 172.21.15.120:0/2954370643 learned_addr learned my addr 172.21.15.120:0/2954370643 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.205+0000 7f3ad658c640 1 -- 172.21.15.120:0/2954370643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ad0071970 msgr2=0x7f3ad00710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.205+0000 7f3ad658c640 1 --2- 172.21.15.120:0/2954370643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ad0071970 0x7f3ad00710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.205+0000 7f3ad658c640 1 -- 172.21.15.120:0/2954370643 >> v2:172.21.15.155:3300/0 conn(0x7f3ad00b6680 msgr2=0x7f3ad00b6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.205+0000 7f3ad658c640 1 --2- 172.21.15.120:0/2954370643 >> v2:172.21.15.155:3300/0 conn(0x7f3ad00b6680 0x7f3ad00b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.207 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.205+0000 7f3ad658c640 1 -- 172.21.15.120:0/2954370643 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad00b3b30 con 0x7f3ad0069f70 2023-12-19T05:39:25.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.206+0000 7f3ad658c640 1 --2- 172.21.15.120:0/2954370643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ad0069f70 0x7f3ad014aa80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3ad006b5f0 tx=0x7f3acc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d948304cbfa30e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.206+0000 7f3ad558a640 1 -- 172.21.15.120:0/2954370643 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc0317e0 con 0x7f3ad0069f70 2023-12-19T05:39:25.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.206+0000 7f3ad558a640 1 -- 172.21.15.120:0/2954370643 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc031940 con 0x7f3ad0069f70 2023-12-19T05:39:25.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.206+0000 7f3ad558a640 1 -- 172.21.15.120:0/2954370643 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc031cd0 con 0x7f3ad0069f70 2023-12-19T05:39:25.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.206+0000 7f3ad87f0640 1 -- 172.21.15.120:0/2954370643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ad0069f70 msgr2=0x7f3ad014aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.206+0000 7f3ad87f0640 1 --2- 172.21.15.120:0/2954370643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ad0069f70 0x7f3ad014aa80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3ad006b5f0 tx=0x7f3acc02b880 comp rx=0 tx=0).stop 2023-12-19T05:39:25.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.206+0000 7f3ad87f0640 1 -- 172.21.15.120:0/2954370643 shutdown_connections 2023-12-19T05:39:25.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.206+0000 7f3ad87f0640 1 --2- 172.21.15.120:0/2954370643 >> v2:172.21.15.155:3300/0 conn(0x7f3ad00b6680 0x7f3ad00b6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.206+0000 7f3ad87f0640 1 --2- 172.21.15.120:0/2954370643 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ad0071970 0x7f3ad00710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.206+0000 7f3ad87f0640 1 --2- 172.21.15.120:0/2954370643 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ad0069f70 0x7f3ad014aa80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.211 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.206+0000 7f3ad87f0640 1 -- 172.21.15.120:0/2954370643 >> 172.21.15.120:0/2954370643 conn(0x7f3ad00bd210 msgr2=0x7f3ad00bd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:25.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.206+0000 7f3ad87f0640 1 -- 172.21.15.120:0/2954370643 shutdown_connections 2023-12-19T05:39:25.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.206+0000 7f3ad87f0640 1 -- 172.21.15.120:0/2954370643 wait complete. 2023-12-19T05:39:25.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.207+0000 7f3ad87f0640 1 Processor -- start 2023-12-19T05:39:25.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.207+0000 7f3ad87f0640 1 -- start start 2023-12-19T05:39:25.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad87f0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ad0069f70 0x7f3ad0147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad87f0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ad0071970 0x7f3ad01dfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad87f0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ad00b6680 0x7f3ad014e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad87f0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad0147870 con 0x7f3ad00b6680 2023-12-19T05:39:25.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad87f0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad0145c30 con 0x7f3ad0069f70 2023-12-19T05:39:25.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad87f0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad00abcb0 con 0x7f3ad0071970 2023-12-19T05:39:25.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad6d8d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ad00b6680 0x7f3ad014e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.212 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad6d8d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ad00b6680 0x7f3ad014e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52734/0 (socket says 172.21.15.120:52734) 2023-12-19T05:39:25.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad6d8d640 1 -- 172.21.15.120:0/67665645 learned_addr learned my addr 172.21.15.120:0/67665645 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:25.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad658c640 1 --2- 172.21.15.120:0/67665645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ad0069f70 0x7f3ad0147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad5d8b640 1 --2- 172.21.15.120:0/67665645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ad0071970 0x7f3ad01dfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad6d8d640 1 -- 172.21.15.120:0/67665645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ad0071970 msgr2=0x7f3ad01dfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad6d8d640 1 --2- 172.21.15.120:0/67665645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ad0071970 0x7f3ad01dfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad6d8d640 1 -- 172.21.15.120:0/67665645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ad0069f70 msgr2=0x7f3ad0147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad6d8d640 1 --2- 172.21.15.120:0/67665645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ad0069f70 0x7f3ad0147330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.208+0000 7f3ad6d8d640 1 -- 172.21.15.120:0/67665645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc0094d0 con 0x7f3ad00b6680 2023-12-19T05:39:25.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.209+0000 7f3ad6d8d640 1 --2- 172.21.15.120:0/67665645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ad00b6680 0x7f3ad014e100 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800b970 tx=0x7f3ac800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.209+0000 7f3ac6ffd640 1 -- 172.21.15.120:0/67665645 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac800caa0 con 0x7f3ad00b6680 2023-12-19T05:39:25.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.209+0000 7f3ac6ffd640 1 -- 172.21.15.120:0/67665645 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac800cc20 con 0x7f3ad00b6680 2023-12-19T05:39:25.213 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.209+0000 7f3ad87f0640 1 -- 172.21.15.120:0/67665645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad00b3840 con 0x7f3ad00b6680 2023-12-19T05:39:25.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.209+0000 7f3ac6ffd640 1 -- 172.21.15.120:0/67665645 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8014440 con 0x7f3ad00b6680 2023-12-19T05:39:25.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.209+0000 7f3ad87f0640 1 -- 172.21.15.120:0/67665645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad01458c0 con 0x7f3ad00b6680 2023-12-19T05:39:25.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.210+0000 7f3ad87f0640 1 -- 172.21.15.120:0/67665645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad0066670 con 0x7f3ad00b6680 2023-12-19T05:39:25.214 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.210+0000 7f3ac6ffd640 1 -- 172.21.15.120:0/67665645 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ac801e440 con 0x7f3ad00b6680 2023-12-19T05:39:25.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.210+0000 7f3ac6ffd640 1 --2- 172.21.15.120:0/67665645 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f3ab406a430 0x7f3ab406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.211+0000 7f3ac6ffd640 1 -- 172.21.15.120:0/67665645 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ac80885f0 con 0x7f3ad00b6680 2023-12-19T05:39:25.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.211+0000 7f3ad658c640 1 --2- 172.21.15.120:0/67665645 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f3ab406a430 0x7f3ab406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.211+0000 7f3ad658c640 1 --2- 172.21.15.120:0/67665645 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f3ab406a430 0x7f3ab406c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3acc036000 tx=0x7f3acc03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.215 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.215+0000 7f3ac6ffd640 1 -- 172.21.15.120:0/67665645 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3ac8053d20 con 0x7f3ad00b6680 2023-12-19T05:39:25.382 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.381+0000 7f3ad87f0640 1 -- 172.21.15.120:0/67665645 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ad0145da0 con 0x7f3ad00b6680 2023-12-19T05:39:25.382 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.381+0000 7f3ac6ffd640 1 -- 172.21.15.120:0/67665645 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ac8019020 con 0x7f3ad00b6680 2023-12-19T05:39:25.382 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2023-12-19T05:39:25.384 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.383+0000 7f3ad87f0640 1 -- 172.21.15.120:0/67665645 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f3ab406a430 msgr2=0x7f3ab406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.384 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.383+0000 7f3ad87f0640 1 --2- 172.21.15.120:0/67665645 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f3ab406a430 0x7f3ab406c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3acc036000 tx=0x7f3acc03d040 comp rx=0 tx=0).stop 2023-12-19T05:39:25.384 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.383+0000 7f3ad87f0640 1 -- 172.21.15.120:0/67665645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ad00b6680 msgr2=0x7f3ad014e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.384 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.383+0000 7f3ad87f0640 1 --2- 172.21.15.120:0/67665645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ad00b6680 0x7f3ad014e100 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800b970 tx=0x7f3ac800bd70 comp rx=0 tx=0).stop 2023-12-19T05:39:25.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.383+0000 7f3ad87f0640 1 -- 172.21.15.120:0/67665645 shutdown_connections 2023-12-19T05:39:25.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.383+0000 7f3ad87f0640 1 --2- 172.21.15.120:0/67665645 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f3ab406a430 0x7f3ab406c8f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.383+0000 7f3ad87f0640 1 --2- 172.21.15.120:0/67665645 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3ad00b6680 0x7f3ad014e100 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.383+0000 7f3ad87f0640 1 --2- 172.21.15.120:0/67665645 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3ad0071970 0x7f3ad01dfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.383+0000 7f3ad87f0640 1 --2- 172.21.15.120:0/67665645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ad0069f70 0x7f3ad0147330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.383+0000 7f3ad87f0640 1 -- 172.21.15.120:0/67665645 >> 172.21.15.120:0/67665645 conn(0x7f3ad00bd210 msgr2=0x7f3ad00bd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:25.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.383+0000 7f3ad87f0640 1 -- 172.21.15.120:0/67665645 shutdown_connections 2023-12-19T05:39:25.385 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.383+0000 7f3ad87f0640 1 -- 172.21.15.120:0/67665645 wait complete. 2023-12-19T05:39:25.398 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T05:39:25.499 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.498+0000 7f3f35d00640 1 Processor -- start 2023-12-19T05:39:25.500 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.498+0000 7f3f35d00640 1 -- start start 2023-12-19T05:39:25.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f35d00640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f3f30144d70 0x7f3f300b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f35d00640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3f300bc7e0 0x7f3f300bcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f35d00640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f30145150 con 0x7f3f3014df70 2023-12-19T05:39:25.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f35d00640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f300b9f00 con 0x7f3f300bc7e0 2023-12-19T05:39:25.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f35d00640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f300b84b0 con 0x7f3f30144d70 2023-12-19T05:39:25.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f2ffff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3f300bc7e0 0x7f3f300bcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f2ffff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f3f300bc7e0 0x7f3f300bcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52746/0 (socket says 172.21.15.120:52746) 2023-12-19T05:39:25.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f27fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f3f3014df70 0x7f3f300b8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40936/0 (socket says 172.21.15.120:40936) 2023-12-19T05:39:25.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f2ffff640 1 -- 172.21.15.120:0/2648572381 learned_addr learned my addr 172.21.15.120:0/2648572381 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:25.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f2f7fe640 1 --2- 172.21.15.120:0/2648572381 >> v2:172.21.15.155:3300/0 conn(0x7f3f30144d70 0x7f3f300b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.502 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f2ffff640 1 -- 172.21.15.120:0/2648572381 >> v2:172.21.15.155:3300/0 conn(0x7f3f30144d70 msgr2=0x7f3f300b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.502 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f2ffff640 1 --2- 172.21.15.120:0/2648572381 >> v2:172.21.15.155:3300/0 conn(0x7f3f30144d70 0x7f3f300b7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.502 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f2ffff640 1 -- 172.21.15.120:0/2648572381 >> v1:172.21.15.120:6789/0 conn(0x7f3f3014df70 legacy=0x7f3f300b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.502 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f2ffff640 1 -- 172.21.15.120:0/2648572381 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f300b9080 con 0x7f3f300bc7e0 2023-12-19T05:39:25.502 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.499+0000 7f3f2effd640 1 -- 172.21.15.120:0/2648572381 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745340342 0 0) 0x7f3f30145150 con 0x7f3f3014df70 2023-12-19T05:39:25.502 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.500+0000 7f3f2ffff640 1 --2- 172.21.15.120:0/2648572381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f300bc7e0 0x7f3f300bcc00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3f300c1400 tx=0x7f3f2802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b537998c55a80f30 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.500+0000 7f3f2effd640 1 -- 172.21.15.120:0/2648572381 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2802cbb0 con 0x7f3f300bc7e0 2023-12-19T05:39:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.500+0000 7f3f2effd640 1 -- 172.21.15.120:0/2648572381 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2802cd10 con 0x7f3f300bc7e0 2023-12-19T05:39:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.500+0000 7f3f2effd640 1 -- 172.21.15.120:0/2648572381 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28034610 con 0x7f3f300bc7e0 2023-12-19T05:39:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.501+0000 7f3f35d00640 1 -- 172.21.15.120:0/2648572381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f300bc7e0 msgr2=0x7f3f300bcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.501+0000 7f3f35d00640 1 --2- 172.21.15.120:0/2648572381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f300bc7e0 0x7f3f300bcc00 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3f300c1400 tx=0x7f3f2802c010 comp rx=0 tx=0).stop 2023-12-19T05:39:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.501+0000 7f3f35d00640 1 -- 172.21.15.120:0/2648572381 shutdown_connections 2023-12-19T05:39:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.501+0000 7f3f35d00640 1 --2- 172.21.15.120:0/2648572381 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f300bc7e0 0x7f3f300bcc00 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.501+0000 7f3f35d00640 1 --2- 172.21.15.120:0/2648572381 >> v2:172.21.15.155:3300/0 conn(0x7f3f30144d70 0x7f3f300b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.501+0000 7f3f35d00640 1 -- 172.21.15.120:0/2648572381 >> 172.21.15.120:0/2648572381 conn(0x7f3f30071430 msgr2=0x7f3f30071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.501+0000 7f3f35d00640 1 -- 172.21.15.120:0/2648572381 shutdown_connections 2023-12-19T05:39:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.501+0000 7f3f35d00640 1 -- 172.21.15.120:0/2648572381 wait complete. 2023-12-19T05:39:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.502+0000 7f3f35d00640 1 Processor -- start 2023-12-19T05:39:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.502+0000 7f3f35d00640 1 -- start start 2023-12-19T05:39:25.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.502+0000 7f3f35d00640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f300bc7e0 0x7f3f300b5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.502+0000 7f3f35d00640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f30144d70 0x7f3f300ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.502+0000 7f3f35d00640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f3014df70 0x7f3f30146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.502+0000 7f3f35d00640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f300b5790 con 0x7f3f300bc7e0 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.502+0000 7f3f35d00640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f301471a0 con 0x7f3f3014df70 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.502+0000 7f3f35d00640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f30145c80 con 0x7f3f30144d70 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f2f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f300bc7e0 0x7f3f300b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f2f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f300bc7e0 0x7f3f300b5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52756/0 (socket says 172.21.15.120:52756) 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f2f7fe640 1 -- 172.21.15.120:0/2127539454 learned_addr learned my addr 172.21.15.120:0/2127539454 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f2ffff640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f3014df70 0x7f3f30146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f27fff640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f30144d70 0x7f3f300ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f2f7fe640 1 -- 172.21.15.120:0/2127539454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f30144d70 msgr2=0x7f3f300ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f2f7fe640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f30144d70 0x7f3f300ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f2f7fe640 1 -- 172.21.15.120:0/2127539454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f3014df70 msgr2=0x7f3f30146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f2f7fe640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f3014df70 0x7f3f30146290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.506 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f2f7fe640 1 -- 172.21.15.120:0/2127539454 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f28009b30 con 0x7f3f300bc7e0 2023-12-19T05:39:25.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f27fff640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f30144d70 0x7f3f300ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:25.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f2f7fe640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f300bc7e0 0x7f3f300b5250 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000ea10 tx=0x7f3f2000eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f2cff9640 1 -- 172.21.15.120:0/2127539454 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20009670 con 0x7f3f300bc7e0 2023-12-19T05:39:25.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f2cff9640 1 -- 172.21.15.120:0/2127539454 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2000ca00 con 0x7f3f300bc7e0 2023-12-19T05:39:25.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f35d00640 1 -- 172.21.15.120:0/2127539454 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f301459e0 con 0x7f3f300bc7e0 2023-12-19T05:39:25.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f2cff9640 1 -- 172.21.15.120:0/2127539454 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2000cdb0 con 0x7f3f300bc7e0 2023-12-19T05:39:25.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.503+0000 7f3f35d00640 1 -- 172.21.15.120:0/2127539454 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f30147bd0 con 0x7f3f300bc7e0 2023-12-19T05:39:25.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.504+0000 7f3f35d00640 1 -- 172.21.15.120:0/2127539454 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f30147820 con 0x7f3f300bc7e0 2023-12-19T05:39:25.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.505+0000 7f3f2cff9640 1 -- 172.21.15.120:0/2127539454 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f20013470 con 0x7f3f300bc7e0 2023-12-19T05:39:25.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.505+0000 7f3f2cff9640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f3f1006a430 0x7f3f1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.505+0000 7f3f27fff640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f3f1006a430 0x7f3f1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.505+0000 7f3f2cff9640 1 -- 172.21.15.120:0/2127539454 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f20088db0 con 0x7f3f300bc7e0 2023-12-19T05:39:25.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.505+0000 7f3f27fff640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f3f1006a430 0x7f3f1006c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3f300b1f30 tx=0x7f3f18007ca0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.509+0000 7f3f2cff9640 1 -- 172.21.15.120:0/2127539454 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f3f200544e0 con 0x7f3f300bc7e0 2023-12-19T05:39:25.674 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.673+0000 7f3f35d00640 1 -- 172.21.15.120:0/2127539454 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3f3004e080 con 0x7f3f300bc7e0 2023-12-19T05:39:25.674 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.673+0000 7f3f2cff9640 1 -- 172.21.15.120:0/2127539454 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3f20057b00 con 0x7f3f300bc7e0 2023-12-19T05:39:25.674 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2023-12-19T05:39:25.676 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.675+0000 7f3f35d00640 1 -- 172.21.15.120:0/2127539454 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f3f1006a430 msgr2=0x7f3f1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.676 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.675+0000 7f3f35d00640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f3f1006a430 0x7f3f1006c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3f300b1f30 tx=0x7f3f18007ca0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.676 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.675+0000 7f3f35d00640 1 -- 172.21.15.120:0/2127539454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f300bc7e0 msgr2=0x7f3f300b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.677 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.675+0000 7f3f35d00640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f300bc7e0 0x7f3f300b5250 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000ea10 tx=0x7f3f2000eed0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.677 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.675+0000 7f3f35d00640 1 -- 172.21.15.120:0/2127539454 shutdown_connections 2023-12-19T05:39:25.677 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.675+0000 7f3f35d00640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f3f1006a430 0x7f3f1006c8f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.677 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.675+0000 7f3f35d00640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f3014df70 0x7f3f30146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.677 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.675+0000 7f3f35d00640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f3f30144d70 0x7f3f300ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.677 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.675+0000 7f3f35d00640 1 --2- 172.21.15.120:0/2127539454 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f3f300bc7e0 0x7f3f300b5250 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.677 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.675+0000 7f3f35d00640 1 -- 172.21.15.120:0/2127539454 >> 172.21.15.120:0/2127539454 conn(0x7f3f30071430 msgr2=0x7f3f300b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:25.677 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.675+0000 7f3f35d00640 1 -- 172.21.15.120:0/2127539454 shutdown_connections 2023-12-19T05:39:25.677 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.675+0000 7f3f35d00640 1 -- 172.21.15.120:0/2127539454 wait complete. 2023-12-19T05:39:25.687 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:39:25.789 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.786+0000 7f922283e640 1 Processor -- start 2023-12-19T05:39:25.789 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.786+0000 7f922283e640 1 -- start start 2023-12-19T05:39:25.789 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.787+0000 7f922283e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f921c0b79b0 0x7f921c0b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.789 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.787+0000 7f922283e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f921c0b8860 0x7f921c144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.789 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.787+0000 7f922283e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921c0b96b0 con 0x7f921c145010 2023-12-19T05:39:25.789 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.787+0000 7f922283e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921c14ae10 con 0x7f921c0b79b0 2023-12-19T05:39:25.790 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.787+0000 7f922283e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921c0bacc0 con 0x7f921c0b8860 2023-12-19T05:39:25.790 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.787+0000 7f921bfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f921c0b79b0 0x7f921c0b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.790 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.787+0000 7f921bfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f921c0b79b0 0x7f921c0b7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52764/0 (socket says 172.21.15.120:52764) 2023-12-19T05:39:25.790 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.787+0000 7f921bfff640 1 -- 172.21.15.120:0/358633728 learned_addr learned my addr 172.21.15.120:0/358633728 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:25.790 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.787+0000 7f921bfff640 1 -- 172.21.15.120:0/358633728 >> v2:172.21.15.155:3300/0 conn(0x7f921c0b8860 msgr2=0x7f921c144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.790 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.787+0000 7f921b7fe640 1 --2- 172.21.15.120:0/358633728 >> v2:172.21.15.155:3300/0 conn(0x7f921c0b8860 0x7f921c144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.790 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.787+0000 7f921bfff640 1 --2- 172.21.15.120:0/358633728 >> v2:172.21.15.155:3300/0 conn(0x7f921c0b8860 0x7f921c144ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.790 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.787+0000 7f921bfff640 1 -- 172.21.15.120:0/358633728 >> v1:172.21.15.155:6789/0 conn(0x7f921c145010 legacy=0x7f921c14b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:25.790 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.787+0000 7f921bfff640 1 -- 172.21.15.120:0/358633728 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0b90f0 con 0x7f921c0b79b0 2023-12-19T05:39:25.790 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.788+0000 7f921bfff640 1 --2- 172.21.15.120:0/358633728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f921c0b79b0 0x7f921c0b7d90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f921c066740 tx=0x7f920c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6608c16bfbf867 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.790 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.788+0000 7f921affd640 1 -- 172.21.15.120:0/358633728 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c031870 con 0x7f921c0b79b0 2023-12-19T05:39:25.790 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.788+0000 7f921affd640 1 -- 172.21.15.120:0/358633728 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c0319d0 con 0x7f921c0b79b0 2023-12-19T05:39:25.791 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.788+0000 7f921affd640 1 -- 172.21.15.120:0/358633728 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c031d60 con 0x7f921c0b79b0 2023-12-19T05:39:25.794 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.788+0000 7f922283e640 1 -- 172.21.15.120:0/358633728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f921c0b79b0 msgr2=0x7f921c0b7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.794 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.788+0000 7f922283e640 1 --2- 172.21.15.120:0/358633728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f921c0b79b0 0x7f921c0b7d90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f921c066740 tx=0x7f920c02b910 comp rx=0 tx=0).stop 2023-12-19T05:39:25.794 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.789+0000 7f922283e640 1 -- 172.21.15.120:0/358633728 shutdown_connections 2023-12-19T05:39:25.794 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.789+0000 7f922283e640 1 --2- 172.21.15.120:0/358633728 >> v2:172.21.15.155:3300/0 conn(0x7f921c0b8860 0x7f921c144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.795 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.789+0000 7f922283e640 1 --2- 172.21.15.120:0/358633728 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f921c0b79b0 0x7f921c0b7d90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.795 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.789+0000 7f922283e640 1 -- 172.21.15.120:0/358633728 >> 172.21.15.120:0/358633728 conn(0x7f921c0c0340 msgr2=0x7f921c0c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:25.795 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.789+0000 7f922283e640 1 -- 172.21.15.120:0/358633728 shutdown_connections 2023-12-19T05:39:25.795 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.789+0000 7f922283e640 1 -- 172.21.15.120:0/358633728 wait complete. 2023-12-19T05:39:25.795 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.790+0000 7f922283e640 1 Processor -- start 2023-12-19T05:39:25.795 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.790+0000 7f922283e640 1 -- start start 2023-12-19T05:39:25.795 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.790+0000 7f922283e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f921c0b79b0 0x7f921c1495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.795 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.790+0000 7f922283e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f921c0b8860 0x7f921c1d5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.795 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.790+0000 7f922283e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f921c145010 0x7f921c1d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.795 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.790+0000 7f922283e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c149b10 con 0x7f921c0b8860 2023-12-19T05:39:25.795 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.790+0000 7f922283e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c1d6c50 con 0x7f921c145010 2023-12-19T05:39:25.795 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.790+0000 7f922283e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921c1d6ec0 con 0x7f921c0b79b0 2023-12-19T05:39:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.790+0000 7f921b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f921c0b8860 0x7f921c1d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f921b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f921c0b8860 0x7f921c1d5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52772/0 (socket says 172.21.15.120:52772) 2023-12-19T05:39:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f921b7fe640 1 -- 172.21.15.120:0/1707245239 learned_addr learned my addr 172.21.15.120:0/1707245239 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f9220ddb640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f921c145010 0x7f921c1d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f921bfff640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f921c0b79b0 0x7f921c1495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f921b7fe640 1 -- 172.21.15.120:0/1707245239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f921c0b79b0 msgr2=0x7f921c1495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f921b7fe640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f921c0b79b0 0x7f921c1495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f921b7fe640 1 -- 172.21.15.120:0/1707245239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f921c145010 msgr2=0x7f921c1d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f921b7fe640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f921c145010 0x7f921c1d1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f921b7fe640 1 -- 172.21.15.120:0/1707245239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c0094d0 con 0x7f921c0b8860 2023-12-19T05:39:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f9220ddb640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f921c145010 0x7f921c1d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f921b7fe640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f921c0b8860 0x7f921c1d5d60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f921000c820 tx=0x7f921000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.796 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f9218ff9640 1 -- 172.21.15.120:0/1707245239 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210004220 con 0x7f921c0b8860 2023-12-19T05:39:25.797 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f9218ff9640 1 -- 172.21.15.120:0/1707245239 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92100043a0 con 0x7f921c0b8860 2023-12-19T05:39:25.797 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f922283e640 1 -- 172.21.15.120:0/1707245239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921c1d71a0 con 0x7f921c0b8860 2023-12-19T05:39:25.797 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f9218ff9640 1 -- 172.21.15.120:0/1707245239 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210007a70 con 0x7f921c0b8860 2023-12-19T05:39:25.797 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.791+0000 7f922283e640 1 -- 172.21.15.120:0/1707245239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921c0b3b40 con 0x7f921c0b8860 2023-12-19T05:39:25.797 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.792+0000 7f922283e640 1 -- 172.21.15.120:0/1707245239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921c1d76c0 con 0x7f921c0b8860 2023-12-19T05:39:25.797 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.792+0000 7f9218ff9640 1 -- 172.21.15.120:0/1707245239 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9210007bd0 con 0x7f921c0b8860 2023-12-19T05:39:25.797 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.793+0000 7f9218ff9640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f920806a460 0x7f920806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:25.797 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.793+0000 7f9218ff9640 1 -- 172.21.15.120:0/1707245239 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9210088610 con 0x7f921c0b8860 2023-12-19T05:39:25.797 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.793+0000 7f921bfff640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f920806a460 0x7f920806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:25.797 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.793+0000 7f921bfff640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f920806a460 0x7f920806c920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f920c036000 tx=0x7f920c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:25.798 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.797+0000 7f9218ff9640 1 -- 172.21.15.120:0/1707245239 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f921c1d76c0 con 0x7f921c0b8860 2023-12-19T05:39:26.000 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:25.999+0000 7f922283e640 1 -- 172.21.15.120:0/1707245239 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f921c1d76c0 con 0x7f921c0b8860 2023-12-19T05:39:26.001 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.000+0000 7f9218ff9640 1 -- 172.21.15.120:0/1707245239 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3892 (secure 0 0 0) 0x7f921c1d76c0 con 0x7f921c0b8860 2023-12-19T05:39:26.001 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:26.001 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/753508604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":753508604},{"type":"v1","addr":"172.21.15.155:6833","nonce":753508604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/3314096579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":3314096579},{"type":"v1","addr":"172.21.15.120:6836","nonce":3314096579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:38:58.081682+0000","modified":"2023-12-19T05:39:00.753884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/1608902018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":1608902018},{"type":"v1","addr":"172.21.15.120:6837","nonce":1608902018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:39:26.001 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2023-12-19T05:39:26.003 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.001+0000 7f922283e640 1 -- 172.21.15.120:0/1707245239 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f920806a460 msgr2=0x7f920806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.003 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.001+0000 7f922283e640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f920806a460 0x7f920806c920 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f920c036000 tx=0x7f920c03c040 comp rx=0 tx=0).stop 2023-12-19T05:39:26.003 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.001+0000 7f922283e640 1 -- 172.21.15.120:0/1707245239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f921c0b8860 msgr2=0x7f921c1d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.003 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.001+0000 7f922283e640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f921c0b8860 0x7f921c1d5d60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f921000c820 tx=0x7f921000cce0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.003 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.001+0000 7f922283e640 1 -- 172.21.15.120:0/1707245239 shutdown_connections 2023-12-19T05:39:26.004 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.001+0000 7f922283e640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f920806a460 0x7f920806c920 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.004 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.001+0000 7f922283e640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f921c145010 0x7f921c1d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.004 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.001+0000 7f922283e640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f921c0b8860 0x7f921c1d5d60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.004 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.001+0000 7f922283e640 1 --2- 172.21.15.120:0/1707245239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f921c0b79b0 0x7f921c1495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.004 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.002+0000 7f922283e640 1 -- 172.21.15.120:0/1707245239 >> 172.21.15.120:0/1707245239 conn(0x7f921c0c0340 msgr2=0x7f921c0bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:26.004 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.002+0000 7f922283e640 1 -- 172.21.15.120:0/1707245239 shutdown_connections 2023-12-19T05:39:26.004 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.002+0000 7f922283e640 1 -- 172.21.15.120:0/1707245239 wait complete. 2023-12-19T05:39:26.013 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:26.112 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.111+0000 7f12999b9640 1 Processor -- start 2023-12-19T05:39:26.113 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.111+0000 7f12999b9640 1 -- start start 2023-12-19T05:39:26.115 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f12999b9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12940b7d90 0x7f1294144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.115 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f12999b9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f1294145010 0x7f129414b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.115 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f12999b9640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12940b96b0 con 0x7f12940b79b0 2023-12-19T05:39:26.115 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f12999b9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129414ae10 con 0x7f1294145010 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f12999b9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12940bacc0 con 0x7f12940b7d90 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f1292ffd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f12940b79b0 0x7f12940b8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40952/0 (socket says 172.21.15.120:40952) 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f1292ffd640 1 -- 172.21.15.120:0/480265897 learned_addr learned my addr 172.21.15.120:0/480265897 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f12937fe640 1 --2- 172.21.15.120:0/480265897 >> v2:172.21.15.155:3300/0 conn(0x7f1294145010 0x7f129414b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f12927fc640 1 --2- 172.21.15.120:0/480265897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12940b7d90 0x7f1294144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f1291ffb640 1 -- 172.21.15.120:0/480265897 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247866866 0 0) 0x7f12940b96b0 con 0x7f12940b79b0 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f1291ffb640 1 -- 172.21.15.120:0/480265897 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f127c003520 con 0x7f12940b79b0 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f1291ffb640 1 -- 172.21.15.120:0/480265897 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3784906464 0 0) 0x7f127c003520 con 0x7f12940b79b0 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f12927fc640 1 -- 172.21.15.120:0/480265897 >> v2:172.21.15.155:3300/0 conn(0x7f1294145010 msgr2=0x7f129414b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f12927fc640 1 --2- 172.21.15.120:0/480265897 >> v2:172.21.15.155:3300/0 conn(0x7f1294145010 0x7f129414b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f12927fc640 1 -- 172.21.15.120:0/480265897 >> v1:172.21.15.120:6789/0 conn(0x7f12940b79b0 legacy=0x7f12940b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f12927fc640 1 -- 172.21.15.120:0/480265897 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12940b81d0 con 0x7f12940b7d90 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.112+0000 7f12937fe640 1 --2- 172.21.15.120:0/480265897 >> v2:172.21.15.155:3300/0 conn(0x7f1294145010 0x7f129414b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.113+0000 7f12927fc640 1 --2- 172.21.15.120:0/480265897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12940b7d90 0x7f1294144ad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f12880097a0 tx=0x7f128802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78cd6a4988c619e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:26.116 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.113+0000 7f1291ffb640 1 -- 172.21.15.120:0/480265897 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12840019f0 con 0x7f12940b7d90 2023-12-19T05:39:26.117 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.113+0000 7f1291ffb640 1 -- 172.21.15.120:0/480265897 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128802e050 con 0x7f12940b7d90 2023-12-19T05:39:26.117 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.113+0000 7f1291ffb640 1 -- 172.21.15.120:0/480265897 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288030710 con 0x7f12940b7d90 2023-12-19T05:39:26.117 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.114+0000 7f12999b9640 1 -- 172.21.15.120:0/480265897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12940b7d90 msgr2=0x7f1294144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.117 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.114+0000 7f12999b9640 1 --2- 172.21.15.120:0/480265897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12940b7d90 0x7f1294144ad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f12880097a0 tx=0x7f128802b790 comp rx=0 tx=0).stop 2023-12-19T05:39:26.117 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.114+0000 7f12999b9640 1 -- 172.21.15.120:0/480265897 shutdown_connections 2023-12-19T05:39:26.117 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.114+0000 7f12999b9640 1 --2- 172.21.15.120:0/480265897 >> v2:172.21.15.155:3300/0 conn(0x7f1294145010 0x7f129414b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.117 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.114+0000 7f12999b9640 1 --2- 172.21.15.120:0/480265897 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12940b7d90 0x7f1294144ad0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.117 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.114+0000 7f12999b9640 1 -- 172.21.15.120:0/480265897 >> 172.21.15.120:0/480265897 conn(0x7f12940c0340 msgr2=0x7f12940c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:26.117 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.114+0000 7f12999b9640 1 -- 172.21.15.120:0/480265897 shutdown_connections 2023-12-19T05:39:26.117 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.114+0000 7f12999b9640 1 -- 172.21.15.120:0/480265897 wait complete. 2023-12-19T05:39:26.120 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.115+0000 7f12999b9640 1 Processor -- start 2023-12-19T05:39:26.120 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.115+0000 7f12999b9640 1 -- start start 2023-12-19T05:39:26.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12999b9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12940b79b0 0x7f12940b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12999b9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12940b7d90 0x7f12940b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12999b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1294145010 0x7f12940b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12999b9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1294144c60 con 0x7f1294145010 2023-12-19T05:39:26.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12999b9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12941d2870 con 0x7f12940b79b0 2023-12-19T05:39:26.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12999b9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12940b1590 con 0x7f12940b7d90 2023-12-19T05:39:26.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12937fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1294145010 0x7f12940b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12937fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1294145010 0x7f12940b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52786/0 (socket says 172.21.15.120:52786) 2023-12-19T05:39:26.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12937fe640 1 -- 172.21.15.120:0/2809638131 learned_addr learned my addr 172.21.15.120:0/2809638131 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:26.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f1292ffd640 1 --2- 172.21.15.120:0/2809638131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12940b79b0 0x7f12940b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12927fc640 1 --2- 172.21.15.120:0/2809638131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12940b7d90 0x7f12940b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12937fe640 1 -- 172.21.15.120:0/2809638131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12940b7d90 msgr2=0x7f12940b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12937fe640 1 --2- 172.21.15.120:0/2809638131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12940b7d90 0x7f12940b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.121 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12937fe640 1 -- 172.21.15.120:0/2809638131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12940b79b0 msgr2=0x7f12940b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12937fe640 1 --2- 172.21.15.120:0/2809638131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12940b79b0 0x7f12940b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12937fe640 1 -- 172.21.15.120:0/2809638131 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c009400 con 0x7f1294145010 2023-12-19T05:39:26.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12937fe640 1 --2- 172.21.15.120:0/2809638131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1294145010 0x7f12940b2d80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f128c00e850 tx=0x7f128c00ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:26.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f127bfff640 1 -- 172.21.15.120:0/2809638131 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c009640 con 0x7f1294145010 2023-12-19T05:39:26.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f127bfff640 1 -- 172.21.15.120:0/2809638131 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c00c940 con 0x7f1294145010 2023-12-19T05:39:26.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12999b9640 1 -- 172.21.15.120:0/2809638131 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1288009400 con 0x7f1294145010 2023-12-19T05:39:26.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f127bfff640 1 -- 172.21.15.120:0/2809638131 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c00ccb0 con 0x7f1294145010 2023-12-19T05:39:26.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.116+0000 7f12999b9640 1 -- 172.21.15.120:0/2809638131 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12941d2220 con 0x7f1294145010 2023-12-19T05:39:26.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.117+0000 7f12999b9640 1 -- 172.21.15.120:0/2809638131 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12941d2080 con 0x7f1294145010 2023-12-19T05:39:26.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.118+0000 7f127bfff640 1 -- 172.21.15.120:0/2809638131 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f128c013470 con 0x7f1294145010 2023-12-19T05:39:26.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.118+0000 7f127bfff640 1 --2- 172.21.15.120:0/2809638131 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f128006a460 0x7f128006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.118+0000 7f1292ffd640 1 --2- 172.21.15.120:0/2809638131 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f128006a460 0x7f128006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.118+0000 7f127bfff640 1 -- 172.21.15.120:0/2809638131 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f128c088970 con 0x7f1294145010 2023-12-19T05:39:26.122 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.119+0000 7f1292ffd640 1 --2- 172.21.15.120:0/2809638131 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f128006a460 0x7f128006c920 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f128400f440 tx=0x7f1284009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:26.123 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.123+0000 7f127bfff640 1 -- 172.21.15.120:0/2809638131 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f12941d2080 con 0x7f1294145010 2023-12-19T05:39:26.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.291+0000 7f12999b9640 1 -- 172.21.15.120:0/2809638131 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12941d2080 con 0x7f1294145010 2023-12-19T05:39:26.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.292+0000 7f127bfff640 1 -- 172.21.15.120:0/2809638131 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f12941d2080 con 0x7f1294145010 2023-12-19T05:39:26.293 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:26.293 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.294+0000 7f12999b9640 1 -- 172.21.15.120:0/2809638131 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f128006a460 msgr2=0x7f128006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.294+0000 7f12999b9640 1 --2- 172.21.15.120:0/2809638131 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f128006a460 0x7f128006c920 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f128400f440 tx=0x7f1284009040 comp rx=0 tx=0).stop 2023-12-19T05:39:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.294+0000 7f12999b9640 1 -- 172.21.15.120:0/2809638131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1294145010 msgr2=0x7f12940b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.294+0000 7f12999b9640 1 --2- 172.21.15.120:0/2809638131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1294145010 0x7f12940b2d80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f128c00e850 tx=0x7f128c00ed10 comp rx=0 tx=0).stop 2023-12-19T05:39:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.294+0000 7f12999b9640 1 -- 172.21.15.120:0/2809638131 shutdown_connections 2023-12-19T05:39:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.294+0000 7f12999b9640 1 --2- 172.21.15.120:0/2809638131 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f128006a460 0x7f128006c920 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.294+0000 7f12999b9640 1 --2- 172.21.15.120:0/2809638131 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f1294145010 0x7f12940b2d80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.294+0000 7f12999b9640 1 --2- 172.21.15.120:0/2809638131 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f12940b7d90 0x7f12940b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.294+0000 7f12999b9640 1 --2- 172.21.15.120:0/2809638131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f12940b79b0 0x7f12940b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.294+0000 7f12999b9640 1 -- 172.21.15.120:0/2809638131 >> 172.21.15.120:0/2809638131 conn(0x7f12940c0340 msgr2=0x7f12940bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:26.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.294+0000 7f12999b9640 1 -- 172.21.15.120:0/2809638131 shutdown_connections 2023-12-19T05:39:26.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.294+0000 7f12999b9640 1 -- 172.21.15.120:0/2809638131 wait complete. 2023-12-19T05:39:26.306 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T05:39:26.306 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:39:26.404 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.403+0000 7f159070a640 1 Processor -- start 2023-12-19T05:39:26.404 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.403+0000 7f159070a640 1 -- start start 2023-12-19T05:39:26.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.404+0000 7f159070a640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f15880b79b0 0x7f15880b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.404+0000 7f159070a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15880b8860 0x7f1588144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.404+0000 7f159070a640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15880b96b0 con 0x7f1588145010 2023-12-19T05:39:26.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.404+0000 7f159070a640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158814ae10 con 0x7f15880b79b0 2023-12-19T05:39:26.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.404+0000 7f159070a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15880bacc0 con 0x7f15880b8860 2023-12-19T05:39:26.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.404+0000 7f158e4a6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f15880b79b0 0x7f15880b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.404+0000 7f158dca5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15880b8860 0x7f1588144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.404+0000 7f158e4a6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f15880b79b0 0x7f15880b7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:40096/0 (socket says 172.21.15.120:40096) 2023-12-19T05:39:26.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.404+0000 7f158e4a6640 1 -- 172.21.15.120:0/4279295813 learned_addr learned my addr 172.21.15.120:0/4279295813 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:26.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.404+0000 7f158eca7640 1 --1- 172.21.15.120:0/4279295813 >> v1:172.21.15.155:6789/0 conn(0x7f1588145010 0x7f158814b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:42676/0 (socket says 172.21.15.120:42676) 2023-12-19T05:39:26.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.404+0000 7f158dca5640 1 -- 172.21.15.120:0/4279295813 >> v2:172.21.15.155:3300/0 conn(0x7f15880b79b0 msgr2=0x7f15880b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:26.407 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.404+0000 7f158dca5640 1 --2- 172.21.15.120:0/4279295813 >> v2:172.21.15.155:3300/0 conn(0x7f15880b79b0 0x7f15880b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.407 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.405+0000 7f158dca5640 1 -- 172.21.15.120:0/4279295813 >> v1:172.21.15.155:6789/0 conn(0x7f1588145010 legacy=0x7f158814b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.407 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.405+0000 7f158dca5640 1 -- 172.21.15.120:0/4279295813 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15880b90f0 con 0x7f15880b8860 2023-12-19T05:39:26.411 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.405+0000 7f158dca5640 1 --2- 172.21.15.120:0/4279295813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15880b8860 0x7f1588144ad0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f15780097a0 tx=0x7f157802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52f54f45027a94a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:26.411 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.405+0000 7f158d4a4640 1 -- 172.21.15.120:0/4279295813 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578031830 con 0x7f15880b8860 2023-12-19T05:39:26.411 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.405+0000 7f158d4a4640 1 -- 172.21.15.120:0/4279295813 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1578031990 con 0x7f15880b8860 2023-12-19T05:39:26.411 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.405+0000 7f158d4a4640 1 -- 172.21.15.120:0/4279295813 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578031d20 con 0x7f15880b8860 2023-12-19T05:39:26.411 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.406+0000 7f159070a640 1 -- 172.21.15.120:0/4279295813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15880b8860 msgr2=0x7f1588144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.406+0000 7f159070a640 1 --2- 172.21.15.120:0/4279295813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15880b8860 0x7f1588144ad0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f15780097a0 tx=0x7f157802b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.406+0000 7f159070a640 1 -- 172.21.15.120:0/4279295813 shutdown_connections 2023-12-19T05:39:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.406+0000 7f159070a640 1 --2- 172.21.15.120:0/4279295813 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f15880b8860 0x7f1588144ad0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.406+0000 7f159070a640 1 --2- 172.21.15.120:0/4279295813 >> v2:172.21.15.155:3300/0 conn(0x7f15880b79b0 0x7f15880b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.406+0000 7f159070a640 1 -- 172.21.15.120:0/4279295813 >> 172.21.15.120:0/4279295813 conn(0x7f15880c0340 msgr2=0x7f15880c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.406+0000 7f159070a640 1 -- 172.21.15.120:0/4279295813 shutdown_connections 2023-12-19T05:39:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.406+0000 7f159070a640 1 -- 172.21.15.120:0/4279295813 wait complete. 2023-12-19T05:39:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.407+0000 7f159070a640 1 Processor -- start 2023-12-19T05:39:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.407+0000 7f159070a640 1 -- start start 2023-12-19T05:39:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f159070a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15880b79b0 0x7f1588136c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f159070a640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15880b8860 0x7f15881e0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f159070a640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1588145010 0x7f15880b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f159070a640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15881371a0 con 0x7f15880b8860 2023-12-19T05:39:26.412 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f159070a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1588138970 con 0x7f15880b79b0 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f159070a640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1588138c50 con 0x7f1588145010 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f158dca5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15880b8860 0x7f15881e0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f158dca5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15880b8860 0x7f15881e0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52802/0 (socket says 172.21.15.120:52802) 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f158dca5640 1 -- 172.21.15.120:0/559385997 learned_addr learned my addr 172.21.15.120:0/559385997 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f158e4a6640 1 --2- 172.21.15.120:0/559385997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15880b79b0 0x7f1588136c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f158eca7640 1 --2- 172.21.15.120:0/559385997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1588145010 0x7f15880b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f158dca5640 1 -- 172.21.15.120:0/559385997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1588145010 msgr2=0x7f15880b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f158dca5640 1 --2- 172.21.15.120:0/559385997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1588145010 0x7f15880b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f158dca5640 1 -- 172.21.15.120:0/559385997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15880b79b0 msgr2=0x7f1588136c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f158dca5640 1 --2- 172.21.15.120:0/559385997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15880b79b0 0x7f1588136c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f158dca5640 1 -- 172.21.15.120:0/559385997 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1578009400 con 0x7f15880b8860 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f158dca5640 1 --2- 172.21.15.120:0/559385997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15880b8860 0x7f15881e0a20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f157802bee0 tx=0x7f15780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f157effd640 1 -- 172.21.15.120:0/559385997 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157803a6f0 con 0x7f15880b8860 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f157effd640 1 -- 172.21.15.120:0/559385997 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157803a870 con 0x7f15880b8860 2023-12-19T05:39:26.413 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f159070a640 1 -- 172.21.15.120:0/559385997 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15881e0500 con 0x7f15880b8860 2023-12-19T05:39:26.414 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f157effd640 1 -- 172.21.15.120:0/559385997 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157803ac20 con 0x7f15880b8860 2023-12-19T05:39:26.414 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.408+0000 7f159070a640 1 -- 172.21.15.120:0/559385997 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1588139e40 con 0x7f15880b8860 2023-12-19T05:39:26.414 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.409+0000 7f159070a640 1 -- 172.21.15.120:0/559385997 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1588066290 con 0x7f15880b8860 2023-12-19T05:39:26.414 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.410+0000 7f157effd640 1 -- 172.21.15.120:0/559385997 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f157804c3b0 con 0x7f15880b8860 2023-12-19T05:39:26.414 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.410+0000 7f157effd640 1 --2- 172.21.15.120:0/559385997 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f156c06a460 0x7f156c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.416 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.410+0000 7f158e4a6640 1 --2- 172.21.15.120:0/559385997 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f156c06a460 0x7f156c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.416 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.410+0000 7f157effd640 1 -- 172.21.15.120:0/559385997 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15780aa4f0 con 0x7f15880b8860 2023-12-19T05:39:26.417 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.411+0000 7f158e4a6640 1 --2- 172.21.15.120:0/559385997 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f156c06a460 0x7f156c06c920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f15840113e0 tx=0x7f158400b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:26.417 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.414+0000 7f157effd640 1 -- 172.21.15.120:0/559385997 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f1578075b00 con 0x7f15880b8860 2023-12-19T05:39:26.615 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.614+0000 7f159070a640 1 -- 172.21.15.120:0/559385997 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f158804e080 con 0x7f15880b8860 2023-12-19T05:39:26.616 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.615+0000 7f157effd640 1 -- 172.21.15.120:0/559385997 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3892 (secure 0 0 0) 0x7f1578079120 con 0x7f15880b8860 2023-12-19T05:39:26.616 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:26.616 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/753508604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":753508604},{"type":"v1","addr":"172.21.15.155:6833","nonce":753508604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/3314096579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":3314096579},{"type":"v1","addr":"172.21.15.120:6836","nonce":3314096579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:38:58.081682+0000","modified":"2023-12-19T05:39:00.753884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/1608902018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":1608902018},{"type":"v1","addr":"172.21.15.120:6837","nonce":1608902018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:39:26.617 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2023-12-19T05:39:26.618 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.617+0000 7f159070a640 1 -- 172.21.15.120:0/559385997 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f156c06a460 msgr2=0x7f156c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.618 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.617+0000 7f159070a640 1 --2- 172.21.15.120:0/559385997 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f156c06a460 0x7f156c06c920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f15840113e0 tx=0x7f158400b040 comp rx=0 tx=0).stop 2023-12-19T05:39:26.618 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.617+0000 7f159070a640 1 -- 172.21.15.120:0/559385997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15880b8860 msgr2=0x7f15881e0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.618 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.617+0000 7f159070a640 1 --2- 172.21.15.120:0/559385997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15880b8860 0x7f15881e0a20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f157802bee0 tx=0x7f15780046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.618 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.617+0000 7f159070a640 1 -- 172.21.15.120:0/559385997 shutdown_connections 2023-12-19T05:39:26.618 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.617+0000 7f159070a640 1 --2- 172.21.15.120:0/559385997 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f156c06a460 0x7f156c06c920 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.619 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.617+0000 7f159070a640 1 --2- 172.21.15.120:0/559385997 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f1588145010 0x7f15880b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.619 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.617+0000 7f159070a640 1 --2- 172.21.15.120:0/559385997 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f15880b8860 0x7f15881e0a20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.619 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.617+0000 7f159070a640 1 --2- 172.21.15.120:0/559385997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15880b79b0 0x7f1588136c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.619 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.617+0000 7f159070a640 1 -- 172.21.15.120:0/559385997 >> 172.21.15.120:0/559385997 conn(0x7f15880c0340 msgr2=0x7f15880be9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:26.619 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.617+0000 7f159070a640 1 -- 172.21.15.120:0/559385997 shutdown_connections 2023-12-19T05:39:26.619 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.617+0000 7f159070a640 1 -- 172.21.15.120:0/559385997 wait complete. 2023-12-19T05:39:26.629 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:39:26.729 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.728+0000 7f871c377640 1 Processor -- start 2023-12-19T05:39:26.729 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.728+0000 7f871c377640 1 -- start start 2023-12-19T05:39:26.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.729+0000 7f871c377640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8714144d60 0x7f871406d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.729+0000 7f871c377640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f871406ae10 0x7f871414b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.729+0000 7f871c377640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87140bbb60 con 0x7f871414b700 2023-12-19T05:39:26.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.729+0000 7f871c377640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871406b980 con 0x7f8714144d60 2023-12-19T05:39:26.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.729+0000 7f871c377640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871414aa40 con 0x7f871406ae10 2023-12-19T05:39:26.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.729+0000 7f871a113640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8714144d60 0x7f871406d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.729+0000 7f8719912640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f871406ae10 0x7f871414b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.729+0000 7f871a113640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f8714144d60 0x7f871406d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:40122/0 (socket says 172.21.15.120:40122) 2023-12-19T05:39:26.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.729+0000 7f871a113640 1 -- 172.21.15.120:0/3504878776 learned_addr learned my addr 172.21.15.120:0/3504878776 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:26.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.729+0000 7f871a914640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f871414b700 0x7f871414df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:42688/0 (socket says 172.21.15.120:42688) 2023-12-19T05:39:26.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.729+0000 7f8719912640 1 -- 172.21.15.120:0/3504878776 >> v2:172.21.15.155:3300/0 conn(0x7f8714144d60 msgr2=0x7f871406d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:26.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.729+0000 7f8719912640 1 --2- 172.21.15.120:0/3504878776 >> v2:172.21.15.155:3300/0 conn(0x7f8714144d60 0x7f871406d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.731 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.729+0000 7f8719912640 1 -- 172.21.15.120:0/3504878776 >> v1:172.21.15.155:6789/0 conn(0x7f871414b700 legacy=0x7f871414df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.732 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.729+0000 7f8719912640 1 -- 172.21.15.120:0/3504878776 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87140b8b10 con 0x7f871406ae10 2023-12-19T05:39:26.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.730+0000 7f8719912640 1 --2- 172.21.15.120:0/3504878776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f871406ae10 0x7f871414b1c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f87040097a0 tx=0x7f870402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a60dca870eac163 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:26.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.730+0000 7f8719111640 1 -- 172.21.15.120:0/3504878776 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704030610 con 0x7f871406ae10 2023-12-19T05:39:26.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.730+0000 7f8719111640 1 -- 172.21.15.120:0/3504878776 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8704030770 con 0x7f871406ae10 2023-12-19T05:39:26.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.730+0000 7f8719111640 1 -- 172.21.15.120:0/3504878776 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704030b00 con 0x7f871406ae10 2023-12-19T05:39:26.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.731+0000 7f871c377640 1 -- 172.21.15.120:0/3504878776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f871406ae10 msgr2=0x7f871414b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.731+0000 7f871c377640 1 --2- 172.21.15.120:0/3504878776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f871406ae10 0x7f871414b1c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f87040097a0 tx=0x7f870402b960 comp rx=0 tx=0).stop 2023-12-19T05:39:26.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.731+0000 7f871c377640 1 -- 172.21.15.120:0/3504878776 shutdown_connections 2023-12-19T05:39:26.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.731+0000 7f871c377640 1 --2- 172.21.15.120:0/3504878776 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f871406ae10 0x7f871414b1c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.733 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.731+0000 7f871c377640 1 --2- 172.21.15.120:0/3504878776 >> v2:172.21.15.155:3300/0 conn(0x7f8714144d60 0x7f871406d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.734 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.731+0000 7f871c377640 1 -- 172.21.15.120:0/3504878776 >> 172.21.15.120:0/3504878776 conn(0x7f87140bac10 msgr2=0x7f87140bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:26.734 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.731+0000 7f871c377640 1 -- 172.21.15.120:0/3504878776 shutdown_connections 2023-12-19T05:39:26.734 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.731+0000 7f871c377640 1 -- 172.21.15.120:0/3504878776 wait complete. 2023-12-19T05:39:26.734 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.732+0000 7f871c377640 1 Processor -- start 2023-12-19T05:39:26.734 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.732+0000 7f871c377640 1 -- start start 2023-12-19T05:39:26.736 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f871c377640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f871406ae10 0x7f87141e3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.736 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f871c377640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8714144d60 0x7f87140a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.736 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f871c377640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f871414b700 0x7f87140bd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.737 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f871c377640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87140a1950 con 0x7f8714144d60 2023-12-19T05:39:26.737 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f871c377640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87140a3090 con 0x7f871414b700 2023-12-19T05:39:26.737 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f871c377640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87140bdb60 con 0x7f871406ae10 2023-12-19T05:39:26.737 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f8719912640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8714144d60 0x7f87140a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.737 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f8719912640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8714144d60 0x7f87140a3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52810/0 (socket says 172.21.15.120:52810) 2023-12-19T05:39:26.737 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f8719912640 1 -- 172.21.15.120:0/3351917498 learned_addr learned my addr 172.21.15.120:0/3351917498 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:26.737 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f871a113640 1 --2- 172.21.15.120:0/3351917498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f871406ae10 0x7f87141e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.737 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f871a914640 1 --2- 172.21.15.120:0/3351917498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f871414b700 0x7f87140bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.737 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f8719912640 1 -- 172.21.15.120:0/3351917498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f871406ae10 msgr2=0x7f87141e3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.737 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f8719912640 1 --2- 172.21.15.120:0/3351917498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f871406ae10 0x7f87141e3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.737 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f8719912640 1 -- 172.21.15.120:0/3351917498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f871414b700 msgr2=0x7f87140bd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.737 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f8719912640 1 --2- 172.21.15.120:0/3351917498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f871414b700 0x7f87140bd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.737 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f8719912640 1 -- 172.21.15.120:0/3351917498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8704009400 con 0x7f8714144d60 2023-12-19T05:39:26.737 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f8719912640 1 --2- 172.21.15.120:0/3351917498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8714144d60 0x7f87140a3720 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8704009890 tx=0x7f87040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:26.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f870affd640 1 -- 172.21.15.120:0/3351917498 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f870403e070 con 0x7f8714144d60 2023-12-19T05:39:26.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f870affd640 1 -- 172.21.15.120:0/3351917498 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8704030e10 con 0x7f8714144d60 2023-12-19T05:39:26.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f871c377640 1 -- 172.21.15.120:0/3351917498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87140a3e20 con 0x7f8714144d60 2023-12-19T05:39:26.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f870affd640 1 -- 172.21.15.120:0/3351917498 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8704039c60 con 0x7f8714144d60 2023-12-19T05:39:26.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.733+0000 7f871c377640 1 -- 172.21.15.120:0/3351917498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87140a15e0 con 0x7f8714144d60 2023-12-19T05:39:26.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.734+0000 7f871c377640 1 -- 172.21.15.120:0/3351917498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87140a1b00 con 0x7f8714144d60 2023-12-19T05:39:26.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.735+0000 7f870affd640 1 -- 172.21.15.120:0/3351917498 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f870404b400 con 0x7f8714144d60 2023-12-19T05:39:26.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.735+0000 7f870affd640 1 --2- 172.21.15.120:0/3351917498 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f86f806a460 0x7f86f806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:26.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.735+0000 7f870affd640 1 -- 172.21.15.120:0/3351917498 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87040aaa50 con 0x7f8714144d60 2023-12-19T05:39:26.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.735+0000 7f871a113640 1 --2- 172.21.15.120:0/3351917498 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f86f806a460 0x7f86f806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:26.738 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.735+0000 7f871a113640 1 --2- 172.21.15.120:0/3351917498 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f86f806a460 0x7f86f806c920 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8710009bd0 tx=0x7f8710009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:26.740 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.739+0000 7f870affd640 1 -- 172.21.15.120:0/3351917498 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f87140a1b00 con 0x7f8714144d60 2023-12-19T05:39:26.945 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.943+0000 7f871c377640 1 -- 172.21.15.120:0/3351917498 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87140a1b00 con 0x7f8714144d60 2023-12-19T05:39:26.945 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.944+0000 7f870affd640 1 -- 172.21.15.120:0/3351917498 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3892 (secure 0 0 0) 0x7f87140a1b00 con 0x7f8714144d60 2023-12-19T05:39:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:26.945 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/753508604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":753508604},{"type":"v1","addr":"172.21.15.155:6833","nonce":753508604}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/3314096579","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":3314096579},{"type":"v1","addr":"172.21.15.120:6836","nonce":3314096579}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:38:58.081682+0000","modified":"2023-12-19T05:39:00.753884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/1608902018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":1608902018},{"type":"v1","addr":"172.21.15.120:6837","nonce":1608902018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T05:39:26.946 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 7 2023-12-19T05:39:26.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.945+0000 7f871c377640 1 -- 172.21.15.120:0/3351917498 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f86f806a460 msgr2=0x7f86f806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.945+0000 7f871c377640 1 --2- 172.21.15.120:0/3351917498 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f86f806a460 0x7f86f806c920 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8710009bd0 tx=0x7f8710009240 comp rx=0 tx=0).stop 2023-12-19T05:39:26.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.945+0000 7f871c377640 1 -- 172.21.15.120:0/3351917498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8714144d60 msgr2=0x7f87140a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:26.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.945+0000 7f871c377640 1 --2- 172.21.15.120:0/3351917498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8714144d60 0x7f87140a3720 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8704009890 tx=0x7f87040046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.945+0000 7f871c377640 1 -- 172.21.15.120:0/3351917498 shutdown_connections 2023-12-19T05:39:26.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.945+0000 7f871c377640 1 --2- 172.21.15.120:0/3351917498 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f86f806a460 0x7f86f806c920 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.945+0000 7f871c377640 1 --2- 172.21.15.120:0/3351917498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f871414b700 0x7f87140bd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.945+0000 7f871c377640 1 --2- 172.21.15.120:0/3351917498 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8714144d60 0x7f87140a3720 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.946+0000 7f871c377640 1 --2- 172.21.15.120:0/3351917498 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f871406ae10 0x7f87141e3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:26.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.946+0000 7f871c377640 1 -- 172.21.15.120:0/3351917498 >> 172.21.15.120:0/3351917498 conn(0x7f87140bac10 msgr2=0x7f871406d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:26.947 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.946+0000 7f871c377640 1 -- 172.21.15.120:0/3351917498 shutdown_connections 2023-12-19T05:39:26.948 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:26.946+0000 7f871c377640 1 -- 172.21.15.120:0/3351917498 wait complete. 2023-12-19T05:39:26.957 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:27.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.054+0000 7f603aa84640 1 Processor -- start 2023-12-19T05:39:27.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.054+0000 7f603aa84640 1 -- start start 2023-12-19T05:39:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.054+0000 7f603aa84640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f60340b68b0 0x7f60340702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.054+0000 7f603aa84640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603406af90 0x7f603406b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.054+0000 7f603aa84640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60340b93c0 con 0x7f60340b95d0 2023-12-19T05:39:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.054+0000 7f603aa84640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6034071a30 con 0x7f60340b68b0 2023-12-19T05:39:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.054+0000 7f603aa84640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603406b900 con 0x7f603406af90 2023-12-19T05:39:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.055+0000 7f6038820640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f60340b68b0 0x7f60340702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.055+0000 7f6033fff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f60340b95d0 0x7f60341426f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40954/0 (socket says 172.21.15.120:40954) 2023-12-19T05:39:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.055+0000 7f6033fff640 1 -- 172.21.15.120:0/1075206218 learned_addr learned my addr 172.21.15.120:0/1075206218 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.055+0000 7f6039021640 1 --2- 172.21.15.120:0/1075206218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603406af90 0x7f603406b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.055+0000 7f6038820640 1 -- 172.21.15.120:0/1075206218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603406af90 msgr2=0x7f603406b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.055+0000 7f60337fe640 1 -- 172.21.15.120:0/1075206218 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321672417 0 0) 0x7f60340b93c0 con 0x7f60340b95d0 2023-12-19T05:39:27.057 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.055+0000 7f6038820640 1 --2- 172.21.15.120:0/1075206218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603406af90 0x7f603406b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.058 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.055+0000 7f6038820640 1 -- 172.21.15.120:0/1075206218 >> v1:172.21.15.120:6789/0 conn(0x7f60340b95d0 legacy=0x7f60341426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.058 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.055+0000 7f6038820640 1 -- 172.21.15.120:0/1075206218 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034070800 con 0x7f60340b68b0 2023-12-19T05:39:27.058 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.055+0000 7f6039021640 1 --2- 172.21.15.120:0/1075206218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603406af90 0x7f603406b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:27.058 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.056+0000 7f6038820640 1 --2- 172.21.15.120:0/1075206218 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60340b68b0 0x7f60340702c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f602c009d90 tx=0x7f602c02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc1b4360d39d3bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:27.058 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.056+0000 7f60337fe640 1 -- 172.21.15.120:0/1075206218 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c02cce0 con 0x7f60340b68b0 2023-12-19T05:39:27.058 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.056+0000 7f60337fe640 1 -- 172.21.15.120:0/1075206218 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c02ce40 con 0x7f60340b68b0 2023-12-19T05:39:27.058 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.056+0000 7f60337fe640 1 -- 172.21.15.120:0/1075206218 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c034660 con 0x7f60340b68b0 2023-12-19T05:39:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.056+0000 7f603aa84640 1 -- 172.21.15.120:0/1075206218 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60340b68b0 msgr2=0x7f60340702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.056+0000 7f603aa84640 1 --2- 172.21.15.120:0/1075206218 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60340b68b0 0x7f60340702c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f602c009d90 tx=0x7f602c02bf30 comp rx=0 tx=0).stop 2023-12-19T05:39:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.056+0000 7f603aa84640 1 -- 172.21.15.120:0/1075206218 shutdown_connections 2023-12-19T05:39:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.056+0000 7f603aa84640 1 --2- 172.21.15.120:0/1075206218 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603406af90 0x7f603406b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.056+0000 7f603aa84640 1 --2- 172.21.15.120:0/1075206218 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60340b68b0 0x7f60340702c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.056+0000 7f603aa84640 1 -- 172.21.15.120:0/1075206218 >> 172.21.15.120:0/1075206218 conn(0x7f60340bcfd0 msgr2=0x7f60340bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:27.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.056+0000 7f603aa84640 1 -- 172.21.15.120:0/1075206218 shutdown_connections 2023-12-19T05:39:27.062 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.056+0000 7f603aa84640 1 -- 172.21.15.120:0/1075206218 wait complete. 2023-12-19T05:39:27.062 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.057+0000 7f603aa84640 1 Processor -- start 2023-12-19T05:39:27.062 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.057+0000 7f603aa84640 1 -- start start 2023-12-19T05:39:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f603aa84640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603406af90 0x7f60341e0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f603aa84640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60340b68b0 0x7f6034143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f603aa84640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60340b95d0 0x7f60341440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f603aa84640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60341e1540 con 0x7f60340b95d0 2023-12-19T05:39:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f603aa84640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603413d6c0 con 0x7f60340b68b0 2023-12-19T05:39:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f603aa84640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60341e11d0 con 0x7f603406af90 2023-12-19T05:39:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f6039021640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60340b95d0 0x7f60341440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f6039021640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60340b95d0 0x7f60341440f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52824/0 (socket says 172.21.15.120:52824) 2023-12-19T05:39:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f6039021640 1 -- 172.21.15.120:0/3245228271 learned_addr learned my addr 172.21.15.120:0/3245228271 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f6033fff640 1 --2- 172.21.15.120:0/3245228271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60340b68b0 0x7f6034143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f6039021640 1 -- 172.21.15.120:0/3245228271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603406af90 msgr2=0x7f60341e0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f6039021640 1 --2- 172.21.15.120:0/3245228271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603406af90 0x7f60341e0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f6039021640 1 -- 172.21.15.120:0/3245228271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60340b68b0 msgr2=0x7f6034143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f6039021640 1 --2- 172.21.15.120:0/3245228271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60340b68b0 0x7f6034143bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.058+0000 7f6039021640 1 -- 172.21.15.120:0/3245228271 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c009a70 con 0x7f60340b95d0 2023-12-19T05:39:27.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.059+0000 7f6039021640 1 --2- 172.21.15.120:0/3245228271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60340b95d0 0x7f60341440f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f602400c7f0 tx=0x7f602400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:27.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.059+0000 7f60317fa640 1 -- 172.21.15.120:0/3245228271 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024007820 con 0x7f60340b95d0 2023-12-19T05:39:27.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.059+0000 7f60317fa640 1 -- 172.21.15.120:0/3245228271 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6024007980 con 0x7f60340b95d0 2023-12-19T05:39:27.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.059+0000 7f603aa84640 1 -- 172.21.15.120:0/3245228271 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60341459a0 con 0x7f60340b95d0 2023-12-19T05:39:27.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.059+0000 7f60317fa640 1 -- 172.21.15.120:0/3245228271 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024007d70 con 0x7f60340b95d0 2023-12-19T05:39:27.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.059+0000 7f603aa84640 1 -- 172.21.15.120:0/3245228271 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603413c9f0 con 0x7f60340b95d0 2023-12-19T05:39:27.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.060+0000 7f603aa84640 1 -- 172.21.15.120:0/3245228271 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603404e080 con 0x7f60340b95d0 2023-12-19T05:39:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.060+0000 7f60317fa640 1 -- 172.21.15.120:0/3245228271 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f60240113f0 con 0x7f60340b95d0 2023-12-19T05:39:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.061+0000 7f60317fa640 1 --2- 172.21.15.120:0/3245228271 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f601406a430 0x7f601406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.061+0000 7f6038820640 1 --2- 172.21.15.120:0/3245228271 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f601406a430 0x7f601406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.061+0000 7f60317fa640 1 -- 172.21.15.120:0/3245228271 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6024088d60 con 0x7f60340b95d0 2023-12-19T05:39:27.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.061+0000 7f6038820640 1 --2- 172.21.15.120:0/3245228271 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f601406a430 0x7f601406c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f602c036000 tx=0x7f602c02e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:27.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.065+0000 7f60317fa640 1 -- 172.21.15.120:0/3245228271 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f60240542d0 con 0x7f60340b95d0 2023-12-19T05:39:27.238 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.233+0000 7f603aa84640 1 -- 172.21.15.120:0/3245228271 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60341e1680 con 0x7f60340b95d0 2023-12-19T05:39:27.238 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.234+0000 7f60317fa640 1 -- 172.21.15.120:0/3245228271 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f60341e1680 con 0x7f60340b95d0 2023-12-19T05:39:27.238 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:27.238 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":20,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:38:59.083159+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:38:56.035188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T05:38:57.050130+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:27.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.236+0000 7f603aa84640 1 -- 172.21.15.120:0/3245228271 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f601406a430 msgr2=0x7f601406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.236+0000 7f603aa84640 1 --2- 172.21.15.120:0/3245228271 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f601406a430 0x7f601406c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f602c036000 tx=0x7f602c02e000 comp rx=0 tx=0).stop 2023-12-19T05:39:27.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.236+0000 7f603aa84640 1 -- 172.21.15.120:0/3245228271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60340b95d0 msgr2=0x7f60341440f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.236+0000 7f603aa84640 1 --2- 172.21.15.120:0/3245228271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60340b95d0 0x7f60341440f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f602400c7f0 tx=0x7f602400ccb0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.237+0000 7f603aa84640 1 -- 172.21.15.120:0/3245228271 shutdown_connections 2023-12-19T05:39:27.239 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.237+0000 7f603aa84640 1 --2- 172.21.15.120:0/3245228271 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f601406a430 0x7f601406c8f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.240 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.237+0000 7f603aa84640 1 --2- 172.21.15.120:0/3245228271 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f60340b95d0 0x7f60341440f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.240 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.237+0000 7f603aa84640 1 --2- 172.21.15.120:0/3245228271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60340b68b0 0x7f6034143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.240 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.237+0000 7f603aa84640 1 --2- 172.21.15.120:0/3245228271 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f603406af90 0x7f60341e0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.240 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.237+0000 7f603aa84640 1 -- 172.21.15.120:0/3245228271 >> 172.21.15.120:0/3245228271 conn(0x7f60340bcfd0 msgr2=0x7f60340b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:27.240 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.237+0000 7f603aa84640 1 -- 172.21.15.120:0/3245228271 shutdown_connections 2023-12-19T05:39:27.240 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.237+0000 7f603aa84640 1 -- 172.21.15.120:0/3245228271 wait complete. 2023-12-19T05:39:27.249 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T05:39:27.349 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.347+0000 7fa79e810640 1 Processor -- start 2023-12-19T05:39:27.349 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.347+0000 7fa79e810640 1 -- start start 2023-12-19T05:39:27.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.348+0000 7fa79e810640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa79806a390 0x7fa7981428c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.348+0000 7fa79e810640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7980b25d0 0x7fa7980b5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.348+0000 7fa79e810640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7980b33b0 con 0x7fa7980b5d50 2023-12-19T05:39:27.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.348+0000 7fa79e810640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7980b61b0 con 0x7fa79806a390 2023-12-19T05:39:27.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.348+0000 7fa79e810640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7980b3600 con 0x7fa7980b25d0 2023-12-19T05:39:27.352 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.348+0000 7fa79cdad640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa7980b5d50 0x7fa79814be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40964/0 (socket says 172.21.15.120:40964) 2023-12-19T05:39:27.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.348+0000 7fa79cdad640 1 -- 172.21.15.120:0/900990525 learned_addr learned my addr 172.21.15.120:0/900990525 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:27.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.348+0000 7fa797fff640 1 --2- 172.21.15.120:0/900990525 >> v2:172.21.15.155:3300/0 conn(0x7fa79806a390 0x7fa7981428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.348+0000 7fa7977fe640 1 --2- 172.21.15.120:0/900990525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7980b25d0 0x7fa7980b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 -- 172.21.15.120:0/900990525 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215294820 0 0) 0x7fa7980b33b0 con 0x7fa7980b5d50 2023-12-19T05:39:27.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 -- 172.21.15.120:0/900990525 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa780003520 con 0x7fa7980b5d50 2023-12-19T05:39:27.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 -- 172.21.15.120:0/900990525 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3359788858 0 0) 0x7fa780003520 con 0x7fa7980b5d50 2023-12-19T05:39:27.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 -- 172.21.15.120:0/900990525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7980b25d0 msgr2=0x7fa7980b5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:27.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 --2- 172.21.15.120:0/900990525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7980b25d0 0x7fa7980b5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 -- 172.21.15.120:0/900990525 >> v2:172.21.15.155:3300/0 conn(0x7fa79806a390 msgr2=0x7fa7981428c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:27.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 --2- 172.21.15.120:0/900990525 >> v2:172.21.15.155:3300/0 conn(0x7fa79806a390 0x7fa7981428c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.353 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 -- 172.21.15.120:0/900990525 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7980b38e0 con 0x7fa7980b5d50 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 -- 172.21.15.120:0/900990525 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7fa7900019f0 con 0x7fa7980b5d50 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 -- 172.21.15.120:0/900990525 >> v1:172.21.15.120:6789/0 conn(0x7fa7980b5d50 legacy=0x7fa79814be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 --2- 172.21.15.120:0/900990525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7980b25d0 0x7fa780003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 --2- 172.21.15.120:0/900990525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa780003ef0 0x7fa7800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 --2- 172.21.15.120:0/900990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa780004d00 0x7fa780005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 -- 172.21.15.120:0/900990525 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7980b61b0 con 0x7fa780003ef0 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 -- 172.21.15.120:0/900990525 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7980b3600 con 0x7fa780004d00 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa796ffd640 1 -- 172.21.15.120:0/900990525 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78000b980 con 0x7fa7980b25d0 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa7977fe640 1 --2- 172.21.15.120:0/900990525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa780003ef0 0x7fa7800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa797fff640 1 --2- 172.21.15.120:0/900990525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7980b25d0 0x7fa780003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa79cdad640 1 --2- 172.21.15.120:0/900990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa780004d00 0x7fa780005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa7977fe640 1 -- 172.21.15.120:0/900990525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7980b25d0 msgr2=0x7fa780003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa7977fe640 1 --2- 172.21.15.120:0/900990525 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7980b25d0 0x7fa780003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa7977fe640 1 -- 172.21.15.120:0/900990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa780004d00 msgr2=0x7fa780005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:27.354 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa7977fe640 1 --2- 172.21.15.120:0/900990525 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa780004d00 0x7fa780005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.355 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.349+0000 7fa7977fe640 1 -- 172.21.15.120:0/900990525 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa780003520 con 0x7fa780003ef0 2023-12-19T05:39:27.355 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.350+0000 7fa7977fe640 1 --2- 172.21.15.120:0/900990525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa780003ef0 0x7fa7800047c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009ac0 tx=0x7fa7800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497ea5158d170ab3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:27.355 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.350+0000 7fa796ffd640 1 -- 172.21.15.120:0/900990525 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c02c6b0 con 0x7fa780003ef0 2023-12-19T05:39:27.355 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.350+0000 7fa796ffd640 1 -- 172.21.15.120:0/900990525 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c02c810 con 0x7fa780003ef0 2023-12-19T05:39:27.355 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.350+0000 7fa796ffd640 1 -- 172.21.15.120:0/900990525 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c02cba0 con 0x7fa780003ef0 2023-12-19T05:39:27.355 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.351+0000 7fa79e810640 1 -- 172.21.15.120:0/900990525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa780003ef0 msgr2=0x7fa7800047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.355 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.351+0000 7fa79e810640 1 --2- 172.21.15.120:0/900990525 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa780003ef0 0x7fa7800047c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa78c009ac0 tx=0x7fa7800057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.355 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.351+0000 7fa79cdad640 1 -- 172.21.15.120:0/900990525 reap_dead start 2023-12-19T05:39:27.356 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.351+0000 7fa79e810640 1 -- 172.21.15.120:0/900990525 shutdown_connections 2023-12-19T05:39:27.356 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.351+0000 7fa79e810640 1 -- 172.21.15.120:0/900990525 >> 172.21.15.120:0/900990525 conn(0x7fa7980b8dd0 msgr2=0x7fa7980b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:27.356 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.351+0000 7fa79e810640 1 -- 172.21.15.120:0/900990525 shutdown_connections 2023-12-19T05:39:27.356 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.351+0000 7fa79e810640 1 -- 172.21.15.120:0/900990525 wait complete. 2023-12-19T05:39:27.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.352+0000 7fa79e810640 1 Processor -- start 2023-12-19T05:39:27.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.352+0000 7fa79e810640 1 -- start start 2023-12-19T05:39:27.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.352+0000 7fa79e810640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa780003ef0 0x7fa798137690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.352+0000 7fa79e810640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7981de5b0 0x7fa7980b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.352+0000 7fa79e810640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7980bae20 0x7fa7980bb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.352+0000 7fa79e810640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7980b7800 con 0x7fa780003ef0 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.352+0000 7fa79e810640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa798134cb0 con 0x7fa7981de5b0 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.352+0000 7fa79e810640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa798135840 con 0x7fa7980bae20 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.352+0000 7fa797fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa780003ef0 0x7fa798137690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa797fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa780003ef0 0x7fa798137690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52836/0 (socket says 172.21.15.120:52836) 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa797fff640 1 -- 172.21.15.120:0/866864431 learned_addr learned my addr 172.21.15.120:0/866864431 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa7977fe640 1 --2- 172.21.15.120:0/866864431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7981de5b0 0x7fa7980b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa79cdad640 1 --2- 172.21.15.120:0/866864431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7980bae20 0x7fa7980bb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa797fff640 1 -- 172.21.15.120:0/866864431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7980bae20 msgr2=0x7fa7980bb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa797fff640 1 --2- 172.21.15.120:0/866864431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7980bae20 0x7fa7980bb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa797fff640 1 -- 172.21.15.120:0/866864431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7981de5b0 msgr2=0x7fa7980b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa797fff640 1 --2- 172.21.15.120:0/866864431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7981de5b0 0x7fa7980b72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa797fff640 1 -- 172.21.15.120:0/866864431 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7981de120 con 0x7fa780003ef0 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa797fff640 1 --2- 172.21.15.120:0/866864431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa780003ef0 0x7fa798137690 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa788011a70 tx=0x7fa788011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:27.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa794ff9640 1 -- 172.21.15.120:0/866864431 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa788009680 con 0x7fa780003ef0 2023-12-19T05:39:27.361 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa794ff9640 1 -- 172.21.15.120:0/866864431 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78800fb50 con 0x7fa780003ef0 2023-12-19T05:39:27.361 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa79e810640 1 -- 172.21.15.120:0/866864431 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa798137d70 con 0x7fa780003ef0 2023-12-19T05:39:27.361 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa794ff9640 1 -- 172.21.15.120:0/866864431 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78800fee0 con 0x7fa780003ef0 2023-12-19T05:39:27.361 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.353+0000 7fa79e810640 1 -- 172.21.15.120:0/866864431 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7981ddad0 con 0x7fa780003ef0 2023-12-19T05:39:27.361 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.354+0000 7fa79e810640 1 -- 172.21.15.120:0/866864431 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79804e080 con 0x7fa780003ef0 2023-12-19T05:39:27.361 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.354+0000 7fa794ff9640 1 -- 172.21.15.120:0/866864431 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa788014440 con 0x7fa780003ef0 2023-12-19T05:39:27.361 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.355+0000 7fa794ff9640 1 --2- 172.21.15.120:0/866864431 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa78406a460 0x7fa78406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.361 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.355+0000 7fa7977fe640 1 --2- 172.21.15.120:0/866864431 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa78406a460 0x7fa78406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.361 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.355+0000 7fa794ff9640 1 -- 172.21.15.120:0/866864431 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa788089250 con 0x7fa780003ef0 2023-12-19T05:39:27.361 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.355+0000 7fa7977fe640 1 --2- 172.21.15.120:0/866864431 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa78406a460 0x7fa78406c920 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa78c036000 tx=0x7fa78c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:27.362 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.359+0000 7fa794ff9640 1 -- 172.21.15.120:0/866864431 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa788054840 con 0x7fa780003ef0 2023-12-19T05:39:27.561 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.560+0000 7fa79e810640 1 -- 172.21.15.120:0/866864431 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa7980b4a50 con 0x7fa780003ef0 2023-12-19T05:39:27.561 INFO:tasks.ceph.mon.a.smithi120.stderr:2023-12-19T05:39:27.561+0000 7f93bd209640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T05:39:27.570 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.569+0000 7fa794ff9640 1 -- 172.21.15.120:0/866864431 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa788057e60 con 0x7fa780003ef0 2023-12-19T05:39:27.570 INFO:teuthology.orchestra.run.smithi120.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T05:39:27.573 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.571+0000 7fa79e810640 1 -- 172.21.15.120:0/866864431 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa78406a460 msgr2=0x7fa78406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.573 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.571+0000 7fa79e810640 1 --2- 172.21.15.120:0/866864431 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa78406a460 0x7fa78406c920 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa78c036000 tx=0x7fa78c030000 comp rx=0 tx=0).stop 2023-12-19T05:39:27.573 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.571+0000 7fa79e810640 1 -- 172.21.15.120:0/866864431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa780003ef0 msgr2=0x7fa798137690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.573 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.571+0000 7fa79e810640 1 --2- 172.21.15.120:0/866864431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa780003ef0 0x7fa798137690 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa788011a70 tx=0x7fa788011f30 comp rx=0 tx=0).stop 2023-12-19T05:39:27.573 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.571+0000 7fa79e810640 1 -- 172.21.15.120:0/866864431 shutdown_connections 2023-12-19T05:39:27.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.571+0000 7fa79e810640 1 --2- 172.21.15.120:0/866864431 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa78406a460 0x7fa78406c920 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.571+0000 7fa79e810640 1 --2- 172.21.15.120:0/866864431 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa7980bae20 0x7fa7980bb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.571+0000 7fa79e810640 1 --2- 172.21.15.120:0/866864431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa7981de5b0 0x7fa7980b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.571+0000 7fa79e810640 1 --2- 172.21.15.120:0/866864431 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa780003ef0 0x7fa798137690 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.571+0000 7fa79e810640 1 -- 172.21.15.120:0/866864431 >> 172.21.15.120:0/866864431 conn(0x7fa7980b8dd0 msgr2=0x7fa7981411a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:27.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.572+0000 7fa79e810640 1 -- 172.21.15.120:0/866864431 shutdown_connections 2023-12-19T05:39:27.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.572+0000 7fa79e810640 1 -- 172.21.15.120:0/866864431 wait complete. 2023-12-19T05:39:27.574 INFO:tasks.ceph.mds.a.smithi120.stderr: -4696> 2023-12-19T05:39:01.696+0000 7fc7ba1d3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:39:27.587 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T05:39:27.606 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2023-12-19T05:39:27.689 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.688+0000 7f5942f8b640 1 Processor -- start 2023-12-19T05:39:27.690 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.688+0000 7f5942f8b640 1 -- start start 2023-12-19T05:39:27.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.689+0000 7f5942f8b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f593c0b5a70 0x7f593c069f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.689+0000 7f5942f8b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f593c070a60 0x7f593c1479c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.689+0000 7f5942f8b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c071090 con 0x7f593c0b8240 2023-12-19T05:39:27.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.689+0000 7f5942f8b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c0b8760 con 0x7f593c0b5a70 2023-12-19T05:39:27.691 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.689+0000 7f5942f8b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c071370 con 0x7f593c070a60 2023-12-19T05:39:27.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.689+0000 7f5940d27640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f593c0b5a70 0x7f593c069f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.689+0000 7f5940d27640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f593c0b5a70 0x7f593c069f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52848/0 (socket says 172.21.15.120:52848) 2023-12-19T05:39:27.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.689+0000 7f5940d27640 1 -- 172.21.15.120:0/4272790358 learned_addr learned my addr 172.21.15.120:0/4272790358 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:27.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.689+0000 7f5940d27640 1 -- 172.21.15.120:0/4272790358 >> v2:172.21.15.155:3300/0 conn(0x7f593c070a60 msgr2=0x7f593c1479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:27.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.689+0000 7f593bfff640 1 --2- 172.21.15.120:0/4272790358 >> v2:172.21.15.155:3300/0 conn(0x7f593c070a60 0x7f593c1479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.689+0000 7f5940d27640 1 --2- 172.21.15.120:0/4272790358 >> v2:172.21.15.155:3300/0 conn(0x7f593c070a60 0x7f593c1479c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.689+0000 7f593b7fe640 1 -- 172.21.15.120:0/4272790358 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760701281 0 0) 0x7f593c071090 con 0x7f593c0b8240 2023-12-19T05:39:27.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.689+0000 7f5940d27640 1 -- 172.21.15.120:0/4272790358 >> v1:172.21.15.120:6789/0 conn(0x7f593c0b8240 legacy=0x7f593c14adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.689+0000 7f5940d27640 1 -- 172.21.15.120:0/4272790358 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c071650 con 0x7f593c0b5a70 2023-12-19T05:39:27.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.690+0000 7f5940d27640 1 --2- 172.21.15.120:0/4272790358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f593c0b5a70 0x7f593c069f40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f593c0b7b60 tx=0x7f592c02ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b1da095bfd43cc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:27.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.690+0000 7f593b7fe640 1 -- 172.21.15.120:0/4272790358 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c02f850 con 0x7f593c0b5a70 2023-12-19T05:39:27.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.690+0000 7f593b7fe640 1 -- 172.21.15.120:0/4272790358 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c02f9b0 con 0x7f593c0b5a70 2023-12-19T05:39:27.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.690+0000 7f593b7fe640 1 -- 172.21.15.120:0/4272790358 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c02fd40 con 0x7f593c0b5a70 2023-12-19T05:39:27.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.691+0000 7f5942f8b640 1 -- 172.21.15.120:0/4272790358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f593c0b5a70 msgr2=0x7f593c069f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.691+0000 7f5942f8b640 1 --2- 172.21.15.120:0/4272790358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f593c0b5a70 0x7f593c069f40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f593c0b7b60 tx=0x7f592c02ba30 comp rx=0 tx=0).stop 2023-12-19T05:39:27.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.691+0000 7f5942f8b640 1 -- 172.21.15.120:0/4272790358 shutdown_connections 2023-12-19T05:39:27.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.691+0000 7f5942f8b640 1 --2- 172.21.15.120:0/4272790358 >> v2:172.21.15.155:3300/0 conn(0x7f593c070a60 0x7f593c1479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.691+0000 7f5942f8b640 1 --2- 172.21.15.120:0/4272790358 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f593c0b5a70 0x7f593c069f40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.691+0000 7f5942f8b640 1 -- 172.21.15.120:0/4272790358 >> 172.21.15.120:0/4272790358 conn(0x7f593c0bc120 msgr2=0x7f593c0bc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:27.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.691+0000 7f5942f8b640 1 -- 172.21.15.120:0/4272790358 shutdown_connections 2023-12-19T05:39:27.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.691+0000 7f5942f8b640 1 -- 172.21.15.120:0/4272790358 wait complete. 2023-12-19T05:39:27.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.692+0000 7f5942f8b640 1 Processor -- start 2023-12-19T05:39:27.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.692+0000 7f5942f8b640 1 -- start start 2023-12-19T05:39:27.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.692+0000 7f5942f8b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f593c070a60 0x7f593c13acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f5942f8b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f593c0b5a70 0x7f593c1e3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f5942f8b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f593c0b8240 0x7f593c135c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f5942f8b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c1361d0 con 0x7f593c0b5a70 2023-12-19T05:39:27.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f5942f8b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c1e4120 con 0x7f593c070a60 2023-12-19T05:39:27.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f5942f8b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c13a560 con 0x7f593c0b8240 2023-12-19T05:39:27.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f593bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f593c0b5a70 0x7f593c1e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f593bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f593c0b5a70 0x7f593c1e3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52852/0 (socket says 172.21.15.120:52852) 2023-12-19T05:39:27.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f593bfff640 1 -- 172.21.15.120:0/179484100 learned_addr learned my addr 172.21.15.120:0/179484100 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:27.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f5940d27640 1 --2- 172.21.15.120:0/179484100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f593c070a60 0x7f593c13acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f5941528640 1 --2- 172.21.15.120:0/179484100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f593c0b8240 0x7f593c135c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f593bfff640 1 -- 172.21.15.120:0/179484100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f593c0b8240 msgr2=0x7f593c135c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f593bfff640 1 --2- 172.21.15.120:0/179484100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f593c0b8240 0x7f593c135c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f593bfff640 1 -- 172.21.15.120:0/179484100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f593c070a60 msgr2=0x7f593c13acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:27.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f593bfff640 1 --2- 172.21.15.120:0/179484100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f593c070a60 0x7f593c13acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:27.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f593bfff640 1 -- 172.21.15.120:0/179484100 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c0094d0 con 0x7f593c0b5a70 2023-12-19T05:39:27.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f593bfff640 1 --2- 172.21.15.120:0/179484100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f593c0b5a70 0x7f593c1e3190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f593000c7f0 tx=0x7f593000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:27.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f59397fa640 1 -- 172.21.15.120:0/179484100 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930004220 con 0x7f593c0b5a70 2023-12-19T05:39:27.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f59397fa640 1 -- 172.21.15.120:0/179484100 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5930004380 con 0x7f593c0b5a70 2023-12-19T05:39:27.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f59397fa640 1 -- 172.21.15.120:0/179484100 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930007860 con 0x7f593c0b5a70 2023-12-19T05:39:27.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f5942f8b640 1 -- 172.21.15.120:0/179484100 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c131850 con 0x7f593c0b5a70 2023-12-19T05:39:27.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.693+0000 7f5942f8b640 1 -- 172.21.15.120:0/179484100 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c131290 con 0x7f593c0b5a70 2023-12-19T05:39:27.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.694+0000 7f5942f8b640 1 -- 172.21.15.120:0/179484100 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593c04e080 con 0x7f593c0b5a70 2023-12-19T05:39:27.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.695+0000 7f59397fa640 1 -- 172.21.15.120:0/179484100 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5930007bd0 con 0x7f593c0b5a70 2023-12-19T05:39:27.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.695+0000 7f59397fa640 1 --2- 172.21.15.120:0/179484100 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f592806a430 0x7f592806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:27.699 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.695+0000 7f59397fa640 1 -- 172.21.15.120:0/179484100 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5930088b40 con 0x7f593c0b5a70 2023-12-19T05:39:27.699 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.695+0000 7f5940d27640 1 --2- 172.21.15.120:0/179484100 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f592806a430 0x7f592806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:27.699 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.695+0000 7f5940d27640 1 --2- 172.21.15.120:0/179484100 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f592806a430 0x7f592806c8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f592c036000 tx=0x7f592c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:27.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.699+0000 7f59397fa640 1 -- 172.21.15.120:0/179484100 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5930054210 con 0x7f593c0b5a70 2023-12-19T05:39:27.903 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:27.902+0000 7f5942f8b640 1 -- 172.21.15.120:0/179484100 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f593c06abf0 con 0x7f593c0b5a70 2023-12-19T05:39:28.150 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:39:28.153 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:39:28.155 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:39:28.572 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.570+0000 7f59397fa640 1 -- 172.21.15.120:0/179484100 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f593001e0a0 con 0x7f593c0b5a70 2023-12-19T05:39:28.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.572+0000 7f5942f8b640 1 -- 172.21.15.120:0/179484100 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f592806a430 msgr2=0x7f592806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:28.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.572+0000 7f5942f8b640 1 --2- 172.21.15.120:0/179484100 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f592806a430 0x7f592806c8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f592c036000 tx=0x7f592c008030 comp rx=0 tx=0).stop 2023-12-19T05:39:28.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.572+0000 7f5942f8b640 1 -- 172.21.15.120:0/179484100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f593c0b5a70 msgr2=0x7f593c1e3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:28.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.572+0000 7f5942f8b640 1 --2- 172.21.15.120:0/179484100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f593c0b5a70 0x7f593c1e3190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f593000c7f0 tx=0x7f593000ccb0 comp rx=0 tx=0).stop 2023-12-19T05:39:28.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.573+0000 7f5942f8b640 1 -- 172.21.15.120:0/179484100 shutdown_connections 2023-12-19T05:39:28.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.573+0000 7f5942f8b640 1 --2- 172.21.15.120:0/179484100 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f592806a430 0x7f592806c8f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:28.574 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.573+0000 7f5942f8b640 1 --2- 172.21.15.120:0/179484100 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f593c0b8240 0x7f593c135c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.573+0000 7f5942f8b640 1 --2- 172.21.15.120:0/179484100 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f593c0b5a70 0x7f593c1e3190 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.573+0000 7f5942f8b640 1 --2- 172.21.15.120:0/179484100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f593c070a60 0x7f593c13acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.573+0000 7f5942f8b640 1 -- 172.21.15.120:0/179484100 >> 172.21.15.120:0/179484100 conn(0x7f593c0bc120 msgr2=0x7f593c148080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.573+0000 7f5942f8b640 1 -- 172.21.15.120:0/179484100 shutdown_connections 2023-12-19T05:39:28.575 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.573+0000 7f5942f8b640 1 -- 172.21.15.120:0/179484100 wait complete. 2023-12-19T05:39:28.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T05:39:28.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.689+0000 7f4512e8b640 1 Processor -- start 2023-12-19T05:39:28.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.689+0000 7f4512e8b640 1 -- start start 2023-12-19T05:39:28.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.689+0000 7f4512e8b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f450c069d00 0x7f450c14aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:28.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.689+0000 7f4512e8b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f450c0712b0 0x7f450c06a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:28.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.689+0000 7f4512e8b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f450c06ba10 con 0x7f450c06a620 2023-12-19T05:39:28.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.689+0000 7f4512e8b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450c145270 con 0x7f450c0712b0 2023-12-19T05:39:28.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.689+0000 7f4512e8b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f450c0b41f0 con 0x7f450c069d00 2023-12-19T05:39:28.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.689+0000 7f450bfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f450c0712b0 0x7f450c06a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:28.692 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.690+0000 7f450bfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f450c0712b0 0x7f450c06a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52866/0 (socket says 172.21.15.120:52866) 2023-12-19T05:39:28.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.690+0000 7f450bfff640 1 -- 172.21.15.120:0/3053113706 learned_addr learned my addr 172.21.15.120:0/3053113706 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:28.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.690+0000 7f450bfff640 1 -- 172.21.15.120:0/3053113706 >> v2:172.21.15.155:3300/0 conn(0x7f450c069d00 msgr2=0x7f450c14aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:28.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.690+0000 7f4510c27640 1 --2- 172.21.15.120:0/3053113706 >> v2:172.21.15.155:3300/0 conn(0x7f450c069d00 0x7f450c14aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:28.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.690+0000 7f450bfff640 1 --2- 172.21.15.120:0/3053113706 >> v2:172.21.15.155:3300/0 conn(0x7f450c069d00 0x7f450c14aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:28.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.690+0000 7f450bfff640 1 -- 172.21.15.120:0/3053113706 >> v1:172.21.15.155:6789/0 conn(0x7f450c06a620 legacy=0x7f450c14e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:28.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.690+0000 7f450bfff640 1 -- 172.21.15.120:0/3053113706 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c070e20 con 0x7f450c0712b0 2023-12-19T05:39:28.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.690+0000 7f450bfff640 1 --2- 172.21.15.120:0/3053113706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f450c0712b0 0x7f450c06a0e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f450c0babe0 tx=0x7f44f802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75bb4369dba27ba6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:28.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.691+0000 7f450b7fe640 1 -- 172.21.15.120:0/3053113706 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8031870 con 0x7f450c0712b0 2023-12-19T05:39:28.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.691+0000 7f450b7fe640 1 -- 172.21.15.120:0/3053113706 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f80319d0 con 0x7f450c0712b0 2023-12-19T05:39:28.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.691+0000 7f450b7fe640 1 -- 172.21.15.120:0/3053113706 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8031d60 con 0x7f450c0712b0 2023-12-19T05:39:28.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.691+0000 7f4512e8b640 1 -- 172.21.15.120:0/3053113706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f450c0712b0 msgr2=0x7f450c06a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:28.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.691+0000 7f4512e8b640 1 --2- 172.21.15.120:0/3053113706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f450c0712b0 0x7f450c06a0e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f450c0babe0 tx=0x7f44f802b910 comp rx=0 tx=0).stop 2023-12-19T05:39:28.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.691+0000 7f4512e8b640 1 -- 172.21.15.120:0/3053113706 shutdown_connections 2023-12-19T05:39:28.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.691+0000 7f4512e8b640 1 --2- 172.21.15.120:0/3053113706 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f450c0712b0 0x7f450c06a0e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:28.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.691+0000 7f4512e8b640 1 --2- 172.21.15.120:0/3053113706 >> v2:172.21.15.155:3300/0 conn(0x7f450c069d00 0x7f450c14aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:28.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.691+0000 7f4512e8b640 1 -- 172.21.15.120:0/3053113706 >> 172.21.15.120:0/3053113706 conn(0x7f450c0bd070 msgr2=0x7f450c0bd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:28.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.691+0000 7f4512e8b640 1 -- 172.21.15.120:0/3053113706 shutdown_connections 2023-12-19T05:39:28.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.691+0000 7f4512e8b640 1 -- 172.21.15.120:0/3053113706 wait complete. 2023-12-19T05:39:28.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.692+0000 7f4512e8b640 1 Processor -- start 2023-12-19T05:39:28.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.692+0000 7f4512e8b640 1 -- start start 2023-12-19T05:39:28.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.693+0000 7f4512e8b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f450c069d00 0x7f450c1499e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:28.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.693+0000 7f4512e8b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f450c0712b0 0x7f450c14dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:28.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.693+0000 7f4512e8b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f450c1481b0 0x7f450c1402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:28.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.693+0000 7f4512e8b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c149f20 con 0x7f450c0712b0 2023-12-19T05:39:28.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.693+0000 7f4512e8b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450c14e4e0 con 0x7f450c069d00 2023-12-19T05:39:28.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.693+0000 7f4512e8b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450c14daa0 con 0x7f450c1481b0 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.693+0000 7f450bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f450c0712b0 0x7f450c14dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.693+0000 7f450bfff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f450c0712b0 0x7f450c14dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52874/0 (socket says 172.21.15.120:52874) 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.693+0000 7f450bfff640 1 -- 172.21.15.120:0/3168310132 learned_addr learned my addr 172.21.15.120:0/3168310132 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.693+0000 7f450bfff640 1 -- 172.21.15.120:0/3168310132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f450c1481b0 msgr2=0x7f450c1402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.693+0000 7f450bfff640 1 --2- 172.21.15.120:0/3168310132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f450c1481b0 0x7f450c1402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.693+0000 7f450bfff640 1 -- 172.21.15.120:0/3168310132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f450c069d00 msgr2=0x7f450c1499e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.693+0000 7f450bfff640 1 --2- 172.21.15.120:0/3168310132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f450c069d00 0x7f450c1499e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.693+0000 7f450bfff640 1 -- 172.21.15.120:0/3168310132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f80094d0 con 0x7f450c0712b0 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.694+0000 7f450bfff640 1 --2- 172.21.15.120:0/3168310132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f450c0712b0 0x7f450c14dfa0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f44f802b950 tx=0x7f44f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.694+0000 7f45097fa640 1 -- 172.21.15.120:0/3168310132 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8031820 con 0x7f450c0712b0 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.694+0000 7f45097fa640 1 -- 172.21.15.120:0/3168310132 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f80443f0 con 0x7f450c0712b0 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.694+0000 7f4512e8b640 1 -- 172.21.15.120:0/3168310132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450c14bdc0 con 0x7f450c0712b0 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.694+0000 7f45097fa640 1 -- 172.21.15.120:0/3168310132 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f80447a0 con 0x7f450c0712b0 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.694+0000 7f4512e8b640 1 -- 172.21.15.120:0/3168310132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450c14ee30 con 0x7f450c0712b0 2023-12-19T05:39:28.698 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.695+0000 7f4512e8b640 1 -- 172.21.15.120:0/3168310132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f450c14d900 con 0x7f450c0712b0 2023-12-19T05:39:28.699 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.695+0000 7f45097fa640 1 -- 172.21.15.120:0/3168310132 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f44f804d450 con 0x7f450c0712b0 2023-12-19T05:39:28.699 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.695+0000 7f45097fa640 1 --2- 172.21.15.120:0/3168310132 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f44f006a430 0x7f44f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:28.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.696+0000 7f4510c27640 1 --2- 172.21.15.120:0/3168310132 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f44f006a430 0x7f44f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:28.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.696+0000 7f45097fa640 1 -- 172.21.15.120:0/3168310132 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f44f802d040 con 0x7f450c0712b0 2023-12-19T05:39:28.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.696+0000 7f4510c27640 1 --2- 172.21.15.120:0/3168310132 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f44f006a430 0x7f44f006c8f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4500006fd0 tx=0x7f4500008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:28.705 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.704+0000 7f45097fa640 1 -- 172.21.15.120:0/3168310132 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f450c14d900 con 0x7f450c0712b0 2023-12-19T05:39:28.879 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:28.878+0000 7f4512e8b640 1 -- 172.21.15.120:0/3168310132 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f450c14d900 con 0x7f450c0712b0 2023-12-19T05:39:29.784 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.782+0000 7f45097fa640 1 -- 172.21.15.120:0/3168310132 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f450c14d900 con 0x7f450c0712b0 2023-12-19T05:39:29.784 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' removed 2023-12-19T05:39:29.786 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.785+0000 7f4512e8b640 1 -- 172.21.15.120:0/3168310132 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f44f006a430 msgr2=0x7f44f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:29.787 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.785+0000 7f4512e8b640 1 --2- 172.21.15.120:0/3168310132 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f44f006a430 0x7f44f006c8f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4500006fd0 tx=0x7f4500008040 comp rx=0 tx=0).stop 2023-12-19T05:39:29.787 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.785+0000 7f4512e8b640 1 -- 172.21.15.120:0/3168310132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f450c0712b0 msgr2=0x7f450c14dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:29.787 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.785+0000 7f4512e8b640 1 --2- 172.21.15.120:0/3168310132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f450c0712b0 0x7f450c14dfa0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f44f802b950 tx=0x7f44f80046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:29.787 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.785+0000 7f4512e8b640 1 -- 172.21.15.120:0/3168310132 shutdown_connections 2023-12-19T05:39:29.787 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.785+0000 7f4512e8b640 1 --2- 172.21.15.120:0/3168310132 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f44f006a430 0x7f44f006c8f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:29.787 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.785+0000 7f4512e8b640 1 --2- 172.21.15.120:0/3168310132 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f450c1481b0 0x7f450c1402b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:29.787 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.785+0000 7f4512e8b640 1 --2- 172.21.15.120:0/3168310132 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f450c0712b0 0x7f450c14dfa0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:29.787 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.785+0000 7f4512e8b640 1 --2- 172.21.15.120:0/3168310132 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f450c069d00 0x7f450c1499e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:29.787 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.785+0000 7f4512e8b640 1 -- 172.21.15.120:0/3168310132 >> 172.21.15.120:0/3168310132 conn(0x7f450c0bd070 msgr2=0x7f450c0bc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:29.787 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.785+0000 7f4512e8b640 1 -- 172.21.15.120:0/3168310132 shutdown_connections 2023-12-19T05:39:29.787 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.785+0000 7f4512e8b640 1 -- 172.21.15.120:0/3168310132 wait complete. 2023-12-19T05:39:29.798 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T05:39:29.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.899+0000 7f8100fd0640 1 Processor -- start 2023-12-19T05:39:29.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.899+0000 7f8100fd0640 1 -- start start 2023-12-19T05:39:29.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.900+0000 7f8100fd0640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f80fc144db0 0x7f80fc0b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:29.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.900+0000 7f8100fd0640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f80fc0b9be0 0x7f80fc155380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:29.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.900+0000 7f8100fd0640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80fc0b5240 con 0x7f80fc0ba920 2023-12-19T05:39:29.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.900+0000 7f8100fd0640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80fc06b160 con 0x7f80fc144db0 2023-12-19T05:39:29.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.900+0000 7f8100fd0640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80fc0ba690 con 0x7f80fc0b9be0 2023-12-19T05:39:29.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.900+0000 7f80fa59c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f80fc144db0 0x7f80fc0b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:29.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.900+0000 7f80f9d9b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f80fc0ba920 0x7f80fc0b94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40994/0 (socket says 172.21.15.120:40994) 2023-12-19T05:39:29.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.900+0000 7f80f9d9b640 1 -- 172.21.15.120:0/2796392754 learned_addr learned my addr 172.21.15.120:0/2796392754 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:29.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.900+0000 7f80fa59c640 1 -- 172.21.15.120:0/2796392754 >> v2:172.21.15.155:3300/0 conn(0x7f80fc0b9be0 msgr2=0x7f80fc155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:29.909 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.900+0000 7f80fad9d640 1 --2- 172.21.15.120:0/2796392754 >> v2:172.21.15.155:3300/0 conn(0x7f80fc0b9be0 0x7f80fc155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:29.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.900+0000 7f80fa59c640 1 --2- 172.21.15.120:0/2796392754 >> v2:172.21.15.155:3300/0 conn(0x7f80fc0b9be0 0x7f80fc155380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:29.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.900+0000 7f80f959a640 1 -- 172.21.15.120:0/2796392754 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3181922519 0 0) 0x7f80e4001110 con 0x7f80fc0ba920 2023-12-19T05:39:29.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.900+0000 7f80fa59c640 1 -- 172.21.15.120:0/2796392754 >> v1:172.21.15.120:6789/0 conn(0x7f80fc0ba920 legacy=0x7f80fc0b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:29.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.900+0000 7f80fa59c640 1 -- 172.21.15.120:0/2796392754 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc06b400 con 0x7f80fc144db0 2023-12-19T05:39:29.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.901+0000 7f80fa59c640 1 --2- 172.21.15.120:0/2796392754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc144db0 0x7f80fc0b4b40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0bb420 tx=0x7f80f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9d07b5be572129 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:29.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.901+0000 7f80f959a640 1 -- 172.21.15.120:0/2796392754 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4031830 con 0x7f80fc144db0 2023-12-19T05:39:29.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.901+0000 7f80f959a640 1 -- 172.21.15.120:0/2796392754 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80f4031990 con 0x7f80fc144db0 2023-12-19T05:39:29.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.901+0000 7f80f959a640 1 -- 172.21.15.120:0/2796392754 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80f4031d20 con 0x7f80fc144db0 2023-12-19T05:39:29.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.902+0000 7f8100fd0640 1 -- 172.21.15.120:0/2796392754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc144db0 msgr2=0x7f80fc0b4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:29.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.902+0000 7f8100fd0640 1 --2- 172.21.15.120:0/2796392754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc144db0 0x7f80fc0b4b40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f80fc0bb420 tx=0x7f80f402b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:29.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.902+0000 7f8100fd0640 1 -- 172.21.15.120:0/2796392754 shutdown_connections 2023-12-19T05:39:29.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.902+0000 7f8100fd0640 1 --2- 172.21.15.120:0/2796392754 >> v2:172.21.15.155:3300/0 conn(0x7f80fc0b9be0 0x7f80fc155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:29.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.902+0000 7f8100fd0640 1 --2- 172.21.15.120:0/2796392754 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc144db0 0x7f80fc0b4b40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:29.910 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.902+0000 7f8100fd0640 1 -- 172.21.15.120:0/2796392754 >> 172.21.15.120:0/2796392754 conn(0x7f80fc069d00 msgr2=0x7f80fc06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:29.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.902+0000 7f8100fd0640 1 -- 172.21.15.120:0/2796392754 shutdown_connections 2023-12-19T05:39:29.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.902+0000 7f8100fd0640 1 -- 172.21.15.120:0/2796392754 wait complete. 2023-12-19T05:39:29.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.903+0000 7f8100fd0640 1 Processor -- start 2023-12-19T05:39:29.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.903+0000 7f8100fd0640 1 -- start start 2023-12-19T05:39:29.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f8100fd0640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80fc0b9be0 0x7f80fc0bd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:29.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f8100fd0640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc0ba920 0x7f80fc1e3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:29.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f8100fd0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80fc144db0 0x7f80fc149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:29.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f8100fd0640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc0bdd90 con 0x7f80fc0ba920 2023-12-19T05:39:29.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f8100fd0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc148910 con 0x7f80fc144db0 2023-12-19T05:39:29.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f8100fd0640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc1e3ab0 con 0x7f80fc0b9be0 2023-12-19T05:39:29.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f80f9d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc0ba920 0x7f80fc1e3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:29.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f80f9d9b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc0ba920 0x7f80fc1e3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52890/0 (socket says 172.21.15.120:52890) 2023-12-19T05:39:29.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f80f9d9b640 1 -- 172.21.15.120:0/2300780265 learned_addr learned my addr 172.21.15.120:0/2300780265 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:29.911 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f80fa59c640 1 --2- 172.21.15.120:0/2300780265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80fc0b9be0 0x7f80fc0bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:29.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f80fad9d640 1 --2- 172.21.15.120:0/2300780265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80fc144db0 0x7f80fc149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:29.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f80f9d9b640 1 -- 172.21.15.120:0/2300780265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80fc0b9be0 msgr2=0x7f80fc0bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:29.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f80f9d9b640 1 --2- 172.21.15.120:0/2300780265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80fc0b9be0 0x7f80fc0bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:29.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f80f9d9b640 1 -- 172.21.15.120:0/2300780265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80fc144db0 msgr2=0x7f80fc149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:29.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f80f9d9b640 1 --2- 172.21.15.120:0/2300780265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80fc144db0 0x7f80fc149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:29.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f80f9d9b640 1 -- 172.21.15.120:0/2300780265 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f4009400 con 0x7f80fc0ba920 2023-12-19T05:39:29.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f80f9d9b640 1 --2- 172.21.15.120:0/2300780265 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc0ba920 0x7f80fc1e3570 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f80e400c780 tx=0x7f80e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:29.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f80f2ffd640 1 -- 172.21.15.120:0/2300780265 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e40072d0 con 0x7f80fc0ba920 2023-12-19T05:39:29.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f80f2ffd640 1 -- 172.21.15.120:0/2300780265 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e4007450 con 0x7f80fc0ba920 2023-12-19T05:39:29.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f8100fd0640 1 -- 172.21.15.120:0/2300780265 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80fc14b4b0 con 0x7f80fc0ba920 2023-12-19T05:39:29.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f80f2ffd640 1 -- 172.21.15.120:0/2300780265 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e40047e0 con 0x7f80fc0ba920 2023-12-19T05:39:29.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.904+0000 7f8100fd0640 1 -- 172.21.15.120:0/2300780265 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80fc148c60 con 0x7f80fc0ba920 2023-12-19T05:39:29.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.905+0000 7f8100fd0640 1 -- 172.21.15.120:0/2300780265 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80fc14a4e0 con 0x7f80fc0ba920 2023-12-19T05:39:29.912 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.906+0000 7f80f2ffd640 1 -- 172.21.15.120:0/2300780265 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f80e4004960 con 0x7f80fc0ba920 2023-12-19T05:39:29.913 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.906+0000 7f80f2ffd640 1 --2- 172.21.15.120:0/2300780265 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f80dc06a430 0x7f80dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:29.913 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.906+0000 7f80f2ffd640 1 -- 172.21.15.120:0/2300780265 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f80e40879e0 con 0x7f80fc0ba920 2023-12-19T05:39:29.913 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.906+0000 7f80fa59c640 1 --2- 172.21.15.120:0/2300780265 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f80dc06a430 0x7f80dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:29.913 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.906+0000 7f80fa59c640 1 --2- 172.21.15.120:0/2300780265 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f80dc06a430 0x7f80dc06c8f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f80f4036000 tx=0x7f80f403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:29.913 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:29.910+0000 7f80f2ffd640 1 -- 172.21.15.120:0/2300780265 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f80e4053270 con 0x7f80fc0ba920 2023-12-19T05:39:30.081 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.080+0000 7f8100fd0640 1 -- 172.21.15.120:0/2300780265 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f80fc0b5240 con 0x7f80fc0ba920 2023-12-19T05:39:30.790 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.789+0000 7f80f2ffd640 1 -- 172.21.15.120:0/2300780265 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f80fc0b5240 con 0x7f80fc0ba920 2023-12-19T05:39:30.790 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' removed 2023-12-19T05:39:30.793 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.791+0000 7f8100fd0640 1 -- 172.21.15.120:0/2300780265 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f80dc06a430 msgr2=0x7f80dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:30.793 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.791+0000 7f8100fd0640 1 --2- 172.21.15.120:0/2300780265 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f80dc06a430 0x7f80dc06c8f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f80f4036000 tx=0x7f80f403c040 comp rx=0 tx=0).stop 2023-12-19T05:39:30.793 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.791+0000 7f8100fd0640 1 -- 172.21.15.120:0/2300780265 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc0ba920 msgr2=0x7f80fc1e3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:30.793 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.791+0000 7f8100fd0640 1 --2- 172.21.15.120:0/2300780265 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc0ba920 0x7f80fc1e3570 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f80e400c780 tx=0x7f80e400cc40 comp rx=0 tx=0).stop 2023-12-19T05:39:30.793 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.791+0000 7f8100fd0640 1 -- 172.21.15.120:0/2300780265 shutdown_connections 2023-12-19T05:39:30.793 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.791+0000 7f8100fd0640 1 --2- 172.21.15.120:0/2300780265 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f80dc06a430 0x7f80dc06c8f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.793 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.791+0000 7f8100fd0640 1 --2- 172.21.15.120:0/2300780265 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80fc144db0 0x7f80fc149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.793 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.791+0000 7f8100fd0640 1 --2- 172.21.15.120:0/2300780265 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f80fc0ba920 0x7f80fc1e3570 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.793 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.791+0000 7f8100fd0640 1 --2- 172.21.15.120:0/2300780265 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f80fc0b9be0 0x7f80fc0bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.793 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.791+0000 7f8100fd0640 1 -- 172.21.15.120:0/2300780265 >> 172.21.15.120:0/2300780265 conn(0x7f80fc069d00 msgr2=0x7f80fc13d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:30.794 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.791+0000 7f8100fd0640 1 -- 172.21.15.120:0/2300780265 shutdown_connections 2023-12-19T05:39:30.794 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.792+0000 7f8100fd0640 1 -- 172.21.15.120:0/2300780265 wait complete. 2023-12-19T05:39:30.805 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T05:39:30.805 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T05:39:30.805 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T05:39:30.805 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:39:30.805 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T05:39:30.805 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T05:39:30.806 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T05:39:30.806 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:39:30.806 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T05:39:30.806 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T05:39:30.806 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T05:39:30.806 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T05:39:30.816 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T05:39:30.816 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T05:39:30.816 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T05:39:30.817 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T05:39:30.818 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T05:39:30.818 DEBUG:teuthology.orchestra.run.smithi155:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T05:39:30.858 INFO:tasks.ceph.mds.a:Started 2023-12-19T05:39:30.859 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:30.860 INFO:tasks.ceph.mds.c:Started 2023-12-19T05:39:30.860 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:30.861 INFO:tasks.ceph.mds.b:Started 2023-12-19T05:39:30.861 DEBUG:teuthology.parallel:result is None 2023-12-19T05:39:30.861 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T05:39:30.935 INFO:tasks.ceph.mds.a.smithi120.stdout:starting mds.a at 2023-12-19T05:39:30.935 INFO:tasks.ceph.mds.c.smithi120.stdout:starting mds.c at 2023-12-19T05:39:30.944 INFO:tasks.ceph.mds.b.smithi155.stdout:starting mds.b at 2023-12-19T05:39:30.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.969+0000 7fe8807ab640 1 Processor -- start 2023-12-19T05:39:30.971 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.969+0000 7fe8807ab640 1 -- start start 2023-12-19T05:39:30.973 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.970+0000 7fe8807ab640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe87806b080 0x7fe8780b9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:30.973 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.970+0000 7fe8807ab640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe878071740 0x7fe87814ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:30.973 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.970+0000 7fe8807ab640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe878070cf0 con 0x7fe87806fe20 2023-12-19T05:39:30.973 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.970+0000 7fe8807ab640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8780b48b0 con 0x7fe87806b080 2023-12-19T05:39:30.973 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.970+0000 7fe8807ab640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8780712b0 con 0x7fe878071740 2023-12-19T05:39:30.973 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.970+0000 7fe87e547640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe87806b080 0x7fe8780b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:30.973 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.970+0000 7fe87e547640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe87806b080 0x7fe8780b9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52926/0 (socket says 172.21.15.120:52926) 2023-12-19T05:39:30.973 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.970+0000 7fe87e547640 1 -- 172.21.15.120:0/1137454727 learned_addr learned my addr 172.21.15.120:0/1137454727 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:30.973 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.970+0000 7fe87dd46640 1 --2- 172.21.15.120:0/1137454727 >> v2:172.21.15.155:3300/0 conn(0x7fe878071740 0x7fe87814ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:30.973 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.971+0000 7fe87e547640 1 -- 172.21.15.120:0/1137454727 >> v2:172.21.15.155:3300/0 conn(0x7fe878071740 msgr2=0x7fe87814ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:30.973 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.971+0000 7fe87e547640 1 --2- 172.21.15.120:0/1137454727 >> v2:172.21.15.155:3300/0 conn(0x7fe878071740 0x7fe87814ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.973 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.971+0000 7fe87e547640 1 -- 172.21.15.120:0/1137454727 >> v1:172.21.15.155:6789/0 conn(0x7fe87806fe20 legacy=0x7fe878141820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:30.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.971+0000 7fe87e547640 1 -- 172.21.15.120:0/1137454727 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe878141f30 con 0x7fe87806b080 2023-12-19T05:39:30.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.971+0000 7fe87dd46640 1 --2- 172.21.15.120:0/1137454727 >> v2:172.21.15.155:3300/0 conn(0x7fe878071740 0x7fe87814ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:30.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.971+0000 7fe87e547640 1 --2- 172.21.15.120:0/1137454727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe87806b080 0x7fe8780b9170 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe87806b790 tx=0x7fe87402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d3b2fa7bcb53a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:30.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.972+0000 7fe87d545640 1 -- 172.21.15.120:0/1137454727 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe874030860 con 0x7fe87806b080 2023-12-19T05:39:30.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.972+0000 7fe87d545640 1 -- 172.21.15.120:0/1137454727 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8740309c0 con 0x7fe87806b080 2023-12-19T05:39:30.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.972+0000 7fe87d545640 1 -- 172.21.15.120:0/1137454727 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe874030d50 con 0x7fe87806b080 2023-12-19T05:39:30.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.972+0000 7fe8807ab640 1 -- 172.21.15.120:0/1137454727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe87806b080 msgr2=0x7fe8780b9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:30.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.972+0000 7fe8807ab640 1 --2- 172.21.15.120:0/1137454727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe87806b080 0x7fe8780b9170 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe87806b790 tx=0x7fe87402b9a0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.972+0000 7fe8807ab640 1 -- 172.21.15.120:0/1137454727 shutdown_connections 2023-12-19T05:39:30.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.972+0000 7fe8807ab640 1 --2- 172.21.15.120:0/1137454727 >> v2:172.21.15.155:3300/0 conn(0x7fe878071740 0x7fe87814ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.972+0000 7fe8807ab640 1 --2- 172.21.15.120:0/1137454727 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe87806b080 0x7fe8780b9170 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.972+0000 7fe8807ab640 1 -- 172.21.15.120:0/1137454727 >> 172.21.15.120:0/1137454727 conn(0x7fe8780bcff0 msgr2=0x7fe8780bd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:30.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.972+0000 7fe8807ab640 1 -- 172.21.15.120:0/1137454727 shutdown_connections 2023-12-19T05:39:30.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.972+0000 7fe8807ab640 1 -- 172.21.15.120:0/1137454727 wait complete. 2023-12-19T05:39:30.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.973+0000 7fe8807ab640 1 Processor -- start 2023-12-19T05:39:30.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.974+0000 7fe8807ab640 1 -- start start 2023-12-19T05:39:30.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.974+0000 7fe8807ab640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe87806b080 0x7fe87813f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:30.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.974+0000 7fe8807ab640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe87806fe20 0x7fe87814a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:30.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.974+0000 7fe8807ab640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe878071740 0x7fe87813e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:30.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.974+0000 7fe8807ab640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87814a910 con 0x7fe878071740 2023-12-19T05:39:30.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.974+0000 7fe8807ab640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8781dfeb0 con 0x7fe87806b080 2023-12-19T05:39:30.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.974+0000 7fe8807ab640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87813df30 con 0x7fe87806fe20 2023-12-19T05:39:30.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.974+0000 7fe87ed48640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe878071740 0x7fe87813e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:30.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.974+0000 7fe87ed48640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe878071740 0x7fe87813e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:52942/0 (socket says 172.21.15.120:52942) 2023-12-19T05:39:30.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe87ed48640 1 -- 172.21.15.120:0/3600579887 learned_addr learned my addr 172.21.15.120:0/3600579887 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:30.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe87dd46640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe87806fe20 0x7fe87814a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:30.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe87e547640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe87806b080 0x7fe87813f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:30.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe87ed48640 1 -- 172.21.15.120:0/3600579887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe87806fe20 msgr2=0x7fe87814a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:30.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe87ed48640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe87806fe20 0x7fe87814a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe87ed48640 1 -- 172.21.15.120:0/3600579887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe87806b080 msgr2=0x7fe87813f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:30.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe87ed48640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe87806b080 0x7fe87813f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:30.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe87ed48640 1 -- 172.21.15.120:0/3600579887 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8740094d0 con 0x7fe878071740 2023-12-19T05:39:30.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe87e547640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe87806b080 0x7fe87813f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:30.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe87ed48640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe878071740 0x7fe87813e410 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe87000c730 tx=0x7fe87000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:30.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe86effd640 1 -- 172.21.15.120:0/3600579887 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe870003bc0 con 0x7fe878071740 2023-12-19T05:39:30.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe8807ab640 1 -- 172.21.15.120:0/3600579887 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe878140330 con 0x7fe878071740 2023-12-19T05:39:30.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe86effd640 1 -- 172.21.15.120:0/3600579887 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe870003d40 con 0x7fe878071740 2023-12-19T05:39:30.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe8807ab640 1 -- 172.21.15.120:0/3600579887 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe878140050 con 0x7fe878071740 2023-12-19T05:39:30.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.975+0000 7fe86effd640 1 -- 172.21.15.120:0/3600579887 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87000aa90 con 0x7fe878071740 2023-12-19T05:39:30.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.976+0000 7fe8807ab640 1 -- 172.21.15.120:0/3600579887 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe860005250 con 0x7fe878071740 2023-12-19T05:39:30.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.976+0000 7fe86effd640 1 -- 172.21.15.120:0/3600579887 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe87000abf0 con 0x7fe878071740 2023-12-19T05:39:30.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.977+0000 7fe86effd640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe85c06a430 0x7fe85c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:30.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.977+0000 7fe87e547640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe85c06a430 0x7fe85c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:30.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.977+0000 7fe86effd640 1 -- 172.21.15.120:0/3600579887 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe870088430 con 0x7fe878071740 2023-12-19T05:39:30.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.977+0000 7fe87e547640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe85c06a430 0x7fe85c06c8f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe874036000 tx=0x7fe874040040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:30.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:30.981+0000 7fe86effd640 1 -- 172.21.15.120:0/3600579887 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe870053d30 con 0x7fe878071740 2023-12-19T05:39:31.169 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:31.168+0000 7fe8807ab640 1 -- 172.21.15.120:0/3600579887 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe860005500 con 0x7fe878071740 2023-12-19T05:39:31.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:31.973+0000 7fe86effd640 1 -- 172.21.15.120:0/3600579887 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe870001800 con 0x7fe878071740 2023-12-19T05:39:31.974 INFO:teuthology.orchestra.run.smithi120.stderr: removed all blocklist entries 2023-12-19T05:39:31.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:31.975+0000 7fe8807ab640 1 -- 172.21.15.120:0/3600579887 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe85c06a430 msgr2=0x7fe85c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:31.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:31.975+0000 7fe8807ab640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe85c06a430 0x7fe85c06c8f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe874036000 tx=0x7fe874040040 comp rx=0 tx=0).stop 2023-12-19T05:39:31.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:31.975+0000 7fe8807ab640 1 -- 172.21.15.120:0/3600579887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe878071740 msgr2=0x7fe87813e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:31.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:31.975+0000 7fe8807ab640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe878071740 0x7fe87813e410 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe87000c730 tx=0x7fe87000cbf0 comp rx=0 tx=0).stop 2023-12-19T05:39:31.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:31.975+0000 7fe8807ab640 1 -- 172.21.15.120:0/3600579887 shutdown_connections 2023-12-19T05:39:31.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:31.975+0000 7fe8807ab640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe85c06a430 0x7fe85c06c8f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:31.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:31.975+0000 7fe8807ab640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe878071740 0x7fe87813e410 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:31.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:31.975+0000 7fe8807ab640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe87806fe20 0x7fe87814a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:31.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:31.975+0000 7fe8807ab640 1 --2- 172.21.15.120:0/3600579887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe87806b080 0x7fe87813f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:31.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:31.975+0000 7fe8807ab640 1 -- 172.21.15.120:0/3600579887 >> 172.21.15.120:0/3600579887 conn(0x7fe8780bcff0 msgr2=0x7fe8780b8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:31.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:31.975+0000 7fe8807ab640 1 -- 172.21.15.120:0/3600579887 shutdown_connections 2023-12-19T05:39:31.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:31.975+0000 7fe8807ab640 1 -- 172.21.15.120:0/3600579887 wait complete. 2023-12-19T05:39:31.989 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T05:39:32.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.092+0000 7fde31cb2640 1 Processor -- start 2023-12-19T05:39:32.093 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.092+0000 7fde31cb2640 1 -- start start 2023-12-19T05:39:32.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde31cb2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde2c144d60 0x7fde2c06d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde31cb2640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fde2c06ae10 0x7fde2c14b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde31cb2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fde2c14b700 0x7fde2c14df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde31cb2640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde2c06b980 con 0x7fde2c14b700 2023-12-19T05:39:32.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde31cb2640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde2c0bbb60 con 0x7fde2c06ae10 2023-12-19T05:39:32.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde31cb2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c14aa40 con 0x7fde2c144d60 2023-12-19T05:39:32.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde2bfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fde2c14b700 0x7fde2c14df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde2bfff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fde2c14b700 0x7fde2c14df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46304/0 (socket says 172.21.15.120:46304) 2023-12-19T05:39:32.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde2bfff640 1 -- 172.21.15.120:0/2727804203 learned_addr learned my addr 172.21.15.120:0/2727804203 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:32.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde2affd640 1 --2- 172.21.15.120:0/2727804203 >> v2:172.21.15.155:3300/0 conn(0x7fde2c06ae10 0x7fde2c14b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde2b7fe640 1 --2- 172.21.15.120:0/2727804203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde2c144d60 0x7fde2c06d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde2bfff640 1 -- 172.21.15.120:0/2727804203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde2c144d60 msgr2=0x7fde2c06d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:32.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde2bfff640 1 --2- 172.21.15.120:0/2727804203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde2c144d60 0x7fde2c06d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde2bfff640 1 -- 172.21.15.120:0/2727804203 >> v2:172.21.15.155:3300/0 conn(0x7fde2c06ae10 msgr2=0x7fde2c14b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:32.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde2bfff640 1 --2- 172.21.15.120:0/2727804203 >> v2:172.21.15.155:3300/0 conn(0x7fde2c06ae10 0x7fde2c14b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde2bfff640 1 -- 172.21.15.120:0/2727804203 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c0b8b10 con 0x7fde2c14b700 2023-12-19T05:39:32.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde2b7fe640 1 --2- 172.21.15.120:0/2727804203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde2c144d60 0x7fde2c06d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:32.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.093+0000 7fde2affd640 1 --2- 172.21.15.120:0/2727804203 >> v2:172.21.15.155:3300/0 conn(0x7fde2c06ae10 0x7fde2c14b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:32.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.094+0000 7fde2bfff640 1 --2- 172.21.15.120:0/2727804203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde2c14b700 0x7fde2c14df90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0bbd10 tx=0x7fde2402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89661593748f0f9e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:32.096 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.094+0000 7fde2a7fc640 1 -- 172.21.15.120:0/2727804203 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2402cb00 con 0x7fde2c14b700 2023-12-19T05:39:32.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.094+0000 7fde2a7fc640 1 -- 172.21.15.120:0/2727804203 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2402cc60 con 0x7fde2c14b700 2023-12-19T05:39:32.097 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.094+0000 7fde2a7fc640 1 -- 172.21.15.120:0/2727804203 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde240343f0 con 0x7fde2c14b700 2023-12-19T05:39:32.100 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.094+0000 7fde31cb2640 1 -- 172.21.15.120:0/2727804203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde2c14b700 msgr2=0x7fde2c14df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.100 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.094+0000 7fde31cb2640 1 --2- 172.21.15.120:0/2727804203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde2c14b700 0x7fde2c14df90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fde2c0bbd10 tx=0x7fde2402bf60 comp rx=0 tx=0).stop 2023-12-19T05:39:32.100 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.094+0000 7fde31cb2640 1 -- 172.21.15.120:0/2727804203 shutdown_connections 2023-12-19T05:39:32.100 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.094+0000 7fde31cb2640 1 --2- 172.21.15.120:0/2727804203 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde2c14b700 0x7fde2c14df90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.100 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.094+0000 7fde31cb2640 1 --2- 172.21.15.120:0/2727804203 >> v2:172.21.15.155:3300/0 conn(0x7fde2c06ae10 0x7fde2c14b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.100 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.094+0000 7fde31cb2640 1 --2- 172.21.15.120:0/2727804203 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde2c144d60 0x7fde2c06d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.094+0000 7fde31cb2640 1 -- 172.21.15.120:0/2727804203 >> 172.21.15.120:0/2727804203 conn(0x7fde2c0bac10 msgr2=0x7fde2c0bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:32.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.094+0000 7fde31cb2640 1 -- 172.21.15.120:0/2727804203 shutdown_connections 2023-12-19T05:39:32.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.095+0000 7fde31cb2640 1 -- 172.21.15.120:0/2727804203 wait complete. 2023-12-19T05:39:32.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.095+0000 7fde31cb2640 1 Processor -- start 2023-12-19T05:39:32.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.096+0000 7fde31cb2640 1 -- start start 2023-12-19T05:39:32.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.096+0000 7fde31cb2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde2c06ae10 0x7fde2c140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.096+0000 7fde31cb2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde2c144d60 0x7fde2c1e35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.096+0000 7fde31cb2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde2c14b700 0x7fde2c1e3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.096+0000 7fde31cb2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c140580 con 0x7fde2c06ae10 2023-12-19T05:39:32.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.096+0000 7fde31cb2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c1e30d0 con 0x7fde2c144d60 2023-12-19T05:39:32.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.096+0000 7fde31cb2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c13d9b0 con 0x7fde2c14b700 2023-12-19T05:39:32.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.096+0000 7fde2b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde2c06ae10 0x7fde2c140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.096+0000 7fde2b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde2c06ae10 0x7fde2c140040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46312/0 (socket says 172.21.15.120:46312) 2023-12-19T05:39:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.096+0000 7fde2b7fe640 1 -- 172.21.15.120:0/341769652 learned_addr learned my addr 172.21.15.120:0/341769652 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde2affd640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde2c144d60 0x7fde2c1e35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde2bfff640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde2c14b700 0x7fde2c1e3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde2b7fe640 1 -- 172.21.15.120:0/341769652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde2c14b700 msgr2=0x7fde2c1e3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde2b7fe640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde2c14b700 0x7fde2c1e3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde2b7fe640 1 -- 172.21.15.120:0/341769652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde2c144d60 msgr2=0x7fde2c1e35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde2b7fe640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde2c144d60 0x7fde2c1e35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde2b7fe640 1 -- 172.21.15.120:0/341769652 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde24009b30 con 0x7fde2c06ae10 2023-12-19T05:39:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde2affd640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde2c144d60 0x7fde2c1e35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde2bfff640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde2c14b700 0x7fde2c1e3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde2b7fe640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde2c06ae10 0x7fde2c140040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00c7f0 tx=0x7fde1c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde13fff640 1 -- 172.21.15.120:0/341769652 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c007a30 con 0x7fde2c06ae10 2023-12-19T05:39:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde13fff640 1 -- 172.21.15.120:0/341769652 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c007b90 con 0x7fde2c06ae10 2023-12-19T05:39:32.102 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde31cb2640 1 -- 172.21.15.120:0/341769652 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2c13dc90 con 0x7fde2c06ae10 2023-12-19T05:39:32.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde13fff640 1 -- 172.21.15.120:0/341769652 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00ce40 con 0x7fde2c06ae10 2023-12-19T05:39:32.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.097+0000 7fde31cb2640 1 -- 172.21.15.120:0/341769652 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2c13c5d0 con 0x7fde2c06ae10 2023-12-19T05:39:32.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.098+0000 7fde31cb2640 1 -- 172.21.15.120:0/341769652 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2c1e3290 con 0x7fde2c06ae10 2023-12-19T05:39:32.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.098+0000 7fde13fff640 1 -- 172.21.15.120:0/341769652 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fde1c0113f0 con 0x7fde2c06ae10 2023-12-19T05:39:32.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.099+0000 7fde13fff640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fde1806a430 0x7fde1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.099+0000 7fde13fff640 1 -- 172.21.15.120:0/341769652 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fde1c088710 con 0x7fde2c06ae10 2023-12-19T05:39:32.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.099+0000 7fde2affd640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fde1806a430 0x7fde1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.103 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.099+0000 7fde2affd640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fde1806a430 0x7fde1806c8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fde20006fd0 tx=0x7fde20008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:32.104 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.103+0000 7fde13fff640 1 -- 172.21.15.120:0/341769652 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fde1c054050 con 0x7fde2c06ae10 2023-12-19T05:39:32.334 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.333+0000 7fde31cb2640 1 -- 172.21.15.120:0/341769652 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fde2c04e080 con 0x7fde2c06ae10 2023-12-19T05:39:32.335 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.333+0000 7fde13fff640 1 -- 172.21.15.120:0/341769652 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+5491 (secure 0 0 0) 0x7fde1c057670 con 0x7fde2c06ae10 2023-12-19T05:39:32.335 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:32.335 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2023-12-19T05:39:32.335 INFO:teuthology.orchestra.run.smithi120.stdout: "auth_dump": [ 2023-12-19T05:39:32.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.335 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.a", 2023-12-19T05:39:32.335 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQA4LIFlc8F3LxAAtQc/udoXqk3pq0IcC+cViw==", 2023-12-19T05:39:32.335 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2023-12-19T05:39:32.335 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.b", 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQA5LIFlHDlFABAAkG2cQbduDA9LoN4Ak0Ou0w==", 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mds.c", 2023-12-19T05:39:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQA4LIFl8srDNhAA9qbedtbnSlolGsOHP9IZcA==", 2023-12-19T05:39:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2023-12-19T05:39:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2023-12-19T05:39:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2023-12-19T05:39:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2023-12-19T05:39:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.0", 2023-12-19T05:39:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQA8LIFl2qJRHhAA7kSkTAfkgJFh0wCPYqbOUg==", 2023-12-19T05:39:32.337 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2023-12-19T05:39:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2023-12-19T05:39:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2023-12-19T05:39:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.1", 2023-12-19T05:39:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQA/LIFl+wisGxAA/r+CrA1ZqSU693Ittudckw==", 2023-12-19T05:39:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2023-12-19T05:39:32.338 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2023-12-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2023-12-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.2", 2023-12-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQBCLIFl6KF+GhAAgn7/Jvnpi01GWmcvcmaYVg==", 2023-12-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2023-12-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2023-12-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2023-12-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.339 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.3", 2023-12-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQBFLIFlXPllGRAAZUVvuKfBbJejH+DN03V6zg==", 2023-12-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2023-12-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2023-12-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2023-12-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.4", 2023-12-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQBLLIFlSHIvIRAAY8OnjXCsajBJqLwG8u/i5Q==", 2023-12-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2023-12-19T05:39:32.340 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2023-12-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2023-12-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.5", 2023-12-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQBOLIFlZd5THxAApODY/P86otu/kbcggph47g==", 2023-12-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2023-12-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2023-12-19T05:39:32.341 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.6", 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQBRLIFlHUcEHhAAH7YuWdqiU450ZV6KxZe4+w==", 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "osd.7", 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQBULIFl+itRHBAAr4A0CVd6+WM+XMIAhSlOyw==", 2023-12-19T05:39:32.342 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow profile osd", 2023-12-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile osd", 2023-12-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2023-12-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.0", 2023-12-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQA5LIFlE8KoChAAqbXrEdjo97xHJmDZNUV5Vw==", 2023-12-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow", 2023-12-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow r", 2023-12-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow rw", 2023-12-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow rwx" 2023-12-19T05:39:32.343 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.admin", 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQA4LIFljwWIAxAAGU4DYcPLGx3//cKl4HJCQA==", 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mgr": "allow *", 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow *", 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-mds", 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQBZLIFlT2KaOBAAVC6Yg4wqgJ+4p7EpOY8tSA==", 2023-12-19T05:39:32.344 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-mds" 2023-12-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-mgr", 2023-12-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQBZLIFlnGqaOBAAeKg+TYtQaJB7bizYc/nVlg==", 2023-12-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-osd", 2023-12-19T05:39:32.345 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQBZLIFlXXGaOBAAondbNnLOWBaqhVGtnHxJIQ==", 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-osd" 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-rbd", 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQBZLIFlpYaaOBAAGMGQn1alX+xbZyLlOvfyuQ==", 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQBZLIFl842aOBAAS4w+fxYbaoDeC5GZ5Ycy0Q==", 2023-12-19T05:39:32.346 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "client.bootstrap-rgw", 2023-12-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQBZLIFlJ5WaOBAAxj6dCLb6zUIdr50KYmYL3g==", 2023-12-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mgr.x", 2023-12-19T05:39:32.347 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQA4LIFlTW0ULBAAj0NtwFW1p8x2i5kR9pdpQQ==", 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile mgr", 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: "entity": "mgr.y", 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: "key": "AQA4LIFlazgpKBAA8D4QdLpAljXKvLtxWjvHuw==", 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: "caps": { 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mds": "allow *", 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: "mon": "allow profile mgr", 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: "osd": "allow *" 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:32.349 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2023-12-19T05:39:32.349 INFO:teuthology.orchestra.run.smithi120.stdout:} 2023-12-19T05:39:32.350 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.335+0000 7fde31cb2640 1 -- 172.21.15.120:0/341769652 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fde1806a430 msgr2=0x7fde1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.350 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.335+0000 7fde31cb2640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fde1806a430 0x7fde1806c8f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fde20006fd0 tx=0x7fde20008040 comp rx=0 tx=0).stop 2023-12-19T05:39:32.350 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.335+0000 7fde31cb2640 1 -- 172.21.15.120:0/341769652 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde2c06ae10 msgr2=0x7fde2c140040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.350 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.335+0000 7fde31cb2640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde2c06ae10 0x7fde2c140040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00c7f0 tx=0x7fde1c00cbf0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.350 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.335+0000 7fde31cb2640 1 -- 172.21.15.120:0/341769652 shutdown_connections 2023-12-19T05:39:32.350 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.335+0000 7fde31cb2640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fde1806a430 0x7fde1806c8f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.350 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.335+0000 7fde31cb2640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fde2c14b700 0x7fde2c1e3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.351 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.335+0000 7fde31cb2640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde2c144d60 0x7fde2c1e35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.351 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.335+0000 7fde31cb2640 1 --2- 172.21.15.120:0/341769652 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fde2c06ae10 0x7fde2c140040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.351 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.335+0000 7fde31cb2640 1 -- 172.21.15.120:0/341769652 >> 172.21.15.120:0/341769652 conn(0x7fde2c0bac10 msgr2=0x7fde2c0b9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:32.351 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.336+0000 7fde31cb2640 1 -- 172.21.15.120:0/341769652 shutdown_connections 2023-12-19T05:39:32.351 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.336+0000 7fde31cb2640 1 -- 172.21.15.120:0/341769652 wait complete. 2023-12-19T05:39:32.351 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-19T05:39:32.451 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.450+0000 7fe2764d5640 1 Processor -- start 2023-12-19T05:39:32.451 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.450+0000 7fe2764d5640 1 -- start start 2023-12-19T05:39:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.451+0000 7fe2764d5640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fe27006a390 0x7fe2701416d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.451+0000 7fe2764d5640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe2700b2e50 0x7fe27014abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.451+0000 7fe2764d5640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2700715d0 con 0x7fe2700b80a0 2023-12-19T05:39:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.451+0000 7fe2764d5640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe270071a60 con 0x7fe2700b2e50 2023-12-19T05:39:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.451+0000 7fe2764d5640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe270070ca0 con 0x7fe27006a390 2023-12-19T05:39:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.451+0000 7fe26f7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fe2700b2e50 0x7fe27014abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.451+0000 7fe274a72640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fe2700b80a0 0x7fe270147670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40256/0 (socket says 172.21.15.120:40256) 2023-12-19T05:39:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.451+0000 7fe274a72640 1 -- 172.21.15.120:0/3020301152 learned_addr learned my addr 172.21.15.120:0/3020301152 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.451+0000 7fe26f7fe640 1 -- 172.21.15.120:0/3020301152 >> v2:172.21.15.155:3300/0 conn(0x7fe27006a390 msgr2=0x7fe2701416d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:32.453 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.451+0000 7fe26f7fe640 1 --2- 172.21.15.120:0/3020301152 >> v2:172.21.15.155:3300/0 conn(0x7fe27006a390 0x7fe2701416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.451+0000 7fe26f7fe640 1 -- 172.21.15.120:0/3020301152 >> v1:172.21.15.120:6789/0 conn(0x7fe2700b80a0 legacy=0x7fe270147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.451+0000 7fe26f7fe640 1 -- 172.21.15.120:0/3020301152 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe270070f80 con 0x7fe2700b2e50 2023-12-19T05:39:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.451+0000 7fe26effd640 1 -- 172.21.15.120:0/3020301152 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598592366 0 0) 0x7fe2700715d0 con 0x7fe2700b80a0 2023-12-19T05:39:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.452+0000 7fe26f7fe640 1 --2- 172.21.15.120:0/3020301152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2700b2e50 0x7fe27014abe0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe27006ae70 tx=0x7fe26402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc255e72022577ba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.452+0000 7fe26effd640 1 -- 172.21.15.120:0/3020301152 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264031830 con 0x7fe2700b2e50 2023-12-19T05:39:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.452+0000 7fe26effd640 1 -- 172.21.15.120:0/3020301152 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe264031990 con 0x7fe2700b2e50 2023-12-19T05:39:32.454 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.452+0000 7fe26effd640 1 -- 172.21.15.120:0/3020301152 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264031d20 con 0x7fe2700b2e50 2023-12-19T05:39:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.452+0000 7fe2764d5640 1 -- 172.21.15.120:0/3020301152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2700b2e50 msgr2=0x7fe27014abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.452+0000 7fe2764d5640 1 --2- 172.21.15.120:0/3020301152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2700b2e50 0x7fe27014abe0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe27006ae70 tx=0x7fe26402b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.452+0000 7fe2764d5640 1 -- 172.21.15.120:0/3020301152 shutdown_connections 2023-12-19T05:39:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.452+0000 7fe2764d5640 1 --2- 172.21.15.120:0/3020301152 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2700b2e50 0x7fe27014abe0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.452+0000 7fe2764d5640 1 --2- 172.21.15.120:0/3020301152 >> v2:172.21.15.155:3300/0 conn(0x7fe27006a390 0x7fe2701416d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.452+0000 7fe2764d5640 1 -- 172.21.15.120:0/3020301152 >> 172.21.15.120:0/3020301152 conn(0x7fe2700b8dd0 msgr2=0x7fe2700b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.452+0000 7fe2764d5640 1 -- 172.21.15.120:0/3020301152 shutdown_connections 2023-12-19T05:39:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.452+0000 7fe2764d5640 1 -- 172.21.15.120:0/3020301152 wait complete. 2023-12-19T05:39:32.457 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.453+0000 7fe2764d5640 1 Processor -- start 2023-12-19T05:39:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe2764d5640 1 -- start start 2023-12-19T05:39:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe2764d5640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe27006a390 0x7fe2700bb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe2764d5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2700b2e50 0x7fe270149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe2764d5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2700b80a0 0x7fe270149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe2764d5640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2700bb5e0 con 0x7fe2700b80a0 2023-12-19T05:39:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe2764d5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe270140e20 con 0x7fe2700b2e50 2023-12-19T05:39:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe2764d5640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe270149130 con 0x7fe27006a390 2023-12-19T05:39:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe274a72640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2700b80a0 0x7fe270149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe274a72640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2700b80a0 0x7fe270149e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46332/0 (socket says 172.21.15.120:46332) 2023-12-19T05:39:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe274a72640 1 -- 172.21.15.120:0/3803905399 learned_addr learned my addr 172.21.15.120:0/3803905399 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe26f7fe640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2700b2e50 0x7fe270149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe26ffff640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe27006a390 0x7fe2700bb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe274a72640 1 -- 172.21.15.120:0/3803905399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe27006a390 msgr2=0x7fe2700bb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe274a72640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe27006a390 0x7fe2700bb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe274a72640 1 -- 172.21.15.120:0/3803905399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2700b2e50 msgr2=0x7fe270149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe274a72640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2700b2e50 0x7fe270149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe274a72640 1 -- 172.21.15.120:0/3803905399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe264009400 con 0x7fe2700b80a0 2023-12-19T05:39:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.454+0000 7fe26ffff640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe27006a390 0x7fe2700bb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.455+0000 7fe274a72640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2700b80a0 0x7fe270149e90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe26800c780 tx=0x7fe26800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.455+0000 7fe26cff9640 1 -- 172.21.15.120:0/3803905399 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26800ce90 con 0x7fe2700b80a0 2023-12-19T05:39:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.455+0000 7fe26cff9640 1 -- 172.21.15.120:0/3803905399 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26800a640 con 0x7fe2700b80a0 2023-12-19T05:39:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.455+0000 7fe2764d5640 1 -- 172.21.15.120:0/3803905399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe270140af0 con 0x7fe2700b80a0 2023-12-19T05:39:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.455+0000 7fe26cff9640 1 -- 172.21.15.120:0/3803905399 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26800a9d0 con 0x7fe2700b80a0 2023-12-19T05:39:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.455+0000 7fe2764d5640 1 -- 172.21.15.120:0/3803905399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2701496b0 con 0x7fe2700b80a0 2023-12-19T05:39:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.456+0000 7fe2764d5640 1 -- 172.21.15.120:0/3803905399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe270140f90 con 0x7fe2700b80a0 2023-12-19T05:39:32.459 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.456+0000 7fe26cff9640 1 -- 172.21.15.120:0/3803905399 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe26800ab30 con 0x7fe2700b80a0 2023-12-19T05:39:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.456+0000 7fe26cff9640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe25c06a430 0x7fe25c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.457+0000 7fe26cff9640 1 -- 172.21.15.120:0/3803905399 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe268087930 con 0x7fe2700b80a0 2023-12-19T05:39:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.457+0000 7fe26ffff640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe25c06a430 0x7fe25c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.460 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.457+0000 7fe26ffff640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe25c06a430 0x7fe25c06c8f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe260009930 tx=0x7fe260008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:32.461 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.461+0000 7fe26cff9640 1 -- 172.21.15.120:0/3803905399 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fe268053320 con 0x7fe2700b80a0 2023-12-19T05:39:32.689 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.688+0000 7fe2764d5640 1 -- 172.21.15.120:0/3803905399 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fe27004e080 con 0x7fe2700b80a0 2023-12-19T05:39:32.693 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.692+0000 7fe26cff9640 1 -- 172.21.15.120:0/3803905399 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe268018020 con 0x7fe2700b80a0 2023-12-19T05:39:32.695 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.694+0000 7fe2764d5640 1 -- 172.21.15.120:0/3803905399 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe25c06a430 msgr2=0x7fe25c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.695 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.694+0000 7fe2764d5640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe25c06a430 0x7fe25c06c8f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe260009930 tx=0x7fe260008040 comp rx=0 tx=0).stop 2023-12-19T05:39:32.695 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.694+0000 7fe2764d5640 1 -- 172.21.15.120:0/3803905399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2700b80a0 msgr2=0x7fe270149e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.694+0000 7fe2764d5640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2700b80a0 0x7fe270149e90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe26800c780 tx=0x7fe26800cc40 comp rx=0 tx=0).stop 2023-12-19T05:39:32.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.694+0000 7fe2764d5640 1 -- 172.21.15.120:0/3803905399 shutdown_connections 2023-12-19T05:39:32.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.694+0000 7fe2764d5640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fe25c06a430 0x7fe25c06c8f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.694+0000 7fe2764d5640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fe2700b80a0 0x7fe270149e90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.694+0000 7fe2764d5640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2700b2e50 0x7fe270149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.694+0000 7fe2764d5640 1 --2- 172.21.15.120:0/3803905399 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fe27006a390 0x7fe2700bb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.694+0000 7fe2764d5640 1 -- 172.21.15.120:0/3803905399 >> 172.21.15.120:0/3803905399 conn(0x7fe2700b8dd0 msgr2=0x7fe2700b74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:32.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.694+0000 7fe2764d5640 1 -- 172.21.15.120:0/3803905399 shutdown_connections 2023-12-19T05:39:32.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.694+0000 7fe2764d5640 1 -- 172.21.15.120:0/3803905399 wait complete. 2023-12-19T05:39:32.705 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-19T05:39:32.808 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.806+0000 7eff9a8b6640 1 Processor -- start 2023-12-19T05:39:32.808 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.806+0000 7eff9a8b6640 1 -- start start 2023-12-19T05:39:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.807+0000 7eff9a8b6640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff94070c30 0x7eff941415e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.807+0000 7eff9a8b6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff941477d0 0x7eff94141b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.807+0000 7eff9a8b6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff940b9450 con 0x7eff9406b080 2023-12-19T05:39:32.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.807+0000 7eff9a8b6640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff94070830 con 0x7eff94070c30 2023-12-19T05:39:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.807+0000 7eff9a8b6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9406ff80 con 0x7eff941477d0 2023-12-19T05:39:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.807+0000 7eff98e53640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff941477d0 0x7eff94141b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.807+0000 7eff937fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7eff94070c30 0x7eff941415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.807+0000 7eff98e53640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff941477d0 0x7eff94141b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:37748/0 (socket says 172.21.15.120:37748) 2023-12-19T05:39:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.807+0000 7eff98e53640 1 -- 172.21.15.120:0/1539173215 learned_addr learned my addr 172.21.15.120:0/1539173215 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.808+0000 7eff937fe640 1 -- 172.21.15.120:0/1539173215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff941477d0 msgr2=0x7eff94141b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.808+0000 7eff937fe640 1 --2- 172.21.15.120:0/1539173215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff941477d0 0x7eff94141b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.808+0000 7eff937fe640 1 -- 172.21.15.120:0/1539173215 >> v1:172.21.15.155:6789/0 conn(0x7eff9406b080 legacy=0x7eff94071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.808+0000 7eff937fe640 1 -- 172.21.15.120:0/1539173215 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff94070260 con 0x7eff94070c30 2023-12-19T05:39:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.808+0000 7eff92ffd640 1 -- 172.21.15.120:0/1539173215 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392685821 0 0) 0x7eff940b9450 con 0x7eff9406b080 2023-12-19T05:39:32.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.808+0000 7eff98e53640 1 --2- 172.21.15.120:0/1539173215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff941477d0 0x7eff94141b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.809+0000 7eff937fe640 1 --2- 172.21.15.120:0/1539173215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff94070c30 0x7eff941415e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff880097a0 tx=0x7eff8802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5bfd33c728e70bb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.809+0000 7eff92ffd640 1 -- 172.21.15.120:0/1539173215 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88030610 con 0x7eff94070c30 2023-12-19T05:39:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.809+0000 7eff92ffd640 1 -- 172.21.15.120:0/1539173215 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff88030770 con 0x7eff94070c30 2023-12-19T05:39:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.809+0000 7eff92ffd640 1 -- 172.21.15.120:0/1539173215 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88030b00 con 0x7eff94070c30 2023-12-19T05:39:32.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.809+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1539173215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff94070c30 msgr2=0x7eff941415e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.809+0000 7eff9a8b6640 1 --2- 172.21.15.120:0/1539173215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff94070c30 0x7eff941415e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff880097a0 tx=0x7eff8802b960 comp rx=0 tx=0).stop 2023-12-19T05:39:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.809+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1539173215 shutdown_connections 2023-12-19T05:39:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.809+0000 7eff9a8b6640 1 --2- 172.21.15.120:0/1539173215 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff941477d0 0x7eff94141b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.809+0000 7eff9a8b6640 1 --2- 172.21.15.120:0/1539173215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff94070c30 0x7eff941415e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.809+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1539173215 >> 172.21.15.120:0/1539173215 conn(0x7eff940bcfd0 msgr2=0x7eff940bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.809+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1539173215 shutdown_connections 2023-12-19T05:39:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.809+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1539173215 wait complete. 2023-12-19T05:39:32.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.810+0000 7eff9a8b6640 1 Processor -- start 2023-12-19T05:39:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.811+0000 7eff9a8b6640 1 -- start start 2023-12-19T05:39:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.811+0000 7eff9a8b6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff9406b080 0x7eff94143d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.811+0000 7eff9a8b6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff94070c30 0x7eff941e31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.811+0000 7eff9a8b6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff941477d0 0x7eff94146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.811+0000 7eff9a8b6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff941471f0 con 0x7eff94070c30 2023-12-19T05:39:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.811+0000 7eff9a8b6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff941438e0 con 0x7eff9406b080 2023-12-19T05:39:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.811+0000 7eff9a8b6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9413c040 con 0x7eff941477d0 2023-12-19T05:39:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.811+0000 7eff937fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff94070c30 0x7eff941e31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.811+0000 7eff937fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff94070c30 0x7eff941e31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46340/0 (socket says 172.21.15.120:46340) 2023-12-19T05:39:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.811+0000 7eff937fe640 1 -- 172.21.15.120:0/1647601389 learned_addr learned my addr 172.21.15.120:0/1647601389 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.811+0000 7eff98e53640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff941477d0 0x7eff94146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.811+0000 7eff93fff640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff9406b080 0x7eff94143d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.812+0000 7eff937fe640 1 -- 172.21.15.120:0/1647601389 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff941477d0 msgr2=0x7eff94146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.812+0000 7eff937fe640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff941477d0 0x7eff94146cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.812+0000 7eff937fe640 1 -- 172.21.15.120:0/1647601389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff9406b080 msgr2=0x7eff94143d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.812+0000 7eff937fe640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff9406b080 0x7eff94143d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.812+0000 7eff937fe640 1 -- 172.21.15.120:0/1647601389 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c009b30 con 0x7eff94070c30 2023-12-19T05:39:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.812+0000 7eff98e53640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff941477d0 0x7eff94146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.812+0000 7eff93fff640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff9406b080 0x7eff94143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.812+0000 7eff937fe640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff94070c30 0x7eff941e31d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7eff880098c0 tx=0x7eff88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.812+0000 7eff90ff9640 1 -- 172.21.15.120:0/1647601389 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8803e040 con 0x7eff94070c30 2023-12-19T05:39:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.812+0000 7eff90ff9640 1 -- 172.21.15.120:0/1647601389 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff88039cb0 con 0x7eff94070c30 2023-12-19T05:39:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.812+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1647601389 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff88009400 con 0x7eff94070c30 2023-12-19T05:39:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.812+0000 7eff90ff9640 1 -- 172.21.15.120:0/1647601389 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88044630 con 0x7eff94070c30 2023-12-19T05:39:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.812+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1647601389 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff941435a0 con 0x7eff94070c30 2023-12-19T05:39:32.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.813+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1647601389 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff94143a90 con 0x7eff94070c30 2023-12-19T05:39:32.818 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.813+0000 7eff90ff9640 1 -- 172.21.15.120:0/1647601389 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7eff8804d3b0 con 0x7eff94070c30 2023-12-19T05:39:32.818 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.814+0000 7eff90ff9640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7eff8006a430 0x7eff8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:32.818 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.814+0000 7eff93fff640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7eff8006a430 0x7eff8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:32.818 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.814+0000 7eff90ff9640 1 -- 172.21.15.120:0/1647601389 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7eff880aaa80 con 0x7eff94070c30 2023-12-19T05:39:32.818 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.814+0000 7eff93fff640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7eff8006a430 0x7eff8006c8f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7eff84000f60 tx=0x7eff84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:32.819 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:32.818+0000 7eff90ff9640 1 -- 172.21.15.120:0/1647601389 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7eff94143a90 con 0x7eff94070c30 2023-12-19T05:39:33.049 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.048+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1647601389 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7eff94143a50 con 0x7eff94070c30 2023-12-19T05:39:33.052 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.051+0000 7eff90ff9640 1 -- 172.21.15.120:0/1647601389 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7eff88076570 con 0x7eff94070c30 2023-12-19T05:39:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.053+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1647601389 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7eff8006a430 msgr2=0x7eff8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.053+0000 7eff9a8b6640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7eff8006a430 0x7eff8006c8f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7eff84000f60 tx=0x7eff84009040 comp rx=0 tx=0).stop 2023-12-19T05:39:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.053+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1647601389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff94070c30 msgr2=0x7eff941e31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.053+0000 7eff9a8b6640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff94070c30 0x7eff941e31d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7eff880098c0 tx=0x7eff88004730 comp rx=0 tx=0).stop 2023-12-19T05:39:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.053+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1647601389 shutdown_connections 2023-12-19T05:39:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.053+0000 7eff9a8b6640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7eff8006a430 0x7eff8006c8f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.053+0000 7eff9a8b6640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7eff941477d0 0x7eff94146cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.053+0000 7eff9a8b6640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7eff94070c30 0x7eff941e31d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.055 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.053+0000 7eff9a8b6640 1 --2- 172.21.15.120:0/1647601389 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff9406b080 0x7eff94143d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.053+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1647601389 >> 172.21.15.120:0/1647601389 conn(0x7eff940bcfd0 msgr2=0x7eff9406a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.054+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1647601389 shutdown_connections 2023-12-19T05:39:33.056 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.054+0000 7eff9a8b6640 1 -- 172.21.15.120:0/1647601389 wait complete. 2023-12-19T05:39:33.065 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-19T05:39:33.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.164+0000 7f9283bd9640 1 Processor -- start 2023-12-19T05:39:33.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.164+0000 7f9283bd9640 1 -- start start 2023-12-19T05:39:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.165+0000 7f9283bd9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f927c06da70 0x7f927c1429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.165+0000 7f9283bd9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f927c142ee0 0x7f927c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.165+0000 7f9283bd9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f927c0b4e30 0x7f927c0b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.165+0000 7f9283bd9640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927c06ebc0 con 0x7f927c06da70 2023-12-19T05:39:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.165+0000 7f9283bd9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927c0b3db0 con 0x7f927c0b4e30 2023-12-19T05:39:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.165+0000 7f9283bd9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c06e690 con 0x7f927c142ee0 2023-12-19T05:39:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.165+0000 7f9281975640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f927c06da70 0x7f927c1429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.165+0000 7f9281975640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f927c06da70 0x7f927c1429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46344/0 (socket says 172.21.15.120:46344) 2023-12-19T05:39:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.165+0000 7f9281975640 1 -- 172.21.15.120:0/1272111239 learned_addr learned my addr 172.21.15.120:0/1272111239 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.165+0000 7f9281975640 1 -- 172.21.15.120:0/1272111239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f927c142ee0 msgr2=0x7f927c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:33.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.165+0000 7f9281975640 1 --2- 172.21.15.120:0/1272111239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f927c142ee0 0x7f927c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.165+0000 7f9281975640 1 -- 172.21.15.120:0/1272111239 >> v2:172.21.15.155:3300/0 conn(0x7f927c0b4e30 msgr2=0x7f927c0b35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.165+0000 7f9281975640 1 --2- 172.21.15.120:0/1272111239 >> v2:172.21.15.155:3300/0 conn(0x7f927c0b4e30 0x7f927c0b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.165+0000 7f9281975640 1 -- 172.21.15.120:0/1272111239 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c0b9f60 con 0x7f927c06da70 2023-12-19T05:39:33.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.166+0000 7f9281975640 1 --2- 172.21.15.120:0/1272111239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f927c06da70 0x7f927c1429a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f927c14d030 tx=0x7f927802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267153b19a96b08a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:33.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.166+0000 7f9280973640 1 -- 172.21.15.120:0/1272111239 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927802c9e0 con 0x7f927c06da70 2023-12-19T05:39:33.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.166+0000 7f9280973640 1 -- 172.21.15.120:0/1272111239 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927802cb40 con 0x7f927c06da70 2023-12-19T05:39:33.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.166+0000 7f9280973640 1 -- 172.21.15.120:0/1272111239 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92780343f0 con 0x7f927c06da70 2023-12-19T05:39:33.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.167+0000 7f9283bd9640 1 -- 172.21.15.120:0/1272111239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f927c06da70 msgr2=0x7f927c1429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.167+0000 7f9283bd9640 1 --2- 172.21.15.120:0/1272111239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f927c06da70 0x7f927c1429a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f927c14d030 tx=0x7f927802be40 comp rx=0 tx=0).stop 2023-12-19T05:39:33.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.167+0000 7f9283bd9640 1 -- 172.21.15.120:0/1272111239 shutdown_connections 2023-12-19T05:39:33.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.167+0000 7f9283bd9640 1 --2- 172.21.15.120:0/1272111239 >> v2:172.21.15.155:3300/0 conn(0x7f927c0b4e30 0x7f927c0b35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.167+0000 7f9283bd9640 1 --2- 172.21.15.120:0/1272111239 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f927c142ee0 0x7f927c0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.167+0000 7f9283bd9640 1 --2- 172.21.15.120:0/1272111239 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f927c06da70 0x7f927c1429a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.167+0000 7f9283bd9640 1 -- 172.21.15.120:0/1272111239 >> 172.21.15.120:0/1272111239 conn(0x7f927c0bac10 msgr2=0x7f927c0bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:33.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.167+0000 7f9283bd9640 1 -- 172.21.15.120:0/1272111239 shutdown_connections 2023-12-19T05:39:33.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.167+0000 7f9283bd9640 1 -- 172.21.15.120:0/1272111239 wait complete. 2023-12-19T05:39:33.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.168+0000 7f9283bd9640 1 Processor -- start 2023-12-19T05:39:33.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.168+0000 7f9283bd9640 1 -- start start 2023-12-19T05:39:33.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.168+0000 7f9283bd9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f927c06da70 0x7f927c141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.168+0000 7f9283bd9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f927c0b4e30 0x7f927c13f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.168+0000 7f9283bd9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f927c142ee0 0x7f927c13fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.168+0000 7f9283bd9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c148ea0 con 0x7f927c142ee0 2023-12-19T05:39:33.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.168+0000 7f9283bd9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c147690 con 0x7f927c06da70 2023-12-19T05:39:33.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.168+0000 7f9283bd9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c147970 con 0x7f927c0b4e30 2023-12-19T05:39:33.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f9282176640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f927c142ee0 0x7f927c13fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f9282176640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f927c142ee0 0x7f927c13fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46350/0 (socket says 172.21.15.120:46350) 2023-12-19T05:39:33.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f9282176640 1 -- 172.21.15.120:0/3043987788 learned_addr learned my addr 172.21.15.120:0/3043987788 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:33.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f9281975640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f927c06da70 0x7f927c141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f9281174640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f927c0b4e30 0x7f927c13f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f9282176640 1 -- 172.21.15.120:0/3043987788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f927c0b4e30 msgr2=0x7f927c13f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f9282176640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f927c0b4e30 0x7f927c13f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f9282176640 1 -- 172.21.15.120:0/3043987788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f927c06da70 msgr2=0x7f927c141a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f9282176640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f927c06da70 0x7f927c141a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f9282176640 1 -- 172.21.15.120:0/3043987788 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9278009b30 con 0x7f927c142ee0 2023-12-19T05:39:33.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f9281975640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f927c06da70 0x7f927c141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:33.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f9282176640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f927c142ee0 0x7f927c13fb20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9274009fd0 tx=0x7f927400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:33.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f92727fc640 1 -- 172.21.15.120:0/3043987788 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9274011830 con 0x7f927c142ee0 2023-12-19T05:39:33.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f92727fc640 1 -- 172.21.15.120:0/3043987788 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9274011990 con 0x7f927c142ee0 2023-12-19T05:39:33.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f9283bd9640 1 -- 172.21.15.120:0/3043987788 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927c147c50 con 0x7f927c142ee0 2023-12-19T05:39:33.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f92727fc640 1 -- 172.21.15.120:0/3043987788 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9274011d20 con 0x7f927c142ee0 2023-12-19T05:39:33.173 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.169+0000 7f9283bd9640 1 -- 172.21.15.120:0/3043987788 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c149610 con 0x7f927c142ee0 2023-12-19T05:39:33.174 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.170+0000 7f9283bd9640 1 -- 172.21.15.120:0/3043987788 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927c06e8c0 con 0x7f927c142ee0 2023-12-19T05:39:33.174 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.170+0000 7f92727fc640 1 -- 172.21.15.120:0/3043987788 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f927401b460 con 0x7f927c142ee0 2023-12-19T05:39:33.174 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.171+0000 7f92727fc640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f926006a430 0x7f926006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.171+0000 7f92727fc640 1 -- 172.21.15.120:0/3043987788 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9274088340 con 0x7f927c142ee0 2023-12-19T05:39:33.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.171+0000 7f9281975640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f926006a430 0x7f926006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.171+0000 7f9281975640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f926006a430 0x7f926006c8f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9278035000 tx=0x7f9278030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:33.176 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.175+0000 7f92727fc640 1 -- 172.21.15.120:0/3043987788 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f927c06e8c0 con 0x7f927c142ee0 2023-12-19T05:39:33.405 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.404+0000 7f9283bd9640 1 -- 172.21.15.120:0/3043987788 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f927c06e8c0 con 0x7f927c142ee0 2023-12-19T05:39:33.408 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.407+0000 7f92727fc640 1 -- 172.21.15.120:0/3043987788 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f927c06e8c0 con 0x7f927c142ee0 2023-12-19T05:39:33.410 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.409+0000 7f9283bd9640 1 -- 172.21.15.120:0/3043987788 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f926006a430 msgr2=0x7f926006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.410 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.409+0000 7f9283bd9640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f926006a430 0x7f926006c8f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9278035000 tx=0x7f9278030000 comp rx=0 tx=0).stop 2023-12-19T05:39:33.410 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.409+0000 7f9283bd9640 1 -- 172.21.15.120:0/3043987788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f927c142ee0 msgr2=0x7f927c13fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.411 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.409+0000 7f9283bd9640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f927c142ee0 0x7f927c13fb20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9274009fd0 tx=0x7f927400b8e0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.411 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.409+0000 7f9283bd9640 1 -- 172.21.15.120:0/3043987788 shutdown_connections 2023-12-19T05:39:33.411 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.409+0000 7f9283bd9640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f926006a430 0x7f926006c8f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.411 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.409+0000 7f9283bd9640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f927c142ee0 0x7f927c13fb20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.411 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.409+0000 7f9283bd9640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f927c0b4e30 0x7f927c13f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.411 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.409+0000 7f9283bd9640 1 --2- 172.21.15.120:0/3043987788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f927c06da70 0x7f927c141a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.411 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.409+0000 7f9283bd9640 1 -- 172.21.15.120:0/3043987788 >> 172.21.15.120:0/3043987788 conn(0x7f927c0bac10 msgr2=0x7f927c13e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:33.411 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.409+0000 7f9283bd9640 1 -- 172.21.15.120:0/3043987788 shutdown_connections 2023-12-19T05:39:33.411 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.409+0000 7f9283bd9640 1 -- 172.21.15.120:0/3043987788 wait complete. 2023-12-19T05:39:33.421 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-19T05:39:33.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.520+0000 7fb37e97e640 1 Processor -- start 2023-12-19T05:39:33.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.520+0000 7fb37e97e640 1 -- start start 2023-12-19T05:39:33.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.521+0000 7fb37e97e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb3780b79b0 0x7fb3780b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.521+0000 7fb37e97e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb3780b8860 0x7fb378144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.521+0000 7fb37e97e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3780b96b0 con 0x7fb378145010 2023-12-19T05:39:33.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.521+0000 7fb37e97e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37814ae10 con 0x7fb3780b79b0 2023-12-19T05:39:33.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.521+0000 7fb37e97e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3780bacc0 con 0x7fb3780b8860 2023-12-19T05:39:33.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.521+0000 7fb377fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb3780b79b0 0x7fb3780b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.521+0000 7fb37cf1b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fb378145010 0x7fb37814b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40264/0 (socket says 172.21.15.120:40264) 2023-12-19T05:39:33.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.521+0000 7fb377fff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb3780b79b0 0x7fb3780b7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46366/0 (socket says 172.21.15.120:46366) 2023-12-19T05:39:33.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.521+0000 7fb37cf1b640 1 -- 172.21.15.120:0/1103590863 learned_addr learned my addr 172.21.15.120:0/1103590863 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:33.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.521+0000 7fb377fff640 1 -- 172.21.15.120:0/1103590863 >> v2:172.21.15.155:3300/0 conn(0x7fb3780b8860 msgr2=0x7fb378144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:33.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.521+0000 7fb377fff640 1 --2- 172.21.15.120:0/1103590863 >> v2:172.21.15.155:3300/0 conn(0x7fb3780b8860 0x7fb378144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.521+0000 7fb377fff640 1 -- 172.21.15.120:0/1103590863 >> v1:172.21.15.120:6789/0 conn(0x7fb378145010 legacy=0x7fb37814b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.521+0000 7fb376ffd640 1 -- 172.21.15.120:0/1103590863 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258086115 0 0) 0x7fb3780b96b0 con 0x7fb378145010 2023-12-19T05:39:33.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.521+0000 7fb377fff640 1 -- 172.21.15.120:0/1103590863 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3780b90f0 con 0x7fb3780b79b0 2023-12-19T05:39:33.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.522+0000 7fb377fff640 1 --2- 172.21.15.120:0/1103590863 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3780b79b0 0x7fb3780b7d90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb378066740 tx=0x7fb36802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c892b2bd0be4d3b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:33.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.522+0000 7fb376ffd640 1 -- 172.21.15.120:0/1103590863 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368031830 con 0x7fb3780b79b0 2023-12-19T05:39:33.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.522+0000 7fb376ffd640 1 -- 172.21.15.120:0/1103590863 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb368031990 con 0x7fb3780b79b0 2023-12-19T05:39:33.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.522+0000 7fb376ffd640 1 -- 172.21.15.120:0/1103590863 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368031d20 con 0x7fb3780b79b0 2023-12-19T05:39:33.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.523+0000 7fb37e97e640 1 -- 172.21.15.120:0/1103590863 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3780b79b0 msgr2=0x7fb3780b7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.523+0000 7fb37e97e640 1 --2- 172.21.15.120:0/1103590863 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3780b79b0 0x7fb3780b7d90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb378066740 tx=0x7fb36802b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.523+0000 7fb37e97e640 1 -- 172.21.15.120:0/1103590863 shutdown_connections 2023-12-19T05:39:33.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.523+0000 7fb37e97e640 1 --2- 172.21.15.120:0/1103590863 >> v2:172.21.15.155:3300/0 conn(0x7fb3780b8860 0x7fb378144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.523+0000 7fb37e97e640 1 --2- 172.21.15.120:0/1103590863 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3780b79b0 0x7fb3780b7d90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.523+0000 7fb37e97e640 1 -- 172.21.15.120:0/1103590863 >> 172.21.15.120:0/1103590863 conn(0x7fb3780c0340 msgr2=0x7fb3780c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:33.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.523+0000 7fb37e97e640 1 -- 172.21.15.120:0/1103590863 shutdown_connections 2023-12-19T05:39:33.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.523+0000 7fb37e97e640 1 -- 172.21.15.120:0/1103590863 wait complete. 2023-12-19T05:39:33.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.524+0000 7fb37e97e640 1 Processor -- start 2023-12-19T05:39:33.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.524+0000 7fb37e97e640 1 -- start start 2023-12-19T05:39:33.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.524+0000 7fb37e97e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3780b79b0 0x7fb3781d4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.524+0000 7fb37e97e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3780b8860 0x7fb3781d3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.524+0000 7fb37e97e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb378145010 0x7fb3780b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.524+0000 7fb37e97e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3781e03e0 con 0x7fb3780b8860 2023-12-19T05:39:33.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.524+0000 7fb37e97e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3781d4580 con 0x7fb3780b79b0 2023-12-19T05:39:33.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.524+0000 7fb37e97e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3781d54a0 con 0x7fb378145010 2023-12-19T05:39:33.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.524+0000 7fb3777fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3780b8860 0x7fb3781d3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb3777fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3780b8860 0x7fb3781d3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46382/0 (socket says 172.21.15.120:46382) 2023-12-19T05:39:33.532 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb3777fe640 1 -- 172.21.15.120:0/2881480272 learned_addr learned my addr 172.21.15.120:0/2881480272 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:33.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb377fff640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3780b79b0 0x7fb3781d4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb37cf1b640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb378145010 0x7fb3780b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb3777fe640 1 -- 172.21.15.120:0/2881480272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb378145010 msgr2=0x7fb3780b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb3777fe640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb378145010 0x7fb3780b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb3777fe640 1 -- 172.21.15.120:0/2881480272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3780b79b0 msgr2=0x7fb3781d4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb3777fe640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3780b79b0 0x7fb3781d4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb3777fe640 1 -- 172.21.15.120:0/2881480272 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb368009400 con 0x7fb3780b8860 2023-12-19T05:39:33.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb37cf1b640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb378145010 0x7fb3780b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:33.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb3777fe640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3780b8860 0x7fb3781d3d60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00b4a0 tx=0x7fb36c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:33.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb374ff9640 1 -- 172.21.15.120:0/2881480272 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c010610 con 0x7fb3780b8860 2023-12-19T05:39:33.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb374ff9640 1 -- 172.21.15.120:0/2881480272 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36c010770 con 0x7fb3780b8860 2023-12-19T05:39:33.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb374ff9640 1 -- 172.21.15.120:0/2881480272 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c010b20 con 0x7fb3780b8860 2023-12-19T05:39:33.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb37e97e640 1 -- 172.21.15.120:0/2881480272 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3781e0070 con 0x7fb3780b8860 2023-12-19T05:39:33.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.525+0000 7fb37e97e640 1 -- 172.21.15.120:0/2881480272 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3781dfd60 con 0x7fb3780b8860 2023-12-19T05:39:33.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.526+0000 7fb37e97e640 1 -- 172.21.15.120:0/2881480272 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3781e0550 con 0x7fb3780b8860 2023-12-19T05:39:33.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.526+0000 7fb374ff9640 1 -- 172.21.15.120:0/2881480272 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb36c010c80 con 0x7fb3780b8860 2023-12-19T05:39:33.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.527+0000 7fb374ff9640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb36406a430 0x7fb36406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.527+0000 7fb374ff9640 1 -- 172.21.15.120:0/2881480272 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb36c088230 con 0x7fb3780b8860 2023-12-19T05:39:33.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.527+0000 7fb377fff640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb36406a430 0x7fb36406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.527+0000 7fb377fff640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb36406a430 0x7fb36406c8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb368036000 tx=0x7fb36803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:33.534 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.531+0000 7fb374ff9640 1 -- 172.21.15.120:0/2881480272 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb36c053b90 con 0x7fb3780b8860 2023-12-19T05:39:33.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.762+0000 7fb37e97e640 1 -- 172.21.15.120:0/2881480272 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb37804e080 con 0x7fb3780b8860 2023-12-19T05:39:33.766 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.765+0000 7fb374ff9640 1 -- 172.21.15.120:0/2881480272 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb36c0140a0 con 0x7fb3780b8860 2023-12-19T05:39:33.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.767+0000 7fb37e97e640 1 -- 172.21.15.120:0/2881480272 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb36406a430 msgr2=0x7fb36406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.767+0000 7fb37e97e640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb36406a430 0x7fb36406c8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb368036000 tx=0x7fb36803c040 comp rx=0 tx=0).stop 2023-12-19T05:39:33.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.767+0000 7fb37e97e640 1 -- 172.21.15.120:0/2881480272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3780b8860 msgr2=0x7fb3781d3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.767+0000 7fb37e97e640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3780b8860 0x7fb3781d3d60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00b4a0 tx=0x7fb36c00b960 comp rx=0 tx=0).stop 2023-12-19T05:39:33.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.767+0000 7fb37e97e640 1 -- 172.21.15.120:0/2881480272 shutdown_connections 2023-12-19T05:39:33.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.767+0000 7fb37e97e640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb36406a430 0x7fb36406c8f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.767+0000 7fb37e97e640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb378145010 0x7fb3780b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.770 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.767+0000 7fb37e97e640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb3780b8860 0x7fb3781d3d60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.770 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.767+0000 7fb37e97e640 1 --2- 172.21.15.120:0/2881480272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3780b79b0 0x7fb3781d4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.770 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.767+0000 7fb37e97e640 1 -- 172.21.15.120:0/2881480272 >> 172.21.15.120:0/2881480272 conn(0x7fb3780c0340 msgr2=0x7fb3780bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:33.770 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.768+0000 7fb37e97e640 1 -- 172.21.15.120:0/2881480272 shutdown_connections 2023-12-19T05:39:33.770 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.768+0000 7fb37e97e640 1 -- 172.21.15.120:0/2881480272 wait complete. 2023-12-19T05:39:33.779 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-19T05:39:33.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.879+0000 7f61398b9640 1 Processor -- start 2023-12-19T05:39:33.880 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.879+0000 7f61398b9640 1 -- start start 2023-12-19T05:39:33.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.879+0000 7f61398b9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61340b7d90 0x7f6134144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.879+0000 7f61398b9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6134145010 0x7f613414b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.881 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.879+0000 7f61398b9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61340b96b0 con 0x7f61340b79b0 2023-12-19T05:39:33.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.879+0000 7f61398b9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f613414ae10 con 0x7f6134145010 2023-12-19T05:39:33.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.879+0000 7f61398b9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61340bacc0 con 0x7f61340b7d90 2023-12-19T05:39:33.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.880+0000 7f61337fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6134145010 0x7f613414b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.880+0000 7f612bfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61340b7d90 0x7f6134144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.880+0000 7f6132ffd640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f61340b79b0 0x7f61340b8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:52796/0 (socket says 172.21.15.120:52796) 2023-12-19T05:39:33.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.880+0000 7f61337fe640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6134145010 0x7f613414b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:54810/0 (socket says 172.21.15.120:54810) 2023-12-19T05:39:33.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.880+0000 7f6132ffd640 1 -- 172.21.15.120:0/3538919231 learned_addr learned my addr 172.21.15.120:0/3538919231 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:33.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.880+0000 7f612bfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61340b7d90 0x7f6134144ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:37784/0 (socket says 172.21.15.120:37784) 2023-12-19T05:39:33.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.880+0000 7f612bfff640 1 -- 172.21.15.120:0/3538919231 >> v2:172.21.15.155:3300/0 conn(0x7f6134145010 msgr2=0x7f613414b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:33.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.880+0000 7f612bfff640 1 --2- 172.21.15.120:0/3538919231 >> v2:172.21.15.155:3300/0 conn(0x7f6134145010 0x7f613414b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.880+0000 7f612bfff640 1 -- 172.21.15.120:0/3538919231 >> v1:172.21.15.155:6789/0 conn(0x7f61340b79b0 legacy=0x7f61340b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.880+0000 7f612bfff640 1 -- 172.21.15.120:0/3538919231 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61340b81d0 con 0x7f61340b7d90 2023-12-19T05:39:33.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.880+0000 7f61327fc640 1 -- 172.21.15.120:0/3538919231 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953492695 0 0) 0x7f61340b96b0 con 0x7f61340b79b0 2023-12-19T05:39:33.882 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.880+0000 7f61337fe640 1 --2- 172.21.15.120:0/3538919231 >> v2:172.21.15.155:3300/0 conn(0x7f6134145010 0x7f613414b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:33.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.881+0000 7f612bfff640 1 --2- 172.21.15.120:0/3538919231 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61340b7d90 0x7f6134144ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f611c0097a0 tx=0x7f611c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=740757084baa4138 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:33.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.881+0000 7f61327fc640 1 -- 172.21.15.120:0/3538919231 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c031830 con 0x7f61340b7d90 2023-12-19T05:39:33.885 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.881+0000 7f61327fc640 1 -- 172.21.15.120:0/3538919231 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c031990 con 0x7f61340b7d90 2023-12-19T05:39:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.881+0000 7f61327fc640 1 -- 172.21.15.120:0/3538919231 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c031d20 con 0x7f61340b7d90 2023-12-19T05:39:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.881+0000 7f61398b9640 1 -- 172.21.15.120:0/3538919231 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61340b7d90 msgr2=0x7f6134144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.881+0000 7f61398b9640 1 --2- 172.21.15.120:0/3538919231 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61340b7d90 0x7f6134144ad0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f611c0097a0 tx=0x7f611c02b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.882+0000 7f61398b9640 1 -- 172.21.15.120:0/3538919231 shutdown_connections 2023-12-19T05:39:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.882+0000 7f61398b9640 1 --2- 172.21.15.120:0/3538919231 >> v2:172.21.15.155:3300/0 conn(0x7f6134145010 0x7f613414b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.882+0000 7f61398b9640 1 --2- 172.21.15.120:0/3538919231 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61340b7d90 0x7f6134144ad0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.882+0000 7f61398b9640 1 -- 172.21.15.120:0/3538919231 >> 172.21.15.120:0/3538919231 conn(0x7f61340c0340 msgr2=0x7f61340c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.882+0000 7f61398b9640 1 -- 172.21.15.120:0/3538919231 shutdown_connections 2023-12-19T05:39:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.882+0000 7f61398b9640 1 -- 172.21.15.120:0/3538919231 wait complete. 2023-12-19T05:39:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.882+0000 7f61398b9640 1 Processor -- start 2023-12-19T05:39:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.883+0000 7f61398b9640 1 -- start start 2023-12-19T05:39:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.883+0000 7f61398b9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61340b79b0 0x7f61340b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.883+0000 7f61398b9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61340b7d90 0x7f61341dfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.886 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.883+0000 7f61398b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6134145010 0x7f61341487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.883+0000 7f61398b9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61340b0990 con 0x7f6134145010 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.883+0000 7f61398b9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61340a74b0 con 0x7f61340b7d90 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.883+0000 7f61398b9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61340a6e50 con 0x7f61340b79b0 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.883+0000 7f61337fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6134145010 0x7f61341487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.883+0000 7f61337fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6134145010 0x7f61341487a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46390/0 (socket says 172.21.15.120:46390) 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.883+0000 7f61337fe640 1 -- 172.21.15.120:0/1015151966 learned_addr learned my addr 172.21.15.120:0/1015151966 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.883+0000 7f612bfff640 1 --2- 172.21.15.120:0/1015151966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61340b7d90 0x7f61341dfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.883+0000 7f6132ffd640 1 --2- 172.21.15.120:0/1015151966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61340b79b0 0x7f61340b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.884+0000 7f61337fe640 1 -- 172.21.15.120:0/1015151966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61340b79b0 msgr2=0x7f61340b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.884+0000 7f61337fe640 1 --2- 172.21.15.120:0/1015151966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61340b79b0 0x7f61340b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.884+0000 7f61337fe640 1 -- 172.21.15.120:0/1015151966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61340b7d90 msgr2=0x7f61341dfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.884+0000 7f61337fe640 1 --2- 172.21.15.120:0/1015151966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61340b7d90 0x7f61341dfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.884+0000 7f61337fe640 1 -- 172.21.15.120:0/1015151966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c009a70 con 0x7f6134145010 2023-12-19T05:39:33.887 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.884+0000 7f61337fe640 1 --2- 172.21.15.120:0/1015151966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6134145010 0x7f61341487a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f612c00efb0 tx=0x7f612c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.884+0000 7f6130ff9640 1 -- 172.21.15.120:0/1015151966 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c014480 con 0x7f6134145010 2023-12-19T05:39:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.884+0000 7f6130ff9640 1 -- 172.21.15.120:0/1015151966 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c00f040 con 0x7f6134145010 2023-12-19T05:39:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.884+0000 7f6130ff9640 1 -- 172.21.15.120:0/1015151966 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c014800 con 0x7f6134145010 2023-12-19T05:39:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.884+0000 7f61398b9640 1 -- 172.21.15.120:0/1015151966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611c009400 con 0x7f6134145010 2023-12-19T05:39:33.888 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.884+0000 7f61398b9640 1 -- 172.21.15.120:0/1015151966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61340a6b70 con 0x7f6134145010 2023-12-19T05:39:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.885+0000 7f61398b9640 1 -- 172.21.15.120:0/1015151966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613404e080 con 0x7f6134145010 2023-12-19T05:39:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.885+0000 7f6130ff9640 1 -- 172.21.15.120:0/1015151966 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f612c014960 con 0x7f6134145010 2023-12-19T05:39:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.885+0000 7f6130ff9640 1 --2- 172.21.15.120:0/1015151966 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f611406a430 0x7f611406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.886+0000 7f6130ff9640 1 -- 172.21.15.120:0/1015151966 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f612c089460 con 0x7f6134145010 2023-12-19T05:39:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.886+0000 7f6132ffd640 1 --2- 172.21.15.120:0/1015151966 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f611406a430 0x7f611406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:33.889 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.886+0000 7f6132ffd640 1 --2- 172.21.15.120:0/1015151966 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f611406a430 0x7f611406c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6124000f60 tx=0x7f6124007d50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:33.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:33.890+0000 7f6130ff9640 1 -- 172.21.15.120:0/1015151966 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f612c054ee0 con 0x7f6134145010 2023-12-19T05:39:34.123 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.122+0000 7f61398b9640 1 -- 172.21.15.120:0/1015151966 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f613414a6f0 con 0x7f6134145010 2023-12-19T05:39:34.126 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.125+0000 7f6130ff9640 1 -- 172.21.15.120:0/1015151966 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f612c0180a0 con 0x7f6134145010 2023-12-19T05:39:34.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.127+0000 7f61398b9640 1 -- 172.21.15.120:0/1015151966 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f611406a430 msgr2=0x7f611406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.127+0000 7f61398b9640 1 --2- 172.21.15.120:0/1015151966 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f611406a430 0x7f611406c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6124000f60 tx=0x7f6124007d50 comp rx=0 tx=0).stop 2023-12-19T05:39:34.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.127+0000 7f61398b9640 1 -- 172.21.15.120:0/1015151966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6134145010 msgr2=0x7f61341487a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.127+0000 7f61398b9640 1 --2- 172.21.15.120:0/1015151966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6134145010 0x7f61341487a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f612c00efb0 tx=0x7f612c00c490 comp rx=0 tx=0).stop 2023-12-19T05:39:34.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.127+0000 7f61398b9640 1 -- 172.21.15.120:0/1015151966 shutdown_connections 2023-12-19T05:39:34.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.127+0000 7f61398b9640 1 --2- 172.21.15.120:0/1015151966 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f611406a430 0x7f611406c8f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.127+0000 7f61398b9640 1 --2- 172.21.15.120:0/1015151966 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6134145010 0x7f61341487a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.127+0000 7f61398b9640 1 --2- 172.21.15.120:0/1015151966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61340b7d90 0x7f61341dfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.127+0000 7f61398b9640 1 --2- 172.21.15.120:0/1015151966 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f61340b79b0 0x7f61340b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.127+0000 7f61398b9640 1 -- 172.21.15.120:0/1015151966 >> 172.21.15.120:0/1015151966 conn(0x7f61340c0340 msgr2=0x7f6134144670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:34.129 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.127+0000 7f61398b9640 1 -- 172.21.15.120:0/1015151966 shutdown_connections 2023-12-19T05:39:34.130 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.127+0000 7f61398b9640 1 -- 172.21.15.120:0/1015151966 wait complete. 2023-12-19T05:39:34.139 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-19T05:39:34.238 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.237+0000 7f5a351dc640 1 Processor -- start 2023-12-19T05:39:34.238 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.237+0000 7f5a351dc640 1 -- start start 2023-12-19T05:39:34.242 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a351dc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b79b0 0x7f5a300b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.242 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a351dc640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f5a300b8860 0x7f5a30144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.242 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a351dc640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a300b96b0 con 0x7f5a30145010 2023-12-19T05:39:34.242 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a351dc640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3014ae10 con 0x7f5a300b8860 2023-12-19T05:39:34.242 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a351dc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300bacc0 con 0x7f5a300b79b0 2023-12-19T05:39:34.242 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2f59e640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f5a30145010 0x7f5a3014b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40268/0 (socket says 172.21.15.120:40268) 2023-12-19T05:39:34.242 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2f59e640 1 -- 172.21.15.120:0/1031780580 learned_addr learned my addr 172.21.15.120:0/1031780580 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:34.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2ed9d640 1 --2- 172.21.15.120:0/1031780580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b79b0 0x7f5a300b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2e59c640 1 --2- 172.21.15.120:0/1031780580 >> v2:172.21.15.155:3300/0 conn(0x7f5a300b8860 0x7f5a30144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 -- 172.21.15.120:0/1031780580 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941098572 0 0) 0x7f5a300b96b0 con 0x7f5a30145010 2023-12-19T05:39:34.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 -- 172.21.15.120:0/1031780580 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a18003520 con 0x7f5a30145010 2023-12-19T05:39:34.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 -- 172.21.15.120:0/1031780580 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1432341703 0 0) 0x7f5a18003520 con 0x7f5a30145010 2023-12-19T05:39:34.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 -- 172.21.15.120:0/1031780580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b79b0 msgr2=0x7f5a300b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:34.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 --2- 172.21.15.120:0/1031780580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b79b0 0x7f5a300b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 -- 172.21.15.120:0/1031780580 >> v2:172.21.15.155:3300/0 conn(0x7f5a300b8860 msgr2=0x7f5a30144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:34.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 --2- 172.21.15.120:0/1031780580 >> v2:172.21.15.155:3300/0 conn(0x7f5a300b8860 0x7f5a30144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 -- 172.21.15.120:0/1031780580 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a300b90f0 con 0x7f5a30145010 2023-12-19T05:39:34.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 -- 172.21.15.120:0/1031780580 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f5a28001670 con 0x7f5a30145010 2023-12-19T05:39:34.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 -- 172.21.15.120:0/1031780580 >> v1:172.21.15.120:6789/0 conn(0x7f5a30145010 legacy=0x7f5a3014b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 --2- 172.21.15.120:0/1031780580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b79b0 0x7f5a18003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.243 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 --2- 172.21.15.120:0/1031780580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a18003ef0 0x7f5a180047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 --2- 172.21.15.120:0/1031780580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a18004d00 0x7f5a18005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 -- 172.21.15.120:0/1031780580 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3014ae10 con 0x7f5a18004d00 2023-12-19T05:39:34.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 -- 172.21.15.120:0/1031780580 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1800b980 con 0x7f5a18003ef0 2023-12-19T05:39:34.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.238+0000 7f5a2dd9b640 1 -- 172.21.15.120:0/1031780580 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1800bac0 con 0x7f5a300b79b0 2023-12-19T05:39:34.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.239+0000 7f5a2f59e640 1 --2- 172.21.15.120:0/1031780580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a18004d00 0x7f5a18005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.239+0000 7f5a2ed9d640 1 --2- 172.21.15.120:0/1031780580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b79b0 0x7f5a18003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.239+0000 7f5a2e59c640 1 --2- 172.21.15.120:0/1031780580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a18003ef0 0x7f5a180047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.239+0000 7f5a2f59e640 1 -- 172.21.15.120:0/1031780580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b79b0 msgr2=0x7f5a18003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:34.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.239+0000 7f5a2f59e640 1 --2- 172.21.15.120:0/1031780580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b79b0 0x7f5a18003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.239+0000 7f5a2f59e640 1 -- 172.21.15.120:0/1031780580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a18003ef0 msgr2=0x7f5a180047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:34.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.239+0000 7f5a2f59e640 1 --2- 172.21.15.120:0/1031780580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a18003ef0 0x7f5a180047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.239+0000 7f5a2f59e640 1 -- 172.21.15.120:0/1031780580 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a18003520 con 0x7f5a18004d00 2023-12-19T05:39:34.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.239+0000 7f5a2f59e640 1 --2- 172.21.15.120:0/1031780580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a18004d00 0x7f5a18005180 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5a30145440 tx=0x7f5a180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987a6266b3bd8eb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:34.244 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.240+0000 7f5a2dd9b640 1 -- 172.21.15.120:0/1031780580 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28005ad0 con 0x7f5a18004d00 2023-12-19T05:39:34.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.240+0000 7f5a2dd9b640 1 -- 172.21.15.120:0/1031780580 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a28005c30 con 0x7f5a18004d00 2023-12-19T05:39:34.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.240+0000 7f5a2dd9b640 1 -- 172.21.15.120:0/1031780580 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2802c880 con 0x7f5a18004d00 2023-12-19T05:39:34.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.240+0000 7f5a351dc640 1 -- 172.21.15.120:0/1031780580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a18004d00 msgr2=0x7f5a18005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.240+0000 7f5a351dc640 1 --2- 172.21.15.120:0/1031780580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a18004d00 0x7f5a18005180 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5a30145440 tx=0x7f5a180057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.240+0000 7f5a2f59e640 1 -- 172.21.15.120:0/1031780580 reap_dead start 2023-12-19T05:39:34.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.240+0000 7f5a351dc640 1 -- 172.21.15.120:0/1031780580 shutdown_connections 2023-12-19T05:39:34.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.240+0000 7f5a351dc640 1 -- 172.21.15.120:0/1031780580 >> 172.21.15.120:0/1031780580 conn(0x7f5a300c0340 msgr2=0x7f5a300c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:34.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.240+0000 7f5a351dc640 1 -- 172.21.15.120:0/1031780580 shutdown_connections 2023-12-19T05:39:34.245 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.240+0000 7f5a351dc640 1 -- 172.21.15.120:0/1031780580 wait complete. 2023-12-19T05:39:34.248 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.241+0000 7f5a351dc640 1 Processor -- start 2023-12-19T05:39:34.248 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.242+0000 7f5a351dc640 1 -- start start 2023-12-19T05:39:34.248 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.242+0000 7f5a351dc640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b2530 0x7f5a301e2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.248 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.242+0000 7f5a351dc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a30147b90 0x7f5a300a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.248 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.242+0000 7f5a351dc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a300a6120 0x7f5a30141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.248 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.242+0000 7f5a351dc640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300bbe70 con 0x7f5a300a6120 2023-12-19T05:39:34.248 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.242+0000 7f5a351dc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30146210 con 0x7f5a30147b90 2023-12-19T05:39:34.248 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.242+0000 7f5a351dc640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300a65a0 con 0x7f5a300b2530 2023-12-19T05:39:34.248 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.242+0000 7f5a2f59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a300a6120 0x7f5a30141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.248 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.242+0000 7f5a2f59e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a300a6120 0x7f5a30141be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46416/0 (socket says 172.21.15.120:46416) 2023-12-19T05:39:34.248 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.242+0000 7f5a2f59e640 1 -- 172.21.15.120:0/4068307453 learned_addr learned my addr 172.21.15.120:0/4068307453 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:34.248 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.242+0000 7f5a2e59c640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a30147b90 0x7f5a300a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.242+0000 7f5a2ed9d640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b2530 0x7f5a301e2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.242+0000 7f5a2f59e640 1 -- 172.21.15.120:0/4068307453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b2530 msgr2=0x7f5a301e2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.242+0000 7f5a2f59e640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b2530 0x7f5a301e2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.243+0000 7f5a2f59e640 1 -- 172.21.15.120:0/4068307453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a30147b90 msgr2=0x7f5a300a5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.243+0000 7f5a2f59e640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a30147b90 0x7f5a300a5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.243+0000 7f5a2f59e640 1 -- 172.21.15.120:0/4068307453 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a301480e0 con 0x7f5a300a6120 2023-12-19T05:39:34.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.243+0000 7f5a2e59c640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a30147b90 0x7f5a300a5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:34.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.243+0000 7f5a2f59e640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a300a6120 0x7f5a30141be0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800c380 tx=0x7f5a28000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:34.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.243+0000 7f5a177fe640 1 -- 172.21.15.120:0/4068307453 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2802ca80 con 0x7f5a300a6120 2023-12-19T05:39:34.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.243+0000 7f5a177fe640 1 -- 172.21.15.120:0/4068307453 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2802cbe0 con 0x7f5a300a6120 2023-12-19T05:39:34.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.243+0000 7f5a177fe640 1 -- 172.21.15.120:0/4068307453 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28001640 con 0x7f5a300a6120 2023-12-19T05:39:34.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.243+0000 7f5a351dc640 1 -- 172.21.15.120:0/4068307453 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a30146460 con 0x7f5a300a6120 2023-12-19T05:39:34.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.243+0000 7f5a351dc640 1 -- 172.21.15.120:0/4068307453 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a30146a20 con 0x7f5a300a6120 2023-12-19T05:39:34.249 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.244+0000 7f5a351dc640 1 -- 172.21.15.120:0/4068307453 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3004e080 con 0x7f5a300a6120 2023-12-19T05:39:34.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.244+0000 7f5a177fe640 1 -- 172.21.15.120:0/4068307453 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5a28032070 con 0x7f5a300a6120 2023-12-19T05:39:34.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.245+0000 7f5a177fe640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f5a1c06a430 0x7f5a1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.245+0000 7f5a2ed9d640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f5a1c06a430 0x7f5a1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.245+0000 7f5a177fe640 1 -- 172.21.15.120:0/4068307453 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5a2803c070 con 0x7f5a300a6120 2023-12-19T05:39:34.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.245+0000 7f5a2ed9d640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f5a1c06a430 0x7f5a1c06c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5a20007520 tx=0x7f5a2000b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:34.250 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.249+0000 7f5a177fe640 1 -- 172.21.15.120:0/4068307453 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5a28074b30 con 0x7f5a300a6120 2023-12-19T05:39:34.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.477+0000 7f5a351dc640 1 -- 172.21.15.120:0/4068307453 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f5a300b3c80 con 0x7f5a300a6120 2023-12-19T05:39:34.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.480+0000 7f5a177fe640 1 -- 172.21.15.120:0/4068307453 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5a28078150 con 0x7f5a300a6120 2023-12-19T05:39:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.482+0000 7f5a351dc640 1 -- 172.21.15.120:0/4068307453 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f5a1c06a430 msgr2=0x7f5a1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.482+0000 7f5a351dc640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f5a1c06a430 0x7f5a1c06c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5a20007520 tx=0x7f5a2000b040 comp rx=0 tx=0).stop 2023-12-19T05:39:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.482+0000 7f5a351dc640 1 -- 172.21.15.120:0/4068307453 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a300a6120 msgr2=0x7f5a30141be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.482+0000 7f5a351dc640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a300a6120 0x7f5a30141be0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800c380 tx=0x7f5a28000fe0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.482+0000 7f5a351dc640 1 -- 172.21.15.120:0/4068307453 shutdown_connections 2023-12-19T05:39:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.482+0000 7f5a351dc640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f5a1c06a430 0x7f5a1c06c8f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.482+0000 7f5a351dc640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f5a300a6120 0x7f5a30141be0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.482+0000 7f5a351dc640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a30147b90 0x7f5a300a5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.484 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.482+0000 7f5a351dc640 1 --2- 172.21.15.120:0/4068307453 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5a300b2530 0x7f5a301e2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.485 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.483+0000 7f5a351dc640 1 -- 172.21.15.120:0/4068307453 >> 172.21.15.120:0/4068307453 conn(0x7f5a300c0340 msgr2=0x7f5a300babc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:34.485 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.483+0000 7f5a351dc640 1 -- 172.21.15.120:0/4068307453 shutdown_connections 2023-12-19T05:39:34.485 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.483+0000 7f5a351dc640 1 -- 172.21.15.120:0/4068307453 wait complete. 2023-12-19T05:39:34.495 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.593+0000 7fd42331b640 1 Processor -- start 2023-12-19T05:39:34.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.593+0000 7fd42331b640 1 -- start start 2023-12-19T05:39:34.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.593+0000 7fd42331b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd41c0b79b0 0x7fd41c0b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd42331b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd41c14b230 0x7fd41c14b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd42331b640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41c0b96b0 con 0x7fd41c0b8860 2023-12-19T05:39:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd42331b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41c14ae10 con 0x7fd41c14b230 2023-12-19T05:39:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd42331b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c0bacc0 con 0x7fd41c0b79b0 2023-12-19T05:39:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd4218b8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd41c14b230 0x7fd41c14b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd4210b7640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd41c0b79b0 0x7fd41c0b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd4218b8640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd41c14b230 0x7fd41c14b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:54864/0 (socket says 172.21.15.120:54864) 2023-12-19T05:39:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd4208b6640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd41c0b8860 0x7fd41c144ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:52806/0 (socket says 172.21.15.120:52806) 2023-12-19T05:39:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd4218b8640 1 -- 172.21.15.120:0/2511871523 learned_addr learned my addr 172.21.15.120:0/2511871523 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd4210b7640 1 -- 172.21.15.120:0/2511871523 >> v2:172.21.15.155:3300/0 conn(0x7fd41c14b230 msgr2=0x7fd41c14b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd4210b7640 1 --2- 172.21.15.120:0/2511871523 >> v2:172.21.15.155:3300/0 conn(0x7fd41c14b230 0x7fd41c14b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd4210b7640 1 -- 172.21.15.120:0/2511871523 >> v1:172.21.15.155:6789/0 conn(0x7fd41c0b8860 legacy=0x7fd41c144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd413fff640 1 -- 172.21.15.120:0/2511871523 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245683013 0 0) 0x7fd41c0b96b0 con 0x7fd41c0b8860 2023-12-19T05:39:34.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd4210b7640 1 -- 172.21.15.120:0/2511871523 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c0b90f0 con 0x7fd41c0b79b0 2023-12-19T05:39:34.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.594+0000 7fd4218b8640 1 --2- 172.21.15.120:0/2511871523 >> v2:172.21.15.155:3300/0 conn(0x7fd41c14b230 0x7fd41c14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:34.600 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.595+0000 7fd4210b7640 1 --2- 172.21.15.120:0/2511871523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd41c0b79b0 0x7fd41c0b7d90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd4180097a0 tx=0x7fd41802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2ba74f593f80e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:34.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.595+0000 7fd413fff640 1 -- 172.21.15.120:0/2511871523 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418031830 con 0x7fd41c0b79b0 2023-12-19T05:39:34.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.595+0000 7fd413fff640 1 -- 172.21.15.120:0/2511871523 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd418031990 con 0x7fd41c0b79b0 2023-12-19T05:39:34.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.595+0000 7fd413fff640 1 -- 172.21.15.120:0/2511871523 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418031d20 con 0x7fd41c0b79b0 2023-12-19T05:39:34.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.596+0000 7fd42331b640 1 -- 172.21.15.120:0/2511871523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd41c0b79b0 msgr2=0x7fd41c0b7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.596+0000 7fd42331b640 1 --2- 172.21.15.120:0/2511871523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd41c0b79b0 0x7fd41c0b7d90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd4180097a0 tx=0x7fd41802b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.601 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.596+0000 7fd42331b640 1 -- 172.21.15.120:0/2511871523 shutdown_connections 2023-12-19T05:39:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.596+0000 7fd42331b640 1 --2- 172.21.15.120:0/2511871523 >> v2:172.21.15.155:3300/0 conn(0x7fd41c14b230 0x7fd41c14b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.596+0000 7fd42331b640 1 --2- 172.21.15.120:0/2511871523 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd41c0b79b0 0x7fd41c0b7d90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.596+0000 7fd42331b640 1 -- 172.21.15.120:0/2511871523 >> 172.21.15.120:0/2511871523 conn(0x7fd41c0c0340 msgr2=0x7fd41c0c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.596+0000 7fd42331b640 1 -- 172.21.15.120:0/2511871523 shutdown_connections 2023-12-19T05:39:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.596+0000 7fd42331b640 1 -- 172.21.15.120:0/2511871523 wait complete. 2023-12-19T05:39:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.597+0000 7fd42331b640 1 Processor -- start 2023-12-19T05:39:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.597+0000 7fd42331b640 1 -- start start 2023-12-19T05:39:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.597+0000 7fd42331b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd41c0b79b0 0x7fd41c0a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.597+0000 7fd42331b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd41c0b8860 0x7fd41c0a5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.597+0000 7fd42331b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd41c14b230 0x7fd41c09d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.597+0000 7fd42331b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c1dfc30 con 0x7fd41c0b8860 2023-12-19T05:39:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.597+0000 7fd42331b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c1e04d0 con 0x7fd41c0b79b0 2023-12-19T05:39:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.597+0000 7fd42331b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c1dfe80 con 0x7fd41c14b230 2023-12-19T05:39:34.602 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.597+0000 7fd4208b6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd41c0b8860 0x7fd41c0a5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.597+0000 7fd4208b6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd41c0b8860 0x7fd41c0a5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46424/0 (socket says 172.21.15.120:46424) 2023-12-19T05:39:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.597+0000 7fd4208b6640 1 -- 172.21.15.120:0/2442301536 learned_addr learned my addr 172.21.15.120:0/2442301536 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.597+0000 7fd4218b8640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd41c14b230 0x7fd41c09d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.597+0000 7fd4210b7640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd41c0b79b0 0x7fd41c0a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.598+0000 7fd4208b6640 1 -- 172.21.15.120:0/2442301536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd41c14b230 msgr2=0x7fd41c09d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.598+0000 7fd4208b6640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd41c14b230 0x7fd41c09d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.598+0000 7fd4208b6640 1 -- 172.21.15.120:0/2442301536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd41c0b79b0 msgr2=0x7fd41c0a5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.598+0000 7fd4208b6640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd41c0b79b0 0x7fd41c0a5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.603 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.598+0000 7fd4208b6640 1 -- 172.21.15.120:0/2442301536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd414009b30 con 0x7fd41c0b8860 2023-12-19T05:39:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.598+0000 7fd4210b7640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd41c0b79b0 0x7fd41c0a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.598+0000 7fd4208b6640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd41c0b8860 0x7fd41c0a5f70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00c500 tx=0x7fd40c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.598+0000 7fd411ffb640 1 -- 172.21.15.120:0/2442301536 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c007560 con 0x7fd41c0b8860 2023-12-19T05:39:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.598+0000 7fd411ffb640 1 -- 172.21.15.120:0/2442301536 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c0047e0 con 0x7fd41c0b8860 2023-12-19T05:39:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.598+0000 7fd411ffb640 1 -- 172.21.15.120:0/2442301536 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c004b90 con 0x7fd41c0b8860 2023-12-19T05:39:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.598+0000 7fd42331b640 1 -- 172.21.15.120:0/2442301536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd418009400 con 0x7fd41c0b8860 2023-12-19T05:39:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.598+0000 7fd42331b640 1 -- 172.21.15.120:0/2442301536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41c09f1d0 con 0x7fd41c0b8860 2023-12-19T05:39:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.599+0000 7fd42331b640 1 -- 172.21.15.120:0/2442301536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41c0bdb40 con 0x7fd41c0b8860 2023-12-19T05:39:34.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.599+0000 7fd411ffb640 1 -- 172.21.15.120:0/2442301536 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd40c004cf0 con 0x7fd41c0b8860 2023-12-19T05:39:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.600+0000 7fd411ffb640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd40006a430 0x7fd40006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.600+0000 7fd4210b7640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd40006a430 0x7fd40006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.600+0000 7fd411ffb640 1 -- 172.21.15.120:0/2442301536 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd40c0876b0 con 0x7fd41c0b8860 2023-12-19T05:39:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.600+0000 7fd4210b7640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd40006a430 0x7fd40006c8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd418036000 tx=0x7fd418008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:34.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.604+0000 7fd411ffb640 1 -- 172.21.15.120:0/2442301536 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd40c0530b0 con 0x7fd41c0b8860 2023-12-19T05:39:34.774 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.773+0000 7fd42331b640 1 -- 172.21.15.120:0/2442301536 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd41c0be6a0 con 0x7fd41c0b8860 2023-12-19T05:39:34.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.774+0000 7fd411ffb640 1 -- 172.21.15.120:0/2442301536 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12437 (secure 0 0 0) 0x7fd40c0566d0 con 0x7fd41c0b8860 2023-12-19T05:39:34.775 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:34.776 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":27,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:39:31.970578+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:34.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.776+0000 7fd42331b640 1 -- 172.21.15.120:0/2442301536 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd40006a430 msgr2=0x7fd40006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.778 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.776+0000 7fd42331b640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd40006a430 0x7fd40006c8f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd418036000 tx=0x7fd418008030 comp rx=0 tx=0).stop 2023-12-19T05:39:34.778 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.776+0000 7fd42331b640 1 -- 172.21.15.120:0/2442301536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd41c0b8860 msgr2=0x7fd41c0a5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.778 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.776+0000 7fd42331b640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd41c0b8860 0x7fd41c0a5f70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00c500 tx=0x7fd40c00c9c0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.778 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.776+0000 7fd42331b640 1 -- 172.21.15.120:0/2442301536 shutdown_connections 2023-12-19T05:39:34.778 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.776+0000 7fd42331b640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd40006a430 0x7fd40006c8f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.778 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.776+0000 7fd42331b640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd41c14b230 0x7fd41c09d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.778 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.776+0000 7fd42331b640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd41c0b8860 0x7fd41c0a5f70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.778 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.776+0000 7fd42331b640 1 --2- 172.21.15.120:0/2442301536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd41c0b79b0 0x7fd41c0a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.778 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.776+0000 7fd42331b640 1 -- 172.21.15.120:0/2442301536 >> 172.21.15.120:0/2442301536 conn(0x7fd41c0c0340 msgr2=0x7fd41c0bd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:34.778 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.776+0000 7fd42331b640 1 -- 172.21.15.120:0/2442301536 shutdown_connections 2023-12-19T05:39:34.778 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.776+0000 7fd42331b640 1 -- 172.21.15.120:0/2442301536 wait complete. 2023-12-19T05:39:34.788 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:45.976868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T05:39:34.788 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T05:39:34.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.890+0000 7efdaf527640 1 Processor -- start 2023-12-19T05:39:34.891 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.890+0000 7efdaf527640 1 -- start start 2023-12-19T05:39:34.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.891+0000 7efdaf527640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efda8142850 0x7efda806ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.891+0000 7efdaf527640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda8070730 con 0x7efda8142cc0 2023-12-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.891+0000 7efdaf527640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda8071230 con 0x7efda80b68b0 2023-12-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.891+0000 7efdaf527640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda806ab00 con 0x7efda8142850 2023-12-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.891+0000 7efdacac2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7efda8142850 0x7efda806ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.891+0000 7efdadac4640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7efda8142cc0 0x7efda81531c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40280/0 (socket says 172.21.15.120:40280) 2023-12-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.891+0000 7efdadac4640 1 -- 172.21.15.120:0/947157769 learned_addr learned my addr 172.21.15.120:0/947157769 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.891+0000 7efdacac2640 1 -- 172.21.15.120:0/947157769 >> v1:172.21.15.155:6789/0 conn(0x7efda80b68b0 legacy=0x7efda806fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.891+0000 7efdacac2640 1 -- 172.21.15.120:0/947157769 >> v1:172.21.15.120:6789/0 conn(0x7efda8142cc0 legacy=0x7efda81531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.891+0000 7efd9ffff640 1 -- 172.21.15.120:0/947157769 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566561945 0 0) 0x7efda8070730 con 0x7efda8142cc0 2023-12-19T05:39:34.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.891+0000 7efdacac2640 1 -- 172.21.15.120:0/947157769 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda80714d0 con 0x7efda8142850 2023-12-19T05:39:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.892+0000 7efdacac2640 1 --2- 172.21.15.120:0/947157769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efda8142850 0x7efda806ae20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efd980097a0 tx=0x7efd9802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b04a80911568126 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.892+0000 7efd9ffff640 1 -- 172.21.15.120:0/947157769 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9802e070 con 0x7efda8142850 2023-12-19T05:39:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.892+0000 7efd9ffff640 1 -- 172.21.15.120:0/947157769 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd980315a0 con 0x7efda8142850 2023-12-19T05:39:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.892+0000 7efd9ffff640 1 -- 172.21.15.120:0/947157769 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98031930 con 0x7efda8142850 2023-12-19T05:39:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.893+0000 7efdaf527640 1 -- 172.21.15.120:0/947157769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efda8142850 msgr2=0x7efda806ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.893+0000 7efdaf527640 1 --2- 172.21.15.120:0/947157769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efda8142850 0x7efda806ae20 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efd980097a0 tx=0x7efd9802b840 comp rx=0 tx=0).stop 2023-12-19T05:39:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.893+0000 7efdaf527640 1 -- 172.21.15.120:0/947157769 shutdown_connections 2023-12-19T05:39:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.893+0000 7efdaf527640 1 --2- 172.21.15.120:0/947157769 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efda8142850 0x7efda806ae20 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.893+0000 7efdaf527640 1 -- 172.21.15.120:0/947157769 >> 172.21.15.120:0/947157769 conn(0x7efda80bd210 msgr2=0x7efda80bd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:34.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.893+0000 7efdaf527640 1 -- 172.21.15.120:0/947157769 shutdown_connections 2023-12-19T05:39:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.893+0000 7efdaf527640 1 -- 172.21.15.120:0/947157769 wait complete. 2023-12-19T05:39:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.894+0000 7efdaf527640 1 Processor -- start 2023-12-19T05:39:34.896 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.894+0000 7efdaf527640 1 -- start start 2023-12-19T05:39:34.899 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.894+0000 7efdaf527640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efda80b68b0 0x7efda81438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.899 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.894+0000 7efdaf527640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda8142850 0x7efda813a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.899 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.894+0000 7efdaf527640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efda8142cc0 0x7efda8141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.894+0000 7efdaf527640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda8143e30 con 0x7efda8142cc0 2023-12-19T05:39:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.894+0000 7efdaf527640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda813a7e0 con 0x7efda80b68b0 2023-12-19T05:39:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.894+0000 7efdaf527640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda8144010 con 0x7efda8142850 2023-12-19T05:39:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.894+0000 7efdadac4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efda8142cc0 0x7efda8141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.894+0000 7efdadac4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efda8142cc0 0x7efda8141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46438/0 (socket says 172.21.15.120:46438) 2023-12-19T05:39:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efdadac4640 1 -- 172.21.15.120:0/2035724068 learned_addr learned my addr 172.21.15.120:0/2035724068 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efdad2c3640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efda80b68b0 0x7efda81438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efdacac2640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda8142850 0x7efda813a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efdadac4640 1 -- 172.21.15.120:0/2035724068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda8142850 msgr2=0x7efda813a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efdadac4640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda8142850 0x7efda813a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efdadac4640 1 -- 172.21.15.120:0/2035724068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efda80b68b0 msgr2=0x7efda81438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:34.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efdadac4640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efda80b68b0 0x7efda81438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:34.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efdadac4640 1 -- 172.21.15.120:0/2035724068 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd98009400 con 0x7efda8142cc0 2023-12-19T05:39:34.902 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efdad2c3640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efda80b68b0 0x7efda81438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:34.902 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efdadac4640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efda8142cc0 0x7efda8141a50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efda000c3e0 tx=0x7efda000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:34.902 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efd9dffb640 1 -- 172.21.15.120:0/2035724068 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda0005d30 con 0x7efda8142cc0 2023-12-19T05:39:34.902 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efd9dffb640 1 -- 172.21.15.120:0/2035724068 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda0005e90 con 0x7efda8142cc0 2023-12-19T05:39:34.902 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efdaf527640 1 -- 172.21.15.120:0/2035724068 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda81442f0 con 0x7efda8142cc0 2023-12-19T05:39:34.902 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efd9dffb640 1 -- 172.21.15.120:0/2035724068 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda0007310 con 0x7efda8142cc0 2023-12-19T05:39:34.903 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.895+0000 7efdaf527640 1 -- 172.21.15.120:0/2035724068 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda8141530 con 0x7efda8142cc0 2023-12-19T05:39:34.903 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.896+0000 7efdaf527640 1 -- 172.21.15.120:0/2035724068 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda8141750 con 0x7efda8142cc0 2023-12-19T05:39:34.903 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.896+0000 7efd9dffb640 1 -- 172.21.15.120:0/2035724068 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efda0007530 con 0x7efda8142cc0 2023-12-19T05:39:34.903 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.897+0000 7efd9dffb640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efd8c06a430 0x7efd8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:34.903 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.897+0000 7efdad2c3640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efd8c06a430 0x7efd8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:34.903 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.897+0000 7efd9dffb640 1 -- 172.21.15.120:0/2035724068 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efda0087c10 con 0x7efda8142cc0 2023-12-19T05:39:34.903 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.897+0000 7efdad2c3640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efd8c06a430 0x7efd8c06c8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efda4001e50 tx=0x7efda4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:34.904 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:34.901+0000 7efd9dffb640 1 -- 172.21.15.120:0/2035724068 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7efda00534c0 con 0x7efda8142cc0 2023-12-19T05:39:35.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.065+0000 7efdaf527640 1 -- 172.21.15.120:0/2035724068 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efda80b3f00 con 0x7efda8142cc0 2023-12-19T05:39:35.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.066+0000 7efd9dffb640 1 -- 172.21.15.120:0/2035724068 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7efda0017070 con 0x7efda8142cc0 2023-12-19T05:39:35.067 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2023-12-19T05:39:35.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.067+0000 7efdaf527640 1 -- 172.21.15.120:0/2035724068 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efd8c06a430 msgr2=0x7efd8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.067+0000 7efdaf527640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efd8c06a430 0x7efd8c06c8f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efda4001e50 tx=0x7efda4009040 comp rx=0 tx=0).stop 2023-12-19T05:39:35.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.067+0000 7efdaf527640 1 -- 172.21.15.120:0/2035724068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efda8142cc0 msgr2=0x7efda8141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.067+0000 7efdaf527640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efda8142cc0 0x7efda8141a50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efda000c3e0 tx=0x7efda000c8a0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.068+0000 7efdaf527640 1 -- 172.21.15.120:0/2035724068 shutdown_connections 2023-12-19T05:39:35.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.068+0000 7efdaf527640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7efd8c06a430 0x7efd8c06c8f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.068+0000 7efdaf527640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7efda8142cc0 0x7efda8141a50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.068+0000 7efdaf527640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7efda8142850 0x7efda813a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.068+0000 7efdaf527640 1 --2- 172.21.15.120:0/2035724068 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efda80b68b0 0x7efda81438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.068+0000 7efdaf527640 1 -- 172.21.15.120:0/2035724068 >> 172.21.15.120:0/2035724068 conn(0x7efda80bd210 msgr2=0x7efda813ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:35.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.068+0000 7efdaf527640 1 -- 172.21.15.120:0/2035724068 shutdown_connections 2023-12-19T05:39:35.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.068+0000 7efdaf527640 1 -- 172.21.15.120:0/2035724068 wait complete. 2023-12-19T05:39:35.079 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T05:39:35.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.177+0000 7f8bf84b2640 1 Processor -- start 2023-12-19T05:39:35.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.177+0000 7f8bf84b2640 1 -- start start 2023-12-19T05:39:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.177+0000 7f8bf84b2640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8bf00b8e90 0x7f8bf0144ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.177+0000 7f8bf84b2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bf00b8790 0x7f8bf014b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.177+0000 7f8bf84b2640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf00b6e20 con 0x7f8bf0145020 2023-12-19T05:39:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.177+0000 7f8bf84b2640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf00bacd0 con 0x7f8bf00b8e90 2023-12-19T05:39:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.177+0000 7f8bf84b2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf014ab60 con 0x7f8bf00b8790 2023-12-19T05:39:35.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.178+0000 7f8bf624e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8bf00b8e90 0x7f8bf0144ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.178+0000 7f8bf624e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f8bf00b8e90 0x7f8bf0144ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46454/0 (socket says 172.21.15.120:46454) 2023-12-19T05:39:35.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.178+0000 7f8bf624e640 1 -- 172.21.15.120:0/2570658118 learned_addr learned my addr 172.21.15.120:0/2570658118 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:35.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.178+0000 7f8bf5a4d640 1 --2- 172.21.15.120:0/2570658118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bf00b8790 0x7f8bf014b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.178+0000 7f8bf624e640 1 -- 172.21.15.120:0/2570658118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bf00b8790 msgr2=0x7f8bf014b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:35.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.178+0000 7f8bf624e640 1 --2- 172.21.15.120:0/2570658118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bf00b8790 0x7f8bf014b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.178+0000 7f8bf624e640 1 -- 172.21.15.120:0/2570658118 >> v1:172.21.15.155:6789/0 conn(0x7f8bf0145020 legacy=0x7f8bf014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.178+0000 7f8bf624e640 1 -- 172.21.15.120:0/2570658118 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf00bc720 con 0x7f8bf00b8e90 2023-12-19T05:39:35.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.179+0000 7f8bf624e640 1 --2- 172.21.15.120:0/2570658118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf00b8e90 0x7f8bf0144ae0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009850 tx=0x7f8bec02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893bc3834054e52d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:35.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.179+0000 7f8bf524c640 1 -- 172.21.15.120:0/2570658118 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec004230 con 0x7f8bf00b8e90 2023-12-19T05:39:35.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.179+0000 7f8bf524c640 1 -- 172.21.15.120:0/2570658118 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bec004390 con 0x7f8bf00b8e90 2023-12-19T05:39:35.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.179+0000 7f8bf524c640 1 -- 172.21.15.120:0/2570658118 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec003810 con 0x7f8bf00b8e90 2023-12-19T05:39:35.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.179+0000 7f8bf84b2640 1 -- 172.21.15.120:0/2570658118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf00b8e90 msgr2=0x7f8bf0144ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.179+0000 7f8bf84b2640 1 --2- 172.21.15.120:0/2570658118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf00b8e90 0x7f8bf0144ae0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009850 tx=0x7f8bec02b9f0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.179+0000 7f8bf84b2640 1 -- 172.21.15.120:0/2570658118 shutdown_connections 2023-12-19T05:39:35.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.179+0000 7f8bf84b2640 1 --2- 172.21.15.120:0/2570658118 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bf00b8790 0x7f8bf014b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.179+0000 7f8bf84b2640 1 --2- 172.21.15.120:0/2570658118 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf00b8e90 0x7f8bf0144ae0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.179+0000 7f8bf84b2640 1 -- 172.21.15.120:0/2570658118 >> 172.21.15.120:0/2570658118 conn(0x7f8bf00c0350 msgr2=0x7f8bf00c0730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:35.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.179+0000 7f8bf84b2640 1 -- 172.21.15.120:0/2570658118 shutdown_connections 2023-12-19T05:39:35.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.179+0000 7f8bf84b2640 1 -- 172.21.15.120:0/2570658118 wait complete. 2023-12-19T05:39:35.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.180+0000 7f8bf84b2640 1 Processor -- start 2023-12-19T05:39:35.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.180+0000 7f8bf84b2640 1 -- start start 2023-12-19T05:39:35.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf84b2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bf00b8790 0x7f8bf014e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf84b2640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf00b8e90 0x7f8bf0137950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf84b2640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bf0145020 0x7f8bf00b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf84b2640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0139160 con 0x7f8bf00b8e90 2023-12-19T05:39:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf84b2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf014eda0 con 0x7f8bf00b8790 2023-12-19T05:39:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf84b2640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0137450 con 0x7f8bf0145020 2023-12-19T05:39:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf5a4d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf00b8e90 0x7f8bf0137950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf5a4d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf00b8e90 0x7f8bf0137950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46468/0 (socket says 172.21.15.120:46468) 2023-12-19T05:39:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf5a4d640 1 -- 172.21.15.120:0/4232767188 learned_addr learned my addr 172.21.15.120:0/4232767188 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf624e640 1 --2- 172.21.15.120:0/4232767188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bf00b8790 0x7f8bf014e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf6a4f640 1 --2- 172.21.15.120:0/4232767188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bf0145020 0x7f8bf00b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf5a4d640 1 -- 172.21.15.120:0/4232767188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bf0145020 msgr2=0x7f8bf00b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf5a4d640 1 --2- 172.21.15.120:0/4232767188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bf0145020 0x7f8bf00b2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf5a4d640 1 -- 172.21.15.120:0/4232767188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bf00b8790 msgr2=0x7f8bf014e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf5a4d640 1 --2- 172.21.15.120:0/4232767188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bf00b8790 0x7f8bf014e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf5a4d640 1 -- 172.21.15.120:0/4232767188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec009460 con 0x7f8bf00b8e90 2023-12-19T05:39:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8bf5a4d640 1 --2- 172.21.15.120:0/4232767188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf00b8e90 0x7f8bf0137950 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8be000d800 tx=0x7f8be000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:35.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.181+0000 7f8be6ffd640 1 -- 172.21.15.120:0/4232767188 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be000b6c0 con 0x7f8bf00b8e90 2023-12-19T05:39:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.182+0000 7f8be6ffd640 1 -- 172.21.15.120:0/4232767188 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be000b840 con 0x7f8bf00b8e90 2023-12-19T05:39:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.182+0000 7f8bf84b2640 1 -- 172.21.15.120:0/4232767188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf01482f0 con 0x7f8bf00b8e90 2023-12-19T05:39:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.182+0000 7f8be6ffd640 1 -- 172.21.15.120:0/4232767188 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be000bbf0 con 0x7f8bf00b8e90 2023-12-19T05:39:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.182+0000 7f8bf84b2640 1 -- 172.21.15.120:0/4232767188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf01488b0 con 0x7f8bf00b8e90 2023-12-19T05:39:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.182+0000 7f8bf84b2640 1 -- 172.21.15.120:0/4232767188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf0137610 con 0x7f8bf00b8e90 2023-12-19T05:39:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.183+0000 7f8be6ffd640 1 -- 172.21.15.120:0/4232767188 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8be000bd50 con 0x7f8bf00b8e90 2023-12-19T05:39:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.183+0000 7f8be6ffd640 1 --2- 172.21.15.120:0/4232767188 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8bd406a430 0x7f8bd406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.183+0000 7f8bf624e640 1 --2- 172.21.15.120:0/4232767188 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8bd406a430 0x7f8bd406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.183+0000 7f8be6ffd640 1 -- 172.21.15.120:0/4232767188 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8be0088b10 con 0x7f8bf00b8e90 2023-12-19T05:39:35.186 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.184+0000 7f8bf624e640 1 --2- 172.21.15.120:0/4232767188 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8bd406a430 0x7f8bd406c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8bec035000 tx=0x7f8bec008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:35.188 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.187+0000 7f8be6ffd640 1 -- 172.21.15.120:0/4232767188 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f8be0054450 con 0x7f8bf00b8e90 2023-12-19T05:39:35.356 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.355+0000 7f8bf84b2640 1 -- 172.21.15.120:0/4232767188 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8bf004e080 con 0x7f8bf00b8e90 2023-12-19T05:39:35.357 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.356+0000 7f8be6ffd640 1 -- 172.21.15.120:0/4232767188 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8be0057a70 con 0x7f8bf00b8e90 2023-12-19T05:39:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:35.357 INFO:teuthology.orchestra.run.smithi120.stdout:[ 2023-12-19T05:39:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2023-12-19T05:39:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "poolnum": 1, 2023-12-19T05:39:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "poolname": ".mgr" 2023-12-19T05:39:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: } 2023-12-19T05:39:35.357 INFO:teuthology.orchestra.run.smithi120.stdout:] 2023-12-19T05:39:35.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.357+0000 7f8bf84b2640 1 -- 172.21.15.120:0/4232767188 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8bd406a430 msgr2=0x7f8bd406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.357+0000 7f8bf84b2640 1 --2- 172.21.15.120:0/4232767188 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8bd406a430 0x7f8bd406c8f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8bec035000 tx=0x7f8bec008030 comp rx=0 tx=0).stop 2023-12-19T05:39:35.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.357+0000 7f8bf84b2640 1 -- 172.21.15.120:0/4232767188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf00b8e90 msgr2=0x7f8bf0137950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.357+0000 7f8bf84b2640 1 --2- 172.21.15.120:0/4232767188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf00b8e90 0x7f8bf0137950 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8be000d800 tx=0x7f8be000dcc0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.357+0000 7f8bf84b2640 1 -- 172.21.15.120:0/4232767188 shutdown_connections 2023-12-19T05:39:35.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.357+0000 7f8bf84b2640 1 --2- 172.21.15.120:0/4232767188 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f8bd406a430 0x7f8bd406c8f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.357+0000 7f8bf84b2640 1 --2- 172.21.15.120:0/4232767188 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f8bf0145020 0x7f8bf00b2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.357+0000 7f8bf84b2640 1 --2- 172.21.15.120:0/4232767188 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f8bf00b8e90 0x7f8bf0137950 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.357+0000 7f8bf84b2640 1 --2- 172.21.15.120:0/4232767188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bf00b8790 0x7f8bf014e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.359 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.358+0000 7f8bf84b2640 1 -- 172.21.15.120:0/4232767188 >> 172.21.15.120:0/4232767188 conn(0x7f8bf00c0350 msgr2=0x7f8bf00be8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:35.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.358+0000 7f8bf84b2640 1 -- 172.21.15.120:0/4232767188 shutdown_connections 2023-12-19T05:39:35.360 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.358+0000 7f8bf84b2640 1 -- 172.21.15.120:0/4232767188 wait complete. 2023-12-19T05:39:35.370 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T05:39:35.370 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T05:39:35.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.471+0000 7f9471c84640 1 Processor -- start 2023-12-19T05:39:35.472 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.471+0000 7f9471c84640 1 -- start start 2023-12-19T05:39:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.471+0000 7f9471c84640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f946c144d70 0x7f946c0b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.471+0000 7f9471c84640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f946c14df70 0x7f946c0b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.471+0000 7f9471c84640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946c145150 con 0x7f946c0bc7e0 2023-12-19T05:39:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.471+0000 7f9471c84640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946c0b9f00 con 0x7f946c144d70 2023-12-19T05:39:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.471+0000 7f9471c84640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946c0b84b0 con 0x7f946c14df70 2023-12-19T05:39:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.472+0000 7f946b7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f946c144d70 0x7f946c0b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.472+0000 7f946bfff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f946c0bc7e0 0x7f946c0bcc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40294/0 (socket says 172.21.15.120:40294) 2023-12-19T05:39:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.472+0000 7f946bfff640 1 -- 172.21.15.120:0/547028505 learned_addr learned my addr 172.21.15.120:0/547028505 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.472+0000 7f946affd640 1 --2- 172.21.15.120:0/547028505 >> v2:172.21.15.155:3300/0 conn(0x7f946c14df70 0x7f946c0b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.472+0000 7f946b7fe640 1 -- 172.21.15.120:0/547028505 >> v2:172.21.15.155:3300/0 conn(0x7f946c14df70 msgr2=0x7f946c0b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:35.474 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.472+0000 7f946b7fe640 1 --2- 172.21.15.120:0/547028505 >> v2:172.21.15.155:3300/0 conn(0x7f946c14df70 0x7f946c0b8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.472+0000 7f946b7fe640 1 -- 172.21.15.120:0/547028505 >> v1:172.21.15.120:6789/0 conn(0x7f946c0bc7e0 legacy=0x7f946c0bcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.472+0000 7f946a7fc640 1 -- 172.21.15.120:0/547028505 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1433998489 0 0) 0x7f946c145150 con 0x7f946c0bc7e0 2023-12-19T05:39:35.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.472+0000 7f946b7fe640 1 -- 172.21.15.120:0/547028505 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c0b9080 con 0x7f946c144d70 2023-12-19T05:39:35.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.473+0000 7f946b7fe640 1 --2- 172.21.15.120:0/547028505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946c144d70 0x7f946c0b7f70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f946c1485f0 tx=0x7f946002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13560c909f79810 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:35.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.473+0000 7f946a7fc640 1 -- 172.21.15.120:0/547028505 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460030610 con 0x7f946c144d70 2023-12-19T05:39:35.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.473+0000 7f946a7fc640 1 -- 172.21.15.120:0/547028505 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9460030770 con 0x7f946c144d70 2023-12-19T05:39:35.475 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.473+0000 7f946a7fc640 1 -- 172.21.15.120:0/547028505 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460030b00 con 0x7f946c144d70 2023-12-19T05:39:35.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.473+0000 7f9471c84640 1 -- 172.21.15.120:0/547028505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946c144d70 msgr2=0x7f946c0b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.473+0000 7f9471c84640 1 --2- 172.21.15.120:0/547028505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946c144d70 0x7f946c0b7f70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f946c1485f0 tx=0x7f946002b960 comp rx=0 tx=0).stop 2023-12-19T05:39:35.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.473+0000 7f9471c84640 1 -- 172.21.15.120:0/547028505 shutdown_connections 2023-12-19T05:39:35.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.473+0000 7f9471c84640 1 --2- 172.21.15.120:0/547028505 >> v2:172.21.15.155:3300/0 conn(0x7f946c14df70 0x7f946c0b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.473+0000 7f9471c84640 1 --2- 172.21.15.120:0/547028505 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946c144d70 0x7f946c0b7f70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.478 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.473+0000 7f9471c84640 1 -- 172.21.15.120:0/547028505 >> 172.21.15.120:0/547028505 conn(0x7f946c071430 msgr2=0x7f946c071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:35.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.473+0000 7f9471c84640 1 -- 172.21.15.120:0/547028505 shutdown_connections 2023-12-19T05:39:35.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.473+0000 7f9471c84640 1 -- 172.21.15.120:0/547028505 wait complete. 2023-12-19T05:39:35.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.474+0000 7f9471c84640 1 Processor -- start 2023-12-19T05:39:35.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f9471c84640 1 -- start start 2023-12-19T05:39:35.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f9471c84640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946c0bc7e0 0x7f946c0b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f9471c84640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f946c144d70 0x7f946c0ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f9471c84640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f946c14df70 0x7f946c1e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f9471c84640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c0b5c10 con 0x7f946c0bc7e0 2023-12-19T05:39:35.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f9471c84640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f946c0ab5e0 con 0x7f946c14df70 2023-12-19T05:39:35.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f9471c84640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946c0ab850 con 0x7f946c144d70 2023-12-19T05:39:35.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f946b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946c0bc7e0 0x7f946c0b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f946b7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946c0bc7e0 0x7f946c0b56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46488/0 (socket says 172.21.15.120:46488) 2023-12-19T05:39:35.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f946b7fe640 1 -- 172.21.15.120:0/2179238539 learned_addr learned my addr 172.21.15.120:0/2179238539 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:35.479 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f946bfff640 1 --2- 172.21.15.120:0/2179238539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f946c14df70 0x7f946c1e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f946affd640 1 --2- 172.21.15.120:0/2179238539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f946c144d70 0x7f946c0ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f946b7fe640 1 -- 172.21.15.120:0/2179238539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f946c144d70 msgr2=0x7f946c0ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f946b7fe640 1 --2- 172.21.15.120:0/2179238539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f946c144d70 0x7f946c0ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f946b7fe640 1 -- 172.21.15.120:0/2179238539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f946c14df70 msgr2=0x7f946c1e2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f946b7fe640 1 --2- 172.21.15.120:0/2179238539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f946c14df70 0x7f946c1e2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.475+0000 7f946b7fe640 1 -- 172.21.15.120:0/2179238539 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460009400 con 0x7f946c0bc7e0 2023-12-19T05:39:35.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.476+0000 7f946b7fe640 1 --2- 172.21.15.120:0/2179238539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946c0bc7e0 0x7f946c0b56d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f946002bf70 tx=0x7f9460004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:35.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.476+0000 7f9453fff640 1 -- 172.21.15.120:0/2179238539 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946003e040 con 0x7f946c0bc7e0 2023-12-19T05:39:35.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.476+0000 7f9453fff640 1 -- 172.21.15.120:0/2179238539 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9460039cb0 con 0x7f946c0bc7e0 2023-12-19T05:39:35.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.476+0000 7f9471c84640 1 -- 172.21.15.120:0/2179238539 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f946c0a9a10 con 0x7f946c0bc7e0 2023-12-19T05:39:35.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.476+0000 7f9453fff640 1 -- 172.21.15.120:0/2179238539 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460043680 con 0x7f946c0bc7e0 2023-12-19T05:39:35.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.476+0000 7f9471c84640 1 -- 172.21.15.120:0/2179238539 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f946c0a9fd0 con 0x7f946c0bc7e0 2023-12-19T05:39:35.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.477+0000 7f9471c84640 1 -- 172.21.15.120:0/2179238539 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946c04e080 con 0x7f946c0bc7e0 2023-12-19T05:39:35.480 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.477+0000 7f9453fff640 1 -- 172.21.15.120:0/2179238539 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f94600437e0 con 0x7f946c0bc7e0 2023-12-19T05:39:35.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.477+0000 7f9453fff640 1 --2- 172.21.15.120:0/2179238539 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f945806a430 0x7f945806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.478+0000 7f9453fff640 1 -- 172.21.15.120:0/2179238539 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f94600aa7a0 con 0x7f946c0bc7e0 2023-12-19T05:39:35.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.478+0000 7f946affd640 1 --2- 172.21.15.120:0/2179238539 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f945806a430 0x7f945806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.481 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.478+0000 7f946affd640 1 --2- 172.21.15.120:0/2179238539 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f945806a430 0x7f945806c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f946c0b6390 tx=0x7f945c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:35.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.482+0000 7f9453fff640 1 -- 172.21.15.120:0/2179238539 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9460076190 con 0x7f946c0bc7e0 2023-12-19T05:39:35.650 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.649+0000 7f9471c84640 1 -- 172.21.15.120:0/2179238539 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f946c0bc5a0 con 0x7f946c0bc7e0 2023-12-19T05:39:35.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.809+0000 7f9453fff640 1 -- 172.21.15.120:0/2179238539 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9460006e10 con 0x7f946c0bc7e0 2023-12-19T05:39:35.811 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_metadata' created 2023-12-19T05:39:35.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.812+0000 7f9471c84640 1 -- 172.21.15.120:0/2179238539 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f945806a430 msgr2=0x7f945806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.812+0000 7f9471c84640 1 --2- 172.21.15.120:0/2179238539 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f945806a430 0x7f945806c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f946c0b6390 tx=0x7f945c008040 comp rx=0 tx=0).stop 2023-12-19T05:39:35.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.813+0000 7f9471c84640 1 -- 172.21.15.120:0/2179238539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946c0bc7e0 msgr2=0x7f946c0b56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.813+0000 7f9471c84640 1 --2- 172.21.15.120:0/2179238539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946c0bc7e0 0x7f946c0b56d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f946002bf70 tx=0x7f9460004730 comp rx=0 tx=0).stop 2023-12-19T05:39:35.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.813+0000 7f9471c84640 1 -- 172.21.15.120:0/2179238539 shutdown_connections 2023-12-19T05:39:35.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.813+0000 7f9471c84640 1 --2- 172.21.15.120:0/2179238539 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f945806a430 0x7f945806c8f0 secure :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f946c0b6390 tx=0x7f945c008040 comp rx=0 tx=0).stop 2023-12-19T05:39:35.814 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.813+0000 7f9471c84640 1 --2- 172.21.15.120:0/2179238539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f946c14df70 0x7f946c1e2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.813+0000 7f9471c84640 1 --2- 172.21.15.120:0/2179238539 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f946c144d70 0x7f946c0ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.813+0000 7f9471c84640 1 --2- 172.21.15.120:0/2179238539 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f946c0bc7e0 0x7f946c0b56d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.815 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.813+0000 7f9471c84640 1 -- 172.21.15.120:0/2179238539 >> 172.21.15.120:0/2179238539 conn(0x7f946c071430 msgr2=0x7f946c0be150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:35.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.815+0000 7f9471c84640 1 -- 172.21.15.120:0/2179238539 shutdown_connections 2023-12-19T05:39:35.816 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.815+0000 7f9471c84640 1 -- 172.21.15.120:0/2179238539 wait complete. 2023-12-19T05:39:35.828 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T05:39:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.932+0000 7f52f84a1640 1 Processor -- start 2023-12-19T05:39:35.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.932+0000 7f52f84a1640 1 -- start start 2023-12-19T05:39:35.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.933+0000 7f52f84a1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f52f014df70 0x7f52f00b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.933+0000 7f52f84a1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f0145150 con 0x7f52f0144d70 2023-12-19T05:39:35.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.933+0000 7f52f84a1640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f00b9080 con 0x7f52f00bc7e0 2023-12-19T05:39:35.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.933+0000 7f52f84a1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f00b9f00 con 0x7f52f014df70 2023-12-19T05:39:35.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.933+0000 7f52f5a3c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f52f014df70 0x7f52f00b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.933+0000 7f52f623d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f52f0144d70 0x7f52f00b8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40302/0 (socket says 172.21.15.120:40302) 2023-12-19T05:39:35.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.933+0000 7f52f623d640 1 -- 172.21.15.120:0/2713641258 learned_addr learned my addr 172.21.15.120:0/2713641258 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:35.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.933+0000 7f52f5a3c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f52f014df70 0x7f52f00b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46504/0 (socket says 172.21.15.120:46504) 2023-12-19T05:39:35.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.934+0000 7f52f5a3c640 1 -- 172.21.15.120:0/2713641258 >> v1:172.21.15.155:6789/0 conn(0x7f52f00bc7e0 legacy=0x7f52f00bcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:35.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.934+0000 7f52f523b640 1 -- 172.21.15.120:0/2713641258 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703213519 0 0) 0x7f52f0145150 con 0x7f52f0144d70 2023-12-19T05:39:35.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.934+0000 7f52f5a3c640 1 -- 172.21.15.120:0/2713641258 >> v1:172.21.15.120:6789/0 conn(0x7f52f0144d70 legacy=0x7f52f00b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.934+0000 7f52f5a3c640 1 -- 172.21.15.120:0/2713641258 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f00b9360 con 0x7f52f014df70 2023-12-19T05:39:35.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.934+0000 7f52f5a3c640 1 --2- 172.21.15.120:0/2713641258 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52f014df70 0x7f52f00b7f70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f52e00097a0 tx=0x7f52e002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77de22abd1f5cceb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:35.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.934+0000 7f52f523b640 1 -- 172.21.15.120:0/2713641258 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e0030610 con 0x7f52f014df70 2023-12-19T05:39:35.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.935+0000 7f52f523b640 1 -- 172.21.15.120:0/2713641258 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e0030770 con 0x7f52f014df70 2023-12-19T05:39:35.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.935+0000 7f52f523b640 1 -- 172.21.15.120:0/2713641258 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e0030b00 con 0x7f52f014df70 2023-12-19T05:39:35.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.935+0000 7f52f84a1640 1 -- 172.21.15.120:0/2713641258 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52f014df70 msgr2=0x7f52f00b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.935+0000 7f52f84a1640 1 --2- 172.21.15.120:0/2713641258 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52f014df70 0x7f52f00b7f70 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f52e00097a0 tx=0x7f52e002b960 comp rx=0 tx=0).stop 2023-12-19T05:39:35.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.935+0000 7f52f84a1640 1 -- 172.21.15.120:0/2713641258 shutdown_connections 2023-12-19T05:39:35.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.935+0000 7f52f84a1640 1 --2- 172.21.15.120:0/2713641258 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52f014df70 0x7f52f00b7f70 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.935+0000 7f52f84a1640 1 -- 172.21.15.120:0/2713641258 >> 172.21.15.120:0/2713641258 conn(0x7f52f0071430 msgr2=0x7f52f0071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:35.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.935+0000 7f52f84a1640 1 -- 172.21.15.120:0/2713641258 shutdown_connections 2023-12-19T05:39:35.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.935+0000 7f52f84a1640 1 -- 172.21.15.120:0/2713641258 wait complete. 2023-12-19T05:39:35.941 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.936+0000 7f52f84a1640 1 Processor -- start 2023-12-19T05:39:35.941 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.936+0000 7f52f84a1640 1 -- start start 2023-12-19T05:39:35.941 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f84a1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52f00bc7e0 0x7f52f01491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.941 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f84a1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f0144d70 0x7f52f00af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.941 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f84a1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52f014df70 0x7f52f01dfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.941 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f84a1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f014b5e0 con 0x7f52f00bc7e0 2023-12-19T05:39:35.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f84a1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f00af5b0 con 0x7f52f014df70 2023-12-19T05:39:35.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f84a1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f014aa50 con 0x7f52f0144d70 2023-12-19T05:39:35.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f623d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52f00bc7e0 0x7f52f01491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f623d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52f00bc7e0 0x7f52f01491f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46514/0 (socket says 172.21.15.120:46514) 2023-12-19T05:39:35.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f623d640 1 -- 172.21.15.120:0/2207576066 learned_addr learned my addr 172.21.15.120:0/2207576066 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:35.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f6a3e640 1 --2- 172.21.15.120:0/2207576066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52f014df70 0x7f52f01dfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f5a3c640 1 --2- 172.21.15.120:0/2207576066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f0144d70 0x7f52f00af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f623d640 1 -- 172.21.15.120:0/2207576066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f0144d70 msgr2=0x7f52f00af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f623d640 1 --2- 172.21.15.120:0/2207576066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f0144d70 0x7f52f00af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.942 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f623d640 1 -- 172.21.15.120:0/2207576066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52f014df70 msgr2=0x7f52f01dfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:35.943 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f623d640 1 --2- 172.21.15.120:0/2207576066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52f014df70 0x7f52f01dfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:35.943 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f623d640 1 -- 172.21.15.120:0/2207576066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e0009400 con 0x7f52f00bc7e0 2023-12-19T05:39:35.943 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f623d640 1 --2- 172.21.15.120:0/2207576066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52f00bc7e0 0x7f52f01491f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c500 tx=0x7f52ec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:35.943 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52e6ffd640 1 -- 172.21.15.120:0/2207576066 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec007560 con 0x7f52f00bc7e0 2023-12-19T05:39:35.943 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52e6ffd640 1 -- 172.21.15.120:0/2207576066 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec0047e0 con 0x7f52f00bc7e0 2023-12-19T05:39:35.943 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f84a1640 1 -- 172.21.15.120:0/2207576066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f014ac40 con 0x7f52f00bc7e0 2023-12-19T05:39:35.943 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52e6ffd640 1 -- 172.21.15.120:0/2207576066 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec004b90 con 0x7f52f00bc7e0 2023-12-19T05:39:35.943 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.937+0000 7f52f84a1640 1 -- 172.21.15.120:0/2207576066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f014b200 con 0x7f52f00bc7e0 2023-12-19T05:39:35.943 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.938+0000 7f52f84a1640 1 -- 172.21.15.120:0/2207576066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f004e080 con 0x7f52f00bc7e0 2023-12-19T05:39:35.943 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.939+0000 7f52e6ffd640 1 -- 172.21.15.120:0/2207576066 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f52ec004cf0 con 0x7f52f00bc7e0 2023-12-19T05:39:35.943 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.939+0000 7f52e6ffd640 1 --2- 172.21.15.120:0/2207576066 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f52d406a430 0x7f52d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:35.944 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.939+0000 7f52e6ffd640 1 -- 172.21.15.120:0/2207576066 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f52ec087af0 con 0x7f52f00bc7e0 2023-12-19T05:39:35.944 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.939+0000 7f52f5a3c640 1 --2- 172.21.15.120:0/2207576066 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f52d406a430 0x7f52d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:35.944 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.940+0000 7f52f5a3c640 1 --2- 172.21.15.120:0/2207576066 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f52d406a430 0x7f52d406c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52e0036000 tx=0x7f52e0008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:35.946 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:35.944+0000 7f52e6ffd640 1 -- 172.21.15.120:0/2207576066 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f52ec053400 con 0x7f52f00bc7e0 2023-12-19T05:39:36.114 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.112+0000 7f52f84a1640 1 -- 172.21.15.120:0/2207576066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f52f014a630 con 0x7f52f00bc7e0 2023-12-19T05:39:36.817 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.815+0000 7f52e6ffd640 1 -- 172.21.15.120:0/2207576066 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f52ec0180d0 con 0x7f52f00bc7e0 2023-12-19T05:39:36.817 INFO:teuthology.orchestra.run.smithi120.stderr:pool 'cephfs_data' created 2023-12-19T05:39:36.823 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.821+0000 7f52f84a1640 1 -- 172.21.15.120:0/2207576066 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f52d406a430 msgr2=0x7f52d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:36.824 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.821+0000 7f52f84a1640 1 --2- 172.21.15.120:0/2207576066 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f52d406a430 0x7f52d406c8f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52e0036000 tx=0x7f52e0008030 comp rx=0 tx=0).stop 2023-12-19T05:39:36.824 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.821+0000 7f52f84a1640 1 -- 172.21.15.120:0/2207576066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52f00bc7e0 msgr2=0x7f52f01491f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:36.824 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.821+0000 7f52f84a1640 1 --2- 172.21.15.120:0/2207576066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52f00bc7e0 0x7f52f01491f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c500 tx=0x7f52ec00c9c0 comp rx=0 tx=0).stop 2023-12-19T05:39:36.824 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.823+0000 7f52f84a1640 1 -- 172.21.15.120:0/2207576066 shutdown_connections 2023-12-19T05:39:36.824 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.823+0000 7f52f84a1640 1 --2- 172.21.15.120:0/2207576066 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f52d406a430 0x7f52d406c8f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:36.824 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.823+0000 7f52f84a1640 1 --2- 172.21.15.120:0/2207576066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52f014df70 0x7f52f01dfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:36.824 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.823+0000 7f52f84a1640 1 --2- 172.21.15.120:0/2207576066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52f0144d70 0x7f52f00af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:36.824 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.823+0000 7f52f84a1640 1 --2- 172.21.15.120:0/2207576066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f52f00bc7e0 0x7f52f01491f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:36.825 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.823+0000 7f52f84a1640 1 -- 172.21.15.120:0/2207576066 >> 172.21.15.120:0/2207576066 conn(0x7f52f0071430 msgr2=0x7f52f00b6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:36.826 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.825+0000 7f52f84a1640 1 -- 172.21.15.120:0/2207576066 shutdown_connections 2023-12-19T05:39:36.827 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.826+0000 7f52f84a1640 1 -- 172.21.15.120:0/2207576066 wait complete. 2023-12-19T05:39:36.846 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T05:39:36.952 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.951+0000 7f9e1c884640 1 Processor -- start 2023-12-19T05:39:36.952 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.951+0000 7f9e1c884640 1 -- start start 2023-12-19T05:39:36.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.951+0000 7f9e1c884640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f9e180b4b40 0x7f9e180b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:36.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.951+0000 7f9e1c884640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e180b5240 con 0x7f9e180b9a10 2023-12-19T05:39:36.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.951+0000 7f9e1c884640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e180b9e80 con 0x7f9e18144db0 2023-12-19T05:39:36.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.951+0000 7f9e1c884640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e1806b160 con 0x7f9e180b4b40 2023-12-19T05:39:36.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.951+0000 7f9e16d9d640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9e180b9a10 0x7f9e18155380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40306/0 (socket says 172.21.15.120:40306) 2023-12-19T05:39:36.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.951+0000 7f9e16d9d640 1 -- 172.21.15.120:0/2296798066 learned_addr learned my addr 172.21.15.120:0/2296798066 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:36.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e0ffff640 1 --2- 172.21.15.120:0/2296798066 >> v2:172.21.15.155:3300/0 conn(0x7f9e180b4b40 0x7f9e180b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:36.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 -- 172.21.15.120:0/2296798066 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847664119 0 0) 0x7f9e10001490 con 0x7f9e180b9a10 2023-12-19T05:39:36.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 -- 172.21.15.120:0/2296798066 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e04003520 con 0x7f9e180b9a10 2023-12-19T05:39:36.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 -- 172.21.15.120:0/2296798066 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2145716341 0 0) 0x7f9e04003520 con 0x7f9e180b9a10 2023-12-19T05:39:36.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 -- 172.21.15.120:0/2296798066 >> v2:172.21.15.155:3300/0 conn(0x7f9e180b4b40 msgr2=0x7f9e180b94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:36.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 --2- 172.21.15.120:0/2296798066 >> v2:172.21.15.155:3300/0 conn(0x7f9e180b4b40 0x7f9e180b94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:36.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 -- 172.21.15.120:0/2296798066 >> v1:172.21.15.155:6789/0 conn(0x7f9e18144db0 legacy=0x7f9e180ba920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:36.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 -- 172.21.15.120:0/2296798066 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e180ba690 con 0x7f9e180b9a10 2023-12-19T05:39:36.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 -- 172.21.15.120:0/2296798066 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f9e10001b80 con 0x7f9e180b9a10 2023-12-19T05:39:36.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 -- 172.21.15.120:0/2296798066 >> v1:172.21.15.120:6789/0 conn(0x7f9e180b9a10 legacy=0x7f9e18155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:36.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 --2- 172.21.15.120:0/2296798066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e04003970 0x7f9e04003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:36.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 --2- 172.21.15.120:0/2296798066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e040047c0 0x7f9e04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:36.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 --2- 172.21.15.120:0/2296798066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e04005180 0x7f9e0400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:36.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 -- 172.21.15.120:0/2296798066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1806b160 con 0x7f9e04003970 2023-12-19T05:39:36.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 -- 172.21.15.120:0/2296798066 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0400c020 con 0x7f9e040047c0 2023-12-19T05:39:36.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e15d9b640 1 -- 172.21.15.120:0/2296798066 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0400c1e0 con 0x7f9e04005180 2023-12-19T05:39:36.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e1659c640 1 --2- 172.21.15.120:0/2296798066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e04003970 0x7f9e04003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:36.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e0ffff640 1 --2- 172.21.15.120:0/2296798066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e040047c0 0x7f9e04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:36.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e16d9d640 1 --2- 172.21.15.120:0/2296798066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e04005180 0x7f9e0400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:36.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e1659c640 1 -- 172.21.15.120:0/2296798066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e04005180 msgr2=0x7f9e0400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:36.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e1659c640 1 --2- 172.21.15.120:0/2296798066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e04005180 0x7f9e0400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:36.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e1659c640 1 -- 172.21.15.120:0/2296798066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e040047c0 msgr2=0x7f9e04004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:36.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e1659c640 1 --2- 172.21.15.120:0/2296798066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e040047c0 0x7f9e04004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:36.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e1659c640 1 -- 172.21.15.120:0/2296798066 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04003520 con 0x7f9e04003970 2023-12-19T05:39:36.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e16d9d640 1 --2- 172.21.15.120:0/2296798066 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e04005180 0x7f9e0400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:36.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.952+0000 7f9e16d9d640 1 -- 172.21.15.120:0/2296798066 reap_dead start 2023-12-19T05:39:36.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.953+0000 7f9e1659c640 1 --2- 172.21.15.120:0/2296798066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e04003970 0x7f9e04003d90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9e08001750 tx=0x7f9e040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d989a9a453cc12 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:36.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.953+0000 7f9e15d9b640 1 -- 172.21.15.120:0/2296798066 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e080052d0 con 0x7f9e04003970 2023-12-19T05:39:36.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.953+0000 7f9e15d9b640 1 -- 172.21.15.120:0/2296798066 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0802e050 con 0x7f9e04003970 2023-12-19T05:39:36.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.953+0000 7f9e15d9b640 1 -- 172.21.15.120:0/2296798066 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e08003830 con 0x7f9e04003970 2023-12-19T05:39:36.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.954+0000 7f9e1c884640 1 -- 172.21.15.120:0/2296798066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e04003970 msgr2=0x7f9e04003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:36.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.954+0000 7f9e1c884640 1 --2- 172.21.15.120:0/2296798066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e04003970 0x7f9e04003d90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9e08001750 tx=0x7f9e040057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:36.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.954+0000 7f9e1c884640 1 -- 172.21.15.120:0/2296798066 shutdown_connections 2023-12-19T05:39:36.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.954+0000 7f9e1c884640 1 --2- 172.21.15.120:0/2296798066 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e04003970 0x7f9e04003d90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:36.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.954+0000 7f9e1c884640 1 -- 172.21.15.120:0/2296798066 >> 172.21.15.120:0/2296798066 conn(0x7f9e18069d00 msgr2=0x7f9e1806a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:36.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.954+0000 7f9e1c884640 1 -- 172.21.15.120:0/2296798066 shutdown_connections 2023-12-19T05:39:36.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.954+0000 7f9e1c884640 1 -- 172.21.15.120:0/2296798066 wait complete. 2023-12-19T05:39:36.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.955+0000 7f9e1c884640 1 Processor -- start 2023-12-19T05:39:36.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.955+0000 7f9e1c884640 1 -- start start 2023-12-19T05:39:36.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.955+0000 7f9e1c884640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e04003970 0x7f9e1813c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:36.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.955+0000 7f9e1c884640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e180b70f0 0x7f9e18137e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:36.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.955+0000 7f9e1c884640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e18138380 0x7f9e181e3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:36.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.955+0000 7f9e1c884640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e18142570 con 0x7f9e18138380 2023-12-19T05:39:36.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.955+0000 7f9e1c884640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e18142af0 con 0x7f9e04003970 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.955+0000 7f9e1c884640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e181443d0 con 0x7f9e180b70f0 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.955+0000 7f9e16d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e18138380 0x7f9e181e3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e16d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e18138380 0x7f9e181e3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46524/0 (socket says 172.21.15.120:46524) 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e16d9d640 1 -- 172.21.15.120:0/880561125 learned_addr learned my addr 172.21.15.120:0/880561125 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e1659c640 1 --2- 172.21.15.120:0/880561125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e04003970 0x7f9e1813c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e0ffff640 1 --2- 172.21.15.120:0/880561125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e180b70f0 0x7f9e18137e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e16d9d640 1 -- 172.21.15.120:0/880561125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e180b70f0 msgr2=0x7f9e18137e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e16d9d640 1 --2- 172.21.15.120:0/880561125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e180b70f0 0x7f9e18137e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e16d9d640 1 -- 172.21.15.120:0/880561125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e04003970 msgr2=0x7f9e1813c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e16d9d640 1 --2- 172.21.15.120:0/880561125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e04003970 0x7f9e1813c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e16d9d640 1 -- 172.21.15.120:0/880561125 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e18142780 con 0x7f9e18138380 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e16d9d640 1 --2- 172.21.15.120:0/880561125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e18138380 0x7f9e181e3930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9e18070e50 tx=0x7f9e10007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e0effd640 1 -- 172.21.15.120:0/880561125 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1000e9c0 con 0x7f9e18138380 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e0effd640 1 -- 172.21.15.120:0/880561125 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1000eb20 con 0x7f9e18138380 2023-12-19T05:39:36.962 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e0effd640 1 -- 172.21.15.120:0/880561125 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1000ecd0 con 0x7f9e18138380 2023-12-19T05:39:36.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e1c884640 1 -- 172.21.15.120:0/880561125 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e181440d0 con 0x7f9e18138380 2023-12-19T05:39:36.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.956+0000 7f9e1c884640 1 -- 172.21.15.120:0/880561125 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e181e3e70 con 0x7f9e18138380 2023-12-19T05:39:36.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.957+0000 7f9e1c884640 1 -- 172.21.15.120:0/880561125 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e18142910 con 0x7f9e18138380 2023-12-19T05:39:36.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.957+0000 7f9e0effd640 1 -- 172.21.15.120:0/880561125 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9e10013420 con 0x7f9e18138380 2023-12-19T05:39:36.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.958+0000 7f9e0effd640 1 --2- 172.21.15.120:0/880561125 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9df806a460 0x7f9df806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:36.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.958+0000 7f9e0effd640 1 -- 172.21.15.120:0/880561125 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f9e10088190 con 0x7f9e18138380 2023-12-19T05:39:36.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.958+0000 7f9e1659c640 1 --2- 172.21.15.120:0/880561125 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9df806a460 0x7f9df806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:36.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.958+0000 7f9e1659c640 1 --2- 172.21.15.120:0/880561125 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9df806a460 0x7f9df806c920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9e08033000 tx=0x7f9e08009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:36.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:36.962+0000 7f9e0effd640 1 -- 172.21.15.120:0/880561125 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9e10053870 con 0x7f9e18138380 2023-12-19T05:39:37.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.168+0000 7f9e1c884640 1 -- 172.21.15.120:0/880561125 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9e180b5240 con 0x7f9e18138380 2023-12-19T05:39:37.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.174+0000 7f9e0effd640 1 -- 172.21.15.120:0/880561125 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9e180b5240 con 0x7f9e18138380 2023-12-19T05:39:37.176 INFO:teuthology.orchestra.run.smithi120.stderr:new fs with metadata pool 4 and data pool 5 2023-12-19T05:39:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.181+0000 7f9e1c884640 1 -- 172.21.15.120:0/880561125 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9df806a460 msgr2=0x7f9df806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.181+0000 7f9e1c884640 1 --2- 172.21.15.120:0/880561125 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9df806a460 0x7f9df806c920 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9e08033000 tx=0x7f9e08009030 comp rx=0 tx=0).stop 2023-12-19T05:39:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.181+0000 7f9e1c884640 1 -- 172.21.15.120:0/880561125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e18138380 msgr2=0x7f9e181e3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.182 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.181+0000 7f9e1c884640 1 --2- 172.21.15.120:0/880561125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e18138380 0x7f9e181e3930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9e18070e50 tx=0x7f9e10007bc0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.181+0000 7f9e1c884640 1 -- 172.21.15.120:0/880561125 shutdown_connections 2023-12-19T05:39:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.181+0000 7f9e1c884640 1 --2- 172.21.15.120:0/880561125 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9df806a460 0x7f9df806c920 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.181+0000 7f9e1c884640 1 --2- 172.21.15.120:0/880561125 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9e18138380 0x7f9e181e3930 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.181+0000 7f9e1c884640 1 --2- 172.21.15.120:0/880561125 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9e180b70f0 0x7f9e18137e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.182+0000 7f9e1c884640 1 --2- 172.21.15.120:0/880561125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e04003970 0x7f9e1813c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.182+0000 7f9e1c884640 1 -- 172.21.15.120:0/880561125 >> 172.21.15.120:0/880561125 conn(0x7f9e18069d00 msgr2=0x7f9e181d3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.184+0000 7f9e1c884640 1 -- 172.21.15.120:0/880561125 shutdown_connections 2023-12-19T05:39:37.185 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.184+0000 7f9e1c884640 1 -- 172.21.15.120:0/880561125 wait complete. 2023-12-19T05:39:37.205 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:37.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.303+0000 7fcbf8abd640 1 Processor -- start 2023-12-19T05:39:37.304 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.303+0000 7fcbf8abd640 1 -- start start 2023-12-19T05:39:37.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.303+0000 7fcbf8abd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbf406ae10 0x7fcbf414b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf8abd640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf40bbb60 con 0x7fcbf4144d60 2023-12-19T05:39:37.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf8abd640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf414aa40 con 0x7fcbf414b700 2023-12-19T05:39:37.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf8abd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf406b980 con 0x7fcbf406ae10 2023-12-19T05:39:37.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf259c640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fcbf4144d60 0x7fcbf406d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40320/0 (socket says 172.21.15.120:40320) 2023-12-19T05:39:37.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf259c640 1 -- 172.21.15.120:0/567852612 learned_addr learned my addr 172.21.15.120:0/567852612 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:37.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbebfff640 1 --2- 172.21.15.120:0/567852612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbf406ae10 0x7fcbf414b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147268944 0 0) 0x7fcbf40bbb60 con 0x7fcbf4144d60 2023-12-19T05:39:37.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbe0003520 con 0x7fcbf4144d60 2023-12-19T05:39:37.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299717541 0 0) 0x7fcbf414aa40 con 0x7fcbf414b700 2023-12-19T05:39:37.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 --> v1:172.21.15.155:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf40bbb60 con 0x7fcbf414b700 2023-12-19T05:39:37.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3873443521 0 0) 0x7fcbe0003520 con 0x7fcbf4144d60 2023-12-19T05:39:37.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbf406ae10 msgr2=0x7fcbf414b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:37.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 --2- 172.21.15.120:0/567852612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbf406ae10 0x7fcbf414b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 >> v1:172.21.15.155:6789/0 conn(0x7fcbf414b700 legacy=0x7fcbf4155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf40b8b10 con 0x7fcbf4144d60 2023-12-19T05:39:37.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7fcbe4001670 con 0x7fcbf4144d60 2023-12-19T05:39:37.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 >> v1:172.21.15.120:6789/0 conn(0x7fcbf4144d60 legacy=0x7fcbf406d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 --2- 172.21.15.120:0/567852612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe0003b30 0x7fcbe0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 --2- 172.21.15.120:0/567852612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbf406ae10 0x7fcbe00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 --2- 172.21.15.120:0/567852612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe0004d00 0x7fcbe0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe000ba30 con 0x7fcbe0003b30 2023-12-19T05:39:37.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe000bb70 con 0x7fcbe0004d00 2023-12-19T05:39:37.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe000bce0 con 0x7fcbf406ae10 2023-12-19T05:39:37.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf259c640 1 --2- 172.21.15.120:0/567852612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe0003b30 0x7fcbe0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbebfff640 1 --2- 172.21.15.120:0/567852612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbf406ae10 0x7fcbe00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.304+0000 7fcbf2d9d640 1 --2- 172.21.15.120:0/567852612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe0004d00 0x7fcbe0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.305+0000 7fcbf259c640 1 -- 172.21.15.120:0/567852612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbf406ae10 msgr2=0x7fcbe00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:37.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.305+0000 7fcbf259c640 1 --2- 172.21.15.120:0/567852612 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbf406ae10 0x7fcbe00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.305+0000 7fcbf259c640 1 -- 172.21.15.120:0/567852612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe0004d00 msgr2=0x7fcbe0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:37.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.305+0000 7fcbf259c640 1 --2- 172.21.15.120:0/567852612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe0004d00 0x7fcbe0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.305+0000 7fcbf259c640 1 -- 172.21.15.120:0/567852612 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe0003520 con 0x7fcbe0003b30 2023-12-19T05:39:37.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.305+0000 7fcbf2d9d640 1 --2- 172.21.15.120:0/567852612 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe0004d00 0x7fcbe0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:37.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.305+0000 7fcbf259c640 1 --2- 172.21.15.120:0/567852612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe0003b30 0x7fcbe0003f30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400c190 tx=0x7fcbe00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e22630a0e9fc392 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:37.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.305+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4005ad0 con 0x7fcbe0003b30 2023-12-19T05:39:37.310 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.305+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe4005c30 con 0x7fcbe0003b30 2023-12-19T05:39:37.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.305+0000 7fcbf1d9b640 1 -- 172.21.15.120:0/567852612 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe402c850 con 0x7fcbe0003b30 2023-12-19T05:39:37.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.306+0000 7fcbf8abd640 1 -- 172.21.15.120:0/567852612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe0003b30 msgr2=0x7fcbe0003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.306+0000 7fcbf8abd640 1 --2- 172.21.15.120:0/567852612 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbe0003b30 0x7fcbe0003f30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400c190 tx=0x7fcbe00057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.306+0000 7fcbf2d9d640 1 -- 172.21.15.120:0/567852612 reap_dead start 2023-12-19T05:39:37.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.306+0000 7fcbf8abd640 1 -- 172.21.15.120:0/567852612 shutdown_connections 2023-12-19T05:39:37.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.306+0000 7fcbf8abd640 1 -- 172.21.15.120:0/567852612 >> 172.21.15.120:0/567852612 conn(0x7fcbf40bac10 msgr2=0x7fcbf40bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:37.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.306+0000 7fcbf8abd640 1 -- 172.21.15.120:0/567852612 shutdown_connections 2023-12-19T05:39:37.311 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.306+0000 7fcbf8abd640 1 -- 172.21.15.120:0/567852612 wait complete. 2023-12-19T05:39:37.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.307+0000 7fcbf8abd640 1 Processor -- start 2023-12-19T05:39:37.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.307+0000 7fcbf8abd640 1 -- start start 2023-12-19T05:39:37.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf8abd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe0003b30 0x7fcbf41e05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf8abd640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbf40bd900 0x7fcbf41461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf8abd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbf41e3410 0x7fcbf413c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf8abd640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf41e0150 con 0x7fcbf41e3410 2023-12-19T05:39:37.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf8abd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf40bdd60 con 0x7fcbe0003b30 2023-12-19T05:39:37.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf8abd640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf4146730 con 0x7fcbf40bd900 2023-12-19T05:39:37.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf2d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbf41e3410 0x7fcbf413c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf2d9d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbf41e3410 0x7fcbf413c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46538/0 (socket says 172.21.15.120:46538) 2023-12-19T05:39:37.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf2d9d640 1 -- 172.21.15.120:0/2301081521 learned_addr learned my addr 172.21.15.120:0/2301081521 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:37.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf259c640 1 --2- 172.21.15.120:0/2301081521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe0003b30 0x7fcbf41e05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.314 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbebfff640 1 --2- 172.21.15.120:0/2301081521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbf40bd900 0x7fcbf41461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf2d9d640 1 -- 172.21.15.120:0/2301081521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbf40bd900 msgr2=0x7fcbf41461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf2d9d640 1 --2- 172.21.15.120:0/2301081521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbf40bd900 0x7fcbf41461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf2d9d640 1 -- 172.21.15.120:0/2301081521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe0003b30 msgr2=0x7fcbf41e05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf2d9d640 1 --2- 172.21.15.120:0/2301081521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe0003b30 0x7fcbf41e05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf2d9d640 1 -- 172.21.15.120:0/2301081521 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf41e3e20 con 0x7fcbf41e3410 2023-12-19T05:39:37.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf2d9d640 1 --2- 172.21.15.120:0/2301081521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbf41e3410 0x7fcbf413c2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcbec001330 tx=0x7fcbec00eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:37.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbeaffd640 1 -- 172.21.15.120:0/2301081521 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec017070 con 0x7fcbf41e3410 2023-12-19T05:39:37.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbeaffd640 1 -- 172.21.15.120:0/2301081521 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec006b50 con 0x7fcbf41e3410 2023-12-19T05:39:37.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf8abd640 1 -- 172.21.15.120:0/2301081521 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf41dfb00 con 0x7fcbf41e3410 2023-12-19T05:39:37.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbeaffd640 1 -- 172.21.15.120:0/2301081521 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec006d20 con 0x7fcbf41e3410 2023-12-19T05:39:37.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.308+0000 7fcbf8abd640 1 -- 172.21.15.120:0/2301081521 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf413fa30 con 0x7fcbf41e3410 2023-12-19T05:39:37.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.309+0000 7fcbf8abd640 1 -- 172.21.15.120:0/2301081521 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf404e080 con 0x7fcbf41e3410 2023-12-19T05:39:37.315 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.310+0000 7fcbeaffd640 1 -- 172.21.15.120:0/2301081521 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcbec003970 con 0x7fcbf41e3410 2023-12-19T05:39:37.316 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.310+0000 7fcbeaffd640 1 --2- 172.21.15.120:0/2301081521 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fcbd406a430 0x7fcbd406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.316 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.310+0000 7fcbf259c640 1 --2- 172.21.15.120:0/2301081521 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fcbd406a430 0x7fcbd406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.316 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.310+0000 7fcbeaffd640 1 -- 172.21.15.120:0/2301081521 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbec088070 con 0x7fcbf41e3410 2023-12-19T05:39:37.316 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.311+0000 7fcbf259c640 1 --2- 172.21.15.120:0/2301081521 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fcbd406a430 0x7fcbd406c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4034000 tx=0x7fcbe4007000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:37.316 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.314+0000 7fcbeaffd640 1 -- 172.21.15.120:0/2301081521 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fcbec053550 con 0x7fcbf41e3410 2023-12-19T05:39:37.482 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.481+0000 7fcbf8abd640 1 -- 172.21.15.120:0/2301081521 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbf406e540 con 0x7fcbf41e3410 2023-12-19T05:39:37.483 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.482+0000 7fcbeaffd640 1 -- 172.21.15.120:0/2301081521 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16162 (secure 0 0 0) 0x7fcbec056b70 con 0x7fcbf41e3410 2023-12-19T05:39:37.484 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:37.484 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:39:37.170206+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:35.668117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:36.131433+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:37.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.484+0000 7fcbf8abd640 1 -- 172.21.15.120:0/2301081521 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fcbd406a430 msgr2=0x7fcbd406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.484+0000 7fcbf8abd640 1 --2- 172.21.15.120:0/2301081521 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fcbd406a430 0x7fcbd406c8f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4034000 tx=0x7fcbe4007000 comp rx=0 tx=0).stop 2023-12-19T05:39:37.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.484+0000 7fcbf8abd640 1 -- 172.21.15.120:0/2301081521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbf41e3410 msgr2=0x7fcbf413c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.484+0000 7fcbf8abd640 1 --2- 172.21.15.120:0/2301081521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbf41e3410 0x7fcbf413c2f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcbec001330 tx=0x7fcbec00eb40 comp rx=0 tx=0).stop 2023-12-19T05:39:37.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.484+0000 7fcbf8abd640 1 -- 172.21.15.120:0/2301081521 shutdown_connections 2023-12-19T05:39:37.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.484+0000 7fcbf8abd640 1 --2- 172.21.15.120:0/2301081521 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fcbd406a430 0x7fcbd406c8f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.484+0000 7fcbf8abd640 1 --2- 172.21.15.120:0/2301081521 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fcbf41e3410 0x7fcbf413c2f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.484+0000 7fcbf8abd640 1 --2- 172.21.15.120:0/2301081521 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fcbf40bd900 0x7fcbf41461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.486 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.484+0000 7fcbf8abd640 1 --2- 172.21.15.120:0/2301081521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbe0003b30 0x7fcbf41e05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.487 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.484+0000 7fcbf8abd640 1 -- 172.21.15.120:0/2301081521 >> 172.21.15.120:0/2301081521 conn(0x7fcbf40bac10 msgr2=0x7fcbf4142780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:37.487 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.485+0000 7fcbf8abd640 1 -- 172.21.15.120:0/2301081521 shutdown_connections 2023-12-19T05:39:37.487 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.485+0000 7fcbf8abd640 1 -- 172.21.15.120:0/2301081521 wait complete. 2023-12-19T05:39:37.497 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:37.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.594+0000 7f9ed0318640 1 Processor -- start 2023-12-19T05:39:37.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.594+0000 7f9ed0318640 1 -- start start 2023-12-19T05:39:37.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.595+0000 7f9ed0318640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec80b79b0 0x7f9ec80b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.595+0000 7f9ed0318640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec80b96b0 con 0x7f9ec80b8860 2023-12-19T05:39:37.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.595+0000 7f9ed0318640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec80b90f0 con 0x7f9ec814b230 2023-12-19T05:39:37.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.595+0000 7f9ed0318640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec814ae10 con 0x7f9ec80b79b0 2023-12-19T05:39:37.604 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.595+0000 7f9ecd8b3640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f9ec80b8860 0x7f9ec8144ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40334/0 (socket says 172.21.15.120:40334) 2023-12-19T05:39:37.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.595+0000 7f9ecd8b3640 1 -- 172.21.15.120:0/3174370657 learned_addr learned my addr 172.21.15.120:0/3174370657 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:37.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 -- 172.21.15.120:0/3174370657 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001674091 0 0) 0x7f9ec80b96b0 con 0x7f9ec80b8860 2023-12-19T05:39:37.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 -- 172.21.15.120:0/3174370657 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb4003520 con 0x7f9ec80b8860 2023-12-19T05:39:37.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ece0b4640 1 --2- 172.21.15.120:0/3174370657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec80b79b0 0x7f9ec80b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 -- 172.21.15.120:0/3174370657 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 868116033 0 0) 0x7f9eb4003520 con 0x7f9ec80b8860 2023-12-19T05:39:37.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 -- 172.21.15.120:0/3174370657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec80b79b0 msgr2=0x7f9ec80b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:37.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 --2- 172.21.15.120:0/3174370657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec80b79b0 0x7f9ec80b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 -- 172.21.15.120:0/3174370657 >> v1:172.21.15.155:6789/0 conn(0x7f9ec814b230 legacy=0x7f9ec81553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 -- 172.21.15.120:0/3174370657 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec80b93d0 con 0x7f9ec80b8860 2023-12-19T05:39:37.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 -- 172.21.15.120:0/3174370657 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f9eb8001670 con 0x7f9ec80b8860 2023-12-19T05:39:37.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 -- 172.21.15.120:0/3174370657 >> v1:172.21.15.120:6789/0 conn(0x7f9ec80b8860 legacy=0x7f9ec8144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.605 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 --2- 172.21.15.120:0/3174370657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9eb40039a0 0x7f9eb4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.606 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 --2- 172.21.15.120:0/3174370657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9eb40047c0 0x7f9eb4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.606 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 --2- 172.21.15.120:0/3174370657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec80b79b0 0x7f9eb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.606 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 -- 172.21.15.120:0/3174370657 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec814ae10 con 0x7f9eb40039a0 2023-12-19T05:39:37.606 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 -- 172.21.15.120:0/3174370657 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb400bab0 con 0x7f9eb40047c0 2023-12-19T05:39:37.606 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd0b2640 1 -- 172.21.15.120:0/3174370657 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb400bc70 con 0x7f9ec80b79b0 2023-12-19T05:39:37.606 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ece0b4640 1 --2- 172.21.15.120:0/3174370657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9eb40039a0 0x7f9eb4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.606 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ecd8b3640 1 --2- 172.21.15.120:0/3174370657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9eb40047c0 0x7f9eb4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.606 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ece8b5640 1 --2- 172.21.15.120:0/3174370657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec80b79b0 0x7f9eb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.606 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ece0b4640 1 -- 172.21.15.120:0/3174370657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec80b79b0 msgr2=0x7f9eb40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:37.606 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ece0b4640 1 --2- 172.21.15.120:0/3174370657 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9ec80b79b0 0x7f9eb40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.606 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ece0b4640 1 -- 172.21.15.120:0/3174370657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9eb40047c0 msgr2=0x7f9eb4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:37.606 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ece0b4640 1 --2- 172.21.15.120:0/3174370657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9eb40047c0 0x7f9eb4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.607 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.596+0000 7f9ece0b4640 1 -- 172.21.15.120:0/3174370657 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb4003520 con 0x7f9eb40039a0 2023-12-19T05:39:37.607 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.597+0000 7f9ece0b4640 1 --2- 172.21.15.120:0/3174370657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9eb40039a0 0x7f9eb4003dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0007360 tx=0x7f9eb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6c72298bc5f2ee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:37.607 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.597+0000 7f9ecd0b2640 1 -- 172.21.15.120:0/3174370657 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec002ccd0 con 0x7f9eb40039a0 2023-12-19T05:39:37.607 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.597+0000 7f9ecd0b2640 1 -- 172.21.15.120:0/3174370657 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec002ce30 con 0x7f9eb40039a0 2023-12-19T05:39:37.607 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.597+0000 7f9ecd0b2640 1 -- 172.21.15.120:0/3174370657 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0034660 con 0x7f9eb40039a0 2023-12-19T05:39:37.607 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.598+0000 7f9ed0318640 1 -- 172.21.15.120:0/3174370657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9eb40039a0 msgr2=0x7f9eb4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.607 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.598+0000 7f9ed0318640 1 --2- 172.21.15.120:0/3174370657 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9eb40039a0 0x7f9eb4003dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0007360 tx=0x7f9eb40057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.607 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.598+0000 7f9ece8b5640 1 -- 172.21.15.120:0/3174370657 reap_dead start 2023-12-19T05:39:37.607 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.598+0000 7f9ed0318640 1 -- 172.21.15.120:0/3174370657 shutdown_connections 2023-12-19T05:39:37.607 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.598+0000 7f9ed0318640 1 -- 172.21.15.120:0/3174370657 >> 172.21.15.120:0/3174370657 conn(0x7f9ec80c0340 msgr2=0x7f9ec80c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:37.607 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.598+0000 7f9ed0318640 1 -- 172.21.15.120:0/3174370657 shutdown_connections 2023-12-19T05:39:37.607 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.598+0000 7f9ed0318640 1 -- 172.21.15.120:0/3174370657 wait complete. 2023-12-19T05:39:37.607 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.599+0000 7f9ed0318640 1 Processor -- start 2023-12-19T05:39:37.608 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.599+0000 7f9ed0318640 1 -- start start 2023-12-19T05:39:37.608 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.599+0000 7f9ed0318640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9eb40039a0 0x7f9ec8148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.608 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.599+0000 7f9ed0318640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ec81dffb0 0x7f9ec81e0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.608 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.599+0000 7f9ed0318640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ec81e3580 0x7f9ec81e3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.608 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.599+0000 7f9ed0318640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec8148db0 con 0x7f9ec81e3580 2023-12-19T05:39:37.608 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.599+0000 7f9ed0318640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec81e2ee0 con 0x7f9ec81dffb0 2023-12-19T05:39:37.608 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.599+0000 7f9ed0318640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec81dfb20 con 0x7f9eb40039a0 2023-12-19T05:39:37.608 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.599+0000 7f9ece8b5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ec81e3580 0x7f9ec81e3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.608 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.599+0000 7f9ece8b5640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ec81e3580 0x7f9ec81e3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46562/0 (socket says 172.21.15.120:46562) 2023-12-19T05:39:37.608 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.599+0000 7f9ece8b5640 1 -- 172.21.15.120:0/2156292059 learned_addr learned my addr 172.21.15.120:0/2156292059 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:37.608 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.599+0000 7f9ece0b4640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9eb40039a0 0x7f9ec8148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.608 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.599+0000 7f9ecd8b3640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ec81dffb0 0x7f9ec81e0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.600+0000 7f9ece8b5640 1 -- 172.21.15.120:0/2156292059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9eb40039a0 msgr2=0x7f9ec8148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.600+0000 7f9ece8b5640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9eb40039a0 0x7f9ec8148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.600+0000 7f9ece8b5640 1 -- 172.21.15.120:0/2156292059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ec81dffb0 msgr2=0x7f9ec81e0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.600+0000 7f9ece8b5640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ec81dffb0 0x7f9ec81e0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.600+0000 7f9ece8b5640 1 -- 172.21.15.120:0/2156292059 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec809b410 con 0x7f9ec81e3580 2023-12-19T05:39:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.600+0000 7f9ecd8b3640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ec81dffb0 0x7f9ec81e0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.600+0000 7f9ece8b5640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ec81e3580 0x7f9ec81e3a00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9ec814b610 tx=0x7f9ec400e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.600+0000 7f9ebeffd640 1 -- 172.21.15.120:0/2156292059 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4007e40 con 0x7f9ec81e3580 2023-12-19T05:39:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.600+0000 7f9ebeffd640 1 -- 172.21.15.120:0/2156292059 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec40052e0 con 0x7f9ec81e3580 2023-12-19T05:39:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.600+0000 7f9ed0318640 1 -- 172.21.15.120:0/2156292059 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec809ae50 con 0x7f9ec81e3580 2023-12-19T05:39:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.600+0000 7f9ebeffd640 1 -- 172.21.15.120:0/2156292059 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40035f0 con 0x7f9ec81e3580 2023-12-19T05:39:37.609 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.600+0000 7f9ed0318640 1 -- 172.21.15.120:0/2156292059 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec809f110 con 0x7f9ec81e3580 2023-12-19T05:39:37.610 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.601+0000 7f9ed0318640 1 -- 172.21.15.120:0/2156292059 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec81df930 con 0x7f9ec81e3580 2023-12-19T05:39:37.610 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.601+0000 7f9ebeffd640 1 -- 172.21.15.120:0/2156292059 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9ec4003750 con 0x7f9ec81e3580 2023-12-19T05:39:37.610 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.602+0000 7f9ebeffd640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9eac06a430 0x7f9eac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.610 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.602+0000 7f9ebeffd640 1 -- 172.21.15.120:0/2156292059 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ec4087ec0 con 0x7f9ec81e3580 2023-12-19T05:39:37.610 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.602+0000 7f9ece0b4640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9eac06a430 0x7f9eac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.610 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.602+0000 7f9ece0b4640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9eac06a430 0x7f9eac06c8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0036000 tx=0x7f9ec0030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:37.610 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.606+0000 7f9ebeffd640 1 -- 172.21.15.120:0/2156292059 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f9ec40534d0 con 0x7f9ec81e3580 2023-12-19T05:39:37.774 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.772+0000 7f9ed0318640 1 -- 172.21.15.120:0/2156292059 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ec804e080 con 0x7f9ec81e3580 2023-12-19T05:39:37.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.774+0000 7f9ebeffd640 1 -- 172.21.15.120:0/2156292059 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16162 (secure 0 0 0) 0x7f9ec4019070 con 0x7f9ec81e3580 2023-12-19T05:39:37.775 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:37.775 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":30,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:39:37.170206+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:35.668117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:36.131433+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.775+0000 7f9ed0318640 1 -- 172.21.15.120:0/2156292059 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9eac06a430 msgr2=0x7f9eac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.775+0000 7f9ed0318640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9eac06a430 0x7f9eac06c8f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0036000 tx=0x7f9ec0030000 comp rx=0 tx=0).stop 2023-12-19T05:39:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.775+0000 7f9ed0318640 1 -- 172.21.15.120:0/2156292059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ec81e3580 msgr2=0x7f9ec81e3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.775+0000 7f9ed0318640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ec81e3580 0x7f9ec81e3a00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9ec814b610 tx=0x7f9ec400e8a0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.775+0000 7f9ed0318640 1 -- 172.21.15.120:0/2156292059 shutdown_connections 2023-12-19T05:39:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.775+0000 7f9ed0318640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f9eac06a430 0x7f9eac06c8f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.775+0000 7f9ed0318640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f9ec81e3580 0x7f9ec81e3a00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.775+0000 7f9ed0318640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ec81dffb0 0x7f9ec81e0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.775+0000 7f9ed0318640 1 --2- 172.21.15.120:0/2156292059 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f9eb40039a0 0x7f9ec8148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.777 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.775+0000 7f9ed0318640 1 -- 172.21.15.120:0/2156292059 >> 172.21.15.120:0/2156292059 conn(0x7f9ec80c0340 msgr2=0x7f9ec814a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:37.778 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.775+0000 7f9ed0318640 1 -- 172.21.15.120:0/2156292059 shutdown_connections 2023-12-19T05:39:37.778 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.776+0000 7f9ed0318640 1 -- 172.21.15.120:0/2156292059 wait complete. 2023-12-19T05:39:37.788 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T05:39:37.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.889+0000 7fdcaeb47640 1 Processor -- start 2023-12-19T05:39:37.890 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.889+0000 7fdcaeb47640 1 -- start start 2023-12-19T05:39:37.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.890+0000 7fdcaeb47640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdca8144d70 0x7fdca80b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.890+0000 7fdcaeb47640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdca80bc7e0 0x7fdca80bcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.890+0000 7fdcaeb47640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca8145150 con 0x7fdca814df70 2023-12-19T05:39:37.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.890+0000 7fdcaeb47640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca80b9f00 con 0x7fdca8144d70 2023-12-19T05:39:37.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.890+0000 7fdcaeb47640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca80b84b0 con 0x7fdca80bc7e0 2023-12-19T05:39:37.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.890+0000 7fdcac8e3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdca8144d70 0x7fdca80b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.890+0000 7fdcad0e4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdca80bc7e0 0x7fdca80bcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.890+0000 7fdcac8e3640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fdca8144d70 0x7fdca80b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:54984/0 (socket says 172.21.15.120:54984) 2023-12-19T05:39:37.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.890+0000 7fdcac8e3640 1 -- 172.21.15.120:0/1060707802 learned_addr learned my addr 172.21.15.120:0/1060707802 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:37.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.890+0000 7fdca7fff640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fdca814df70 0x7fdca80b8860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:52880/0 (socket says 172.21.15.120:52880) 2023-12-19T05:39:37.892 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.891+0000 7fdca77fe640 1 -- 172.21.15.120:0/1060707802 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969776551 0 0) 0x7fdca8145150 con 0x7fdca814df70 2023-12-19T05:39:37.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.891+0000 7fdcad0e4640 1 -- 172.21.15.120:0/1060707802 >> v2:172.21.15.155:3300/0 conn(0x7fdca8144d70 msgr2=0x7fdca80b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:37.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.891+0000 7fdcad0e4640 1 --2- 172.21.15.120:0/1060707802 >> v2:172.21.15.155:3300/0 conn(0x7fdca8144d70 0x7fdca80b7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.891+0000 7fdcad0e4640 1 -- 172.21.15.120:0/1060707802 >> v1:172.21.15.155:6789/0 conn(0x7fdca814df70 legacy=0x7fdca80b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.893 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.891+0000 7fdcad0e4640 1 -- 172.21.15.120:0/1060707802 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca80b9080 con 0x7fdca80bc7e0 2023-12-19T05:39:37.894 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.891+0000 7fdcad0e4640 1 --2- 172.21.15.120:0/1060707802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdca80bc7e0 0x7fdca80bcc50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009d90 tx=0x7fdca002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30d94b5bd0609200 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:37.894 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.892+0000 7fdca77fe640 1 -- 172.21.15.120:0/1060707802 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca002cce0 con 0x7fdca80bc7e0 2023-12-19T05:39:37.894 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.892+0000 7fdca77fe640 1 -- 172.21.15.120:0/1060707802 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca002ce40 con 0x7fdca80bc7e0 2023-12-19T05:39:37.894 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.892+0000 7fdca77fe640 1 -- 172.21.15.120:0/1060707802 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0034660 con 0x7fdca80bc7e0 2023-12-19T05:39:37.894 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.892+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1060707802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdca80bc7e0 msgr2=0x7fdca80bcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.894 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.892+0000 7fdcaeb47640 1 --2- 172.21.15.120:0/1060707802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdca80bc7e0 0x7fdca80bcc50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009d90 tx=0x7fdca002bf30 comp rx=0 tx=0).stop 2023-12-19T05:39:37.894 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.892+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1060707802 shutdown_connections 2023-12-19T05:39:37.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.892+0000 7fdcaeb47640 1 --2- 172.21.15.120:0/1060707802 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdca80bc7e0 0x7fdca80bcc50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.892+0000 7fdcaeb47640 1 --2- 172.21.15.120:0/1060707802 >> v2:172.21.15.155:3300/0 conn(0x7fdca8144d70 0x7fdca80b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.892+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1060707802 >> 172.21.15.120:0/1060707802 conn(0x7fdca8071430 msgr2=0x7fdca8071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:37.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.892+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1060707802 shutdown_connections 2023-12-19T05:39:37.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.892+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1060707802 wait complete. 2023-12-19T05:39:37.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.893+0000 7fdcaeb47640 1 Processor -- start 2023-12-19T05:39:37.895 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.893+0000 7fdcaeb47640 1 -- start start 2023-12-19T05:39:37.897 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcaeb47640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdca80bc7e0 0x7fdca80ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcaeb47640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdca8144d70 0x7fdca8148f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.898 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcaeb47640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdca814df70 0x7fdca81e33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.899 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcaeb47640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca80ab5f0 con 0x7fdca814df70 2023-12-19T05:39:37.899 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcaeb47640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca8149460 con 0x7fdca80bc7e0 2023-12-19T05:39:37.899 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcaeb47640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca814a550 con 0x7fdca8144d70 2023-12-19T05:39:37.899 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcad0e4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdca814df70 0x7fdca81e33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcad0e4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdca814df70 0x7fdca81e33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46572/0 (socket says 172.21.15.120:46572) 2023-12-19T05:39:37.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcad0e4640 1 -- 172.21.15.120:0/1241608580 learned_addr learned my addr 172.21.15.120:0/1241608580 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:37.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdca7fff640 1 --2- 172.21.15.120:0/1241608580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdca8144d70 0x7fdca8148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcac8e3640 1 --2- 172.21.15.120:0/1241608580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdca80bc7e0 0x7fdca80ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcad0e4640 1 -- 172.21.15.120:0/1241608580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdca8144d70 msgr2=0x7fdca8148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcad0e4640 1 --2- 172.21.15.120:0/1241608580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdca8144d70 0x7fdca8148f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcad0e4640 1 -- 172.21.15.120:0/1241608580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdca80bc7e0 msgr2=0x7fdca80ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:37.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcad0e4640 1 --2- 172.21.15.120:0/1241608580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdca80bc7e0 0x7fdca80ab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:37.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.894+0000 7fdcad0e4640 1 -- 172.21.15.120:0/1241608580 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0009a70 con 0x7fdca814df70 2023-12-19T05:39:37.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.895+0000 7fdcad0e4640 1 --2- 172.21.15.120:0/1241608580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdca814df70 0x7fdca81e33e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009d90 tx=0x7fdca0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:37.900 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.895+0000 7fdca57fa640 1 -- 172.21.15.120:0/1241608580 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca003d600 con 0x7fdca814df70 2023-12-19T05:39:37.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.895+0000 7fdca57fa640 1 -- 172.21.15.120:0/1241608580 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca003d780 con 0x7fdca814df70 2023-12-19T05:39:37.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.895+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1241608580 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca814b440 con 0x7fdca814df70 2023-12-19T05:39:37.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.895+0000 7fdca57fa640 1 -- 172.21.15.120:0/1241608580 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca003db30 con 0x7fdca814df70 2023-12-19T05:39:37.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.895+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1241608580 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca814ae80 con 0x7fdca814df70 2023-12-19T05:39:37.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.896+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1241608580 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca81e30e0 con 0x7fdca814df70 2023-12-19T05:39:37.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.896+0000 7fdca57fa640 1 -- 172.21.15.120:0/1241608580 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdca003b040 con 0x7fdca814df70 2023-12-19T05:39:37.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.896+0000 7fdca57fa640 1 --2- 172.21.15.120:0/1241608580 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdc9406a430 0x7fdc9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:37.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.896+0000 7fdca57fa640 1 -- 172.21.15.120:0/1241608580 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdca00aaec0 con 0x7fdca814df70 2023-12-19T05:39:37.901 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.896+0000 7fdcac8e3640 1 --2- 172.21.15.120:0/1241608580 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdc9406a430 0x7fdc9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:37.902 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.897+0000 7fdcac8e3640 1 --2- 172.21.15.120:0/1241608580 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdc9406a430 0x7fdc9406c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009b60 tx=0x7fdc98008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:37.902 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:37.901+0000 7fdca57fa640 1 -- 172.21.15.120:0/1241608580 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdca00764b0 con 0x7fdca814df70 2023-12-19T05:39:38.108 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.107+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1241608580 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdca804e080 con 0x7fdca814df70 2023-12-19T05:39:38.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.174+0000 7fdca57fa640 1 -- 172.21.15.120:0/1241608580 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdca0079ad0 con 0x7fdca814df70 2023-12-19T05:39:38.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.176+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1241608580 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdc9406a430 msgr2=0x7fdc9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:38.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.176+0000 7fdcaeb47640 1 --2- 172.21.15.120:0/1241608580 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdc9406a430 0x7fdc9406c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009b60 tx=0x7fdc98008040 comp rx=0 tx=0).stop 2023-12-19T05:39:38.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.176+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1241608580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdca814df70 msgr2=0x7fdca81e33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:38.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.176+0000 7fdcaeb47640 1 --2- 172.21.15.120:0/1241608580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdca814df70 0x7fdca81e33e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009d90 tx=0x7fdca0004a40 comp rx=0 tx=0).stop 2023-12-19T05:39:38.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.176+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1241608580 shutdown_connections 2023-12-19T05:39:38.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.176+0000 7fdcaeb47640 1 --2- 172.21.15.120:0/1241608580 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdc9406a430 0x7fdc9406c8f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:38.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.176+0000 7fdcaeb47640 1 --2- 172.21.15.120:0/1241608580 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdca814df70 0x7fdca81e33e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:38.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.176+0000 7fdcaeb47640 1 --2- 172.21.15.120:0/1241608580 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdca8144d70 0x7fdca8148f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:38.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.176+0000 7fdcaeb47640 1 --2- 172.21.15.120:0/1241608580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdca80bc7e0 0x7fdca80ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:38.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.176+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1241608580 >> 172.21.15.120:0/1241608580 conn(0x7fdca8071430 msgr2=0x7fdca80b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:38.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.176+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1241608580 shutdown_connections 2023-12-19T05:39:38.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.176+0000 7fdcaeb47640 1 -- 172.21.15.120:0/1241608580 wait complete. 2023-12-19T05:39:38.188 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T05:39:38.188 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T05:39:38.290 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.289+0000 7f6c2599c640 1 Processor -- start 2023-12-19T05:39:38.290 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.289+0000 7f6c2599c640 1 -- start start 2023-12-19T05:39:38.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c2599c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c20144d70 0x7f6c200b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:38.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c2599c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6c2014df70 0x7f6c200b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:38.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c2599c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f6c200bc7e0 0x7f6c200bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:38.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c2599c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c200b9f00 con 0x7f6c2014df70 2023-12-19T05:39:38.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c2599c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c200b84b0 con 0x7f6c200bc7e0 2023-12-19T05:39:38.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c2599c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c20145150 con 0x7f6c20144d70 2023-12-19T05:39:38.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c1e7fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6c2014df70 0x7f6c200b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:38.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c1e7fc640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f6c2014df70 0x7f6c200b8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46582/0 (socket says 172.21.15.120:46582) 2023-12-19T05:39:38.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c1e7fc640 1 -- 172.21.15.120:0/586050906 learned_addr learned my addr 172.21.15.120:0/586050906 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:38.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c1effd640 1 --2- 172.21.15.120:0/586050906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c20144d70 0x7f6c200b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:38.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c1f7fe640 1 --2- 172.21.15.120:0/586050906 >> v2:172.21.15.155:3300/0 conn(0x7f6c200bc7e0 0x7f6c200bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:38.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c1e7fc640 1 -- 172.21.15.120:0/586050906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c20144d70 msgr2=0x7f6c200b7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:38.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c1e7fc640 1 --2- 172.21.15.120:0/586050906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c20144d70 0x7f6c200b7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:38.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c1e7fc640 1 -- 172.21.15.120:0/586050906 >> v2:172.21.15.155:3300/0 conn(0x7f6c200bc7e0 msgr2=0x7f6c200bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:38.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c1e7fc640 1 --2- 172.21.15.120:0/586050906 >> v2:172.21.15.155:3300/0 conn(0x7f6c200bc7e0 0x7f6c200bcc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:38.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c1e7fc640 1 -- 172.21.15.120:0/586050906 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c200b9080 con 0x7f6c2014df70 2023-12-19T05:39:38.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.290+0000 7f6c1f7fe640 1 --2- 172.21.15.120:0/586050906 >> v2:172.21.15.155:3300/0 conn(0x7f6c200bc7e0 0x7f6c200bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:38.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.291+0000 7f6c1e7fc640 1 --2- 172.21.15.120:0/586050906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c2014df70 0x7f6c200b8860 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6c200b6b90 tx=0x7f6c1402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1dd2e3f78d163b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:38.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.291+0000 7f6c1dffb640 1 -- 172.21.15.120:0/586050906 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14030840 con 0x7f6c2014df70 2023-12-19T05:39:38.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.291+0000 7f6c1dffb640 1 -- 172.21.15.120:0/586050906 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c140309a0 con 0x7f6c2014df70 2023-12-19T05:39:38.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.291+0000 7f6c1dffb640 1 -- 172.21.15.120:0/586050906 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14030d30 con 0x7f6c2014df70 2023-12-19T05:39:38.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.291+0000 7f6c2599c640 1 -- 172.21.15.120:0/586050906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c2014df70 msgr2=0x7f6c200b8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:38.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.291+0000 7f6c2599c640 1 --2- 172.21.15.120:0/586050906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c2014df70 0x7f6c200b8860 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6c200b6b90 tx=0x7f6c1402b980 comp rx=0 tx=0).stop 2023-12-19T05:39:38.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.291+0000 7f6c2599c640 1 -- 172.21.15.120:0/586050906 shutdown_connections 2023-12-19T05:39:38.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.291+0000 7f6c2599c640 1 --2- 172.21.15.120:0/586050906 >> v2:172.21.15.155:3300/0 conn(0x7f6c200bc7e0 0x7f6c200bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:38.294 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.291+0000 7f6c2599c640 1 --2- 172.21.15.120:0/586050906 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c2014df70 0x7f6c200b8860 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:38.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.291+0000 7f6c2599c640 1 --2- 172.21.15.120:0/586050906 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c20144d70 0x7f6c200b7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:38.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.291+0000 7f6c2599c640 1 -- 172.21.15.120:0/586050906 >> 172.21.15.120:0/586050906 conn(0x7f6c20071430 msgr2=0x7f6c20071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:38.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.291+0000 7f6c2599c640 1 -- 172.21.15.120:0/586050906 shutdown_connections 2023-12-19T05:39:38.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.291+0000 7f6c2599c640 1 -- 172.21.15.120:0/586050906 wait complete. 2023-12-19T05:39:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.292+0000 7f6c2599c640 1 Processor -- start 2023-12-19T05:39:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.293+0000 7f6c2599c640 1 -- start start 2023-12-19T05:39:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.293+0000 7f6c2599c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c200bc7e0 0x7f6c200a8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.293+0000 7f6c2599c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c20144d70 0x7f6c200a6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.293+0000 7f6c2599c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2014df70 0x7f6c20143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.293+0000 7f6c2599c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200a9370 con 0x7f6c20144d70 2023-12-19T05:39:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.293+0000 7f6c2599c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200a7d20 con 0x7f6c2014df70 2023-12-19T05:39:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.293+0000 7f6c2599c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200a96f0 con 0x7f6c200bc7e0 2023-12-19T05:39:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.293+0000 7f6c1e7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c20144d70 0x7f6c200a6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.293+0000 7f6c1e7fc640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c20144d70 0x7f6c200a6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46596/0 (socket says 172.21.15.120:46596) 2023-12-19T05:39:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.293+0000 7f6c1e7fc640 1 -- 172.21.15.120:0/2447294901 learned_addr learned my addr 172.21.15.120:0/2447294901 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:38.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.293+0000 7f6c1effd640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c200bc7e0 0x7f6c200a8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.294+0000 7f6c1f7fe640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2014df70 0x7f6c20143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.294+0000 7f6c1e7fc640 1 -- 172.21.15.120:0/2447294901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c200bc7e0 msgr2=0x7f6c200a8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.294+0000 7f6c1e7fc640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c200bc7e0 0x7f6c200a8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.294+0000 7f6c1e7fc640 1 -- 172.21.15.120:0/2447294901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2014df70 msgr2=0x7f6c20143af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.294+0000 7f6c1e7fc640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2014df70 0x7f6c20143af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.294+0000 7f6c1e7fc640 1 -- 172.21.15.120:0/2447294901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c140094d0 con 0x7f6c20144d70 2023-12-19T05:39:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.294+0000 7f6c1effd640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c200bc7e0 0x7f6c200a8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.294+0000 7f6c1f7fe640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2014df70 0x7f6c20143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.294+0000 7f6c1e7fc640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c20144d70 0x7f6c200a6e00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6c14000c00 tx=0x7f6c14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.294+0000 7f6c07fff640 1 -- 172.21.15.120:0/2447294901 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14039a90 con 0x7f6c20144d70 2023-12-19T05:39:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.294+0000 7f6c07fff640 1 -- 172.21.15.120:0/2447294901 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c14039bf0 con 0x7f6c20144d70 2023-12-19T05:39:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.294+0000 7f6c2599c640 1 -- 172.21.15.120:0/2447294901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c200a7340 con 0x7f6c20144d70 2023-12-19T05:39:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.294+0000 7f6c07fff640 1 -- 172.21.15.120:0/2447294901 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14043410 con 0x7f6c20144d70 2023-12-19T05:39:38.299 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.294+0000 7f6c2599c640 1 -- 172.21.15.120:0/2447294901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c201e34c0 con 0x7f6c20144d70 2023-12-19T05:39:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.295+0000 7f6c2599c640 1 -- 172.21.15.120:0/2447294901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2004e080 con 0x7f6c20144d70 2023-12-19T05:39:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.295+0000 7f6c07fff640 1 -- 172.21.15.120:0/2447294901 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6c1404c3b0 con 0x7f6c20144d70 2023-12-19T05:39:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.296+0000 7f6c07fff640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6c0c06a430 0x7f6c0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.296+0000 7f6c07fff640 1 -- 172.21.15.120:0/2447294901 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c140aabb0 con 0x7f6c20144d70 2023-12-19T05:39:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.296+0000 7f6c1effd640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6c0c06a430 0x7f6c0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:38.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.296+0000 7f6c1effd640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6c0c06a430 0x7f6c0c06c8f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c10006fd0 tx=0x7f6c10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:38.301 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.300+0000 7f6c07fff640 1 -- 172.21.15.120:0/2447294901 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f6c140761a0 con 0x7f6c20144d70 2023-12-19T05:39:38.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:38.503+0000 7f6c2599c640 1 -- 172.21.15.120:0/2447294901 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6c200b4a00 con 0x7f6c20144d70 2023-12-19T05:39:39.181 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.180+0000 7f6c07fff640 1 -- 172.21.15.120:0/2447294901 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6c140340c0 con 0x7f6c20144d70 2023-12-19T05:39:39.183 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.182+0000 7f6c2599c640 1 -- 172.21.15.120:0/2447294901 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6c0c06a430 msgr2=0x7f6c0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.182+0000 7f6c2599c640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6c0c06a430 0x7f6c0c06c8f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c10006fd0 tx=0x7f6c10008040 comp rx=0 tx=0).stop 2023-12-19T05:39:39.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.182+0000 7f6c2599c640 1 -- 172.21.15.120:0/2447294901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c20144d70 msgr2=0x7f6c200a6e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.182+0000 7f6c2599c640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c20144d70 0x7f6c200a6e00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6c14000c00 tx=0x7f6c14004730 comp rx=0 tx=0).stop 2023-12-19T05:39:39.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.182+0000 7f6c2599c640 1 -- 172.21.15.120:0/2447294901 shutdown_connections 2023-12-19T05:39:39.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.182+0000 7f6c2599c640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f6c0c06a430 0x7f6c0c06c8f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.182+0000 7f6c2599c640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c2014df70 0x7f6c20143af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.182+0000 7f6c2599c640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f6c20144d70 0x7f6c200a6e00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.182+0000 7f6c2599c640 1 --2- 172.21.15.120:0/2447294901 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f6c200bc7e0 0x7f6c200a8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.182+0000 7f6c2599c640 1 -- 172.21.15.120:0/2447294901 >> 172.21.15.120:0/2447294901 conn(0x7f6c20071430 msgr2=0x7f6c200b4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:39.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.182+0000 7f6c2599c640 1 -- 172.21.15.120:0/2447294901 shutdown_connections 2023-12-19T05:39:39.184 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.182+0000 7f6c2599c640 1 -- 172.21.15.120:0/2447294901 wait complete. 2023-12-19T05:39:39.194 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T05:39:39.195 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:39:39.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.297+0000 7f4f51d39640 1 Processor -- start 2023-12-19T05:39:39.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.297+0000 7f4f51d39640 1 -- start start 2023-12-19T05:39:39.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.298+0000 7f4f51d39640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4f4c06da70 0x7f4f4c1429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.298+0000 7f4f51d39640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f4c142ee0 0x7f4f4c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.298+0000 7f4f51d39640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4c06e690 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.298+0000 7f4f51d39640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4c06ebc0 con 0x7f4f4c06da70 2023-12-19T05:39:39.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.298+0000 7f4f51d39640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0b3db0 con 0x7f4f4c142ee0 2023-12-19T05:39:39.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.298+0000 7f4f4b7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f4f4c06da70 0x7f4f4c1429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.298+0000 7f4f4bfff640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f4f4c0b4e30 0x7f4f4c14bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40348/0 (socket says 172.21.15.120:40348) 2023-12-19T05:39:39.300 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.298+0000 7f4f4bfff640 1 -- 172.21.15.120:0/2920382883 learned_addr learned my addr 172.21.15.120:0/2920382883 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:39.301 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.298+0000 7f4f4b7fe640 1 -- 172.21.15.120:0/2920382883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f4c142ee0 msgr2=0x7f4f4c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:39.301 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.298+0000 7f4f4b7fe640 1 --2- 172.21.15.120:0/2920382883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f4c142ee0 0x7f4f4c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.301 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.298+0000 7f4f4b7fe640 1 -- 172.21.15.120:0/2920382883 >> v1:172.21.15.120:6789/0 conn(0x7f4f4c0b4e30 legacy=0x7f4f4c14bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.301 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.298+0000 7f4f4b7fe640 1 -- 172.21.15.120:0/2920382883 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c0b9f60 con 0x7f4f4c06da70 2023-12-19T05:39:39.301 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.298+0000 7f4f4affd640 1 -- 172.21.15.120:0/2920382883 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858302701 0 0) 0x7f4f4c06e690 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.299+0000 7f4f4b7fe640 1 --2- 172.21.15.120:0/2920382883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c06da70 0x7f4f4c1429a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0097a0 tx=0x7f4f3c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a495549a01259e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.299+0000 7f4f4affd640 1 -- 172.21.15.120:0/2920382883 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c02e070 con 0x7f4f4c06da70 2023-12-19T05:39:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.299+0000 7f4f4affd640 1 -- 172.21.15.120:0/2920382883 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c0315a0 con 0x7f4f4c06da70 2023-12-19T05:39:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.299+0000 7f4f4affd640 1 -- 172.21.15.120:0/2920382883 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c031930 con 0x7f4f4c06da70 2023-12-19T05:39:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.300+0000 7f4f51d39640 1 -- 172.21.15.120:0/2920382883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c06da70 msgr2=0x7f4f4c1429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.300+0000 7f4f51d39640 1 --2- 172.21.15.120:0/2920382883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c06da70 0x7f4f4c1429a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c0097a0 tx=0x7f4f3c02b840 comp rx=0 tx=0).stop 2023-12-19T05:39:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.300+0000 7f4f51d39640 1 -- 172.21.15.120:0/2920382883 shutdown_connections 2023-12-19T05:39:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.300+0000 7f4f51d39640 1 --2- 172.21.15.120:0/2920382883 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f4c142ee0 0x7f4f4c0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.300+0000 7f4f51d39640 1 --2- 172.21.15.120:0/2920382883 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c06da70 0x7f4f4c1429a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.300+0000 7f4f51d39640 1 -- 172.21.15.120:0/2920382883 >> 172.21.15.120:0/2920382883 conn(0x7f4f4c0bac10 msgr2=0x7f4f4c0bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:39.305 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.300+0000 7f4f51d39640 1 -- 172.21.15.120:0/2920382883 shutdown_connections 2023-12-19T05:39:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.300+0000 7f4f51d39640 1 -- 172.21.15.120:0/2920382883 wait complete. 2023-12-19T05:39:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.301+0000 7f4f51d39640 1 Processor -- start 2023-12-19T05:39:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.301+0000 7f4f51d39640 1 -- start start 2023-12-19T05:39:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f51d39640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c06da70 0x7f4f4c149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f51d39640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c0b4e30 0x7f4f4c14bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f51d39640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f4c142ee0 0x7f4f4c14c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f51d39640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0bdf60 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f51d39640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0bd120 con 0x7f4f4c06da70 2023-12-19T05:39:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f51d39640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c0bdc80 con 0x7f4f4c142ee0 2023-12-19T05:39:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f42ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c0b4e30 0x7f4f4c14bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f42ffd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c0b4e30 0x7f4f4c14bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46604/0 (socket says 172.21.15.120:46604) 2023-12-19T05:39:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f42ffd640 1 -- 172.21.15.120:0/3572554913 learned_addr learned my addr 172.21.15.120:0/3572554913 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f4b7fe640 1 --2- 172.21.15.120:0/3572554913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c06da70 0x7f4f4c149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f4bfff640 1 --2- 172.21.15.120:0/3572554913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f4c142ee0 0x7f4f4c14c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f42ffd640 1 -- 172.21.15.120:0/3572554913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f4c142ee0 msgr2=0x7f4f4c14c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f42ffd640 1 --2- 172.21.15.120:0/3572554913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f4c142ee0 0x7f4f4c14c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f42ffd640 1 -- 172.21.15.120:0/3572554913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c06da70 msgr2=0x7f4f4c149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f42ffd640 1 --2- 172.21.15.120:0/3572554913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c06da70 0x7f4f4c149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f42ffd640 1 -- 172.21.15.120:0/3572554913 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c009400 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f42ffd640 1 --2- 172.21.15.120:0/3572554913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c0b4e30 0x7f4f4c14bf90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400b410 tx=0x7f4f3400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f48ff9640 1 -- 172.21.15.120:0/3572554913 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34011830 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f48ff9640 1 -- 172.21.15.120:0/3572554913 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f340119b0 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.307 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f51d39640 1 -- 172.21.15.120:0/3572554913 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4c14a5f0 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f48ff9640 1 -- 172.21.15.120:0/3572554913 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34011d60 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.302+0000 7f4f51d39640 1 -- 172.21.15.120:0/3572554913 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4c0bd850 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.303+0000 7f4f51d39640 1 -- 172.21.15.120:0/3572554913 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c04e080 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.304+0000 7f4f48ff9640 1 -- 172.21.15.120:0/3572554913 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f3401a400 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.304+0000 7f4f48ff9640 1 --2- 172.21.15.120:0/3572554913 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f4f2c06a430 0x7f4f2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.304+0000 7f4f4b7fe640 1 --2- 172.21.15.120:0/3572554913 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f4f2c06a430 0x7f4f2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.304+0000 7f4f48ff9640 1 -- 172.21.15.120:0/3572554913 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f34088ae0 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.305+0000 7f4f4b7fe640 1 --2- 172.21.15.120:0/3572554913 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f4f2c06a430 0x7f4f2c06c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c036000 tx=0x7f4f3c03d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:39.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.309+0000 7f4f48ff9640 1 -- 172.21.15.120:0/3572554913 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f4f340540d0 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.513+0000 7f4f51d39640 1 -- 172.21.15.120:0/3572554913 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f4c0b4730 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.513+0000 7f4f48ff9640 1 -- 172.21.15.120:0/3572554913 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3900 (secure 0 0 0) 0x7f4f34015020 con 0x7f4f4c0b4e30 2023-12-19T05:39:39.515 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:39.515 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2696557648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2696557648},{"type":"v1","addr":"172.21.15.155:6833","nonce":2696557648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/1519467235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1519467235},{"type":"v1","addr":"172.21.15.120:6836","nonce":1519467235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:39:37.170513+0000","modified":"2023-12-19T05:39:39.176361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/3161992983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":3161992983},{"type":"v1","addr":"172.21.15.120:6837","nonce":3161992983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T05:39:39.515 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 13 2023-12-19T05:39:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.515+0000 7f4f51d39640 1 -- 172.21.15.120:0/3572554913 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f4f2c06a430 msgr2=0x7f4f2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.515+0000 7f4f51d39640 1 --2- 172.21.15.120:0/3572554913 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f4f2c06a430 0x7f4f2c06c8f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c036000 tx=0x7f4f3c03d040 comp rx=0 tx=0).stop 2023-12-19T05:39:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.515+0000 7f4f51d39640 1 -- 172.21.15.120:0/3572554913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c0b4e30 msgr2=0x7f4f4c14bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.515+0000 7f4f51d39640 1 --2- 172.21.15.120:0/3572554913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c0b4e30 0x7f4f4c14bf90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400b410 tx=0x7f4f3400b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.515+0000 7f4f51d39640 1 -- 172.21.15.120:0/3572554913 shutdown_connections 2023-12-19T05:39:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.515+0000 7f4f51d39640 1 --2- 172.21.15.120:0/3572554913 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f4f2c06a430 0x7f4f2c06c8f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.515+0000 7f4f51d39640 1 --2- 172.21.15.120:0/3572554913 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f4f4c142ee0 0x7f4f4c14c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.515+0000 7f4f51d39640 1 --2- 172.21.15.120:0/3572554913 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f4f4c0b4e30 0x7f4f4c14bf90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.515+0000 7f4f51d39640 1 --2- 172.21.15.120:0/3572554913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f4c06da70 0x7f4f4c149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.515+0000 7f4f51d39640 1 -- 172.21.15.120:0/3572554913 >> 172.21.15.120:0/3572554913 conn(0x7f4f4c0bac10 msgr2=0x7f4f4c0b8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.516+0000 7f4f51d39640 1 -- 172.21.15.120:0/3572554913 shutdown_connections 2023-12-19T05:39:39.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.516+0000 7f4f51d39640 1 -- 172.21.15.120:0/3572554913 wait complete. 2023-12-19T05:39:39.528 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T05:39:39.627 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.625+0000 7f17b7f7e640 1 Processor -- start 2023-12-19T05:39:39.627 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.626+0000 7f17b7f7e640 1 -- start start 2023-12-19T05:39:39.631 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.626+0000 7f17b7f7e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b00b68b0 0x7f17b00702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.631 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.626+0000 7f17b7f7e640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b00b93c0 con 0x7f17b006af90 2023-12-19T05:39:39.631 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.626+0000 7f17b7f7e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b0070800 con 0x7f17b00b95d0 2023-12-19T05:39:39.631 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.626+0000 7f17b7f7e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b0071a30 con 0x7f17b00b68b0 2023-12-19T05:39:39.631 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.626+0000 7f17b651b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f17b006af90 0x7f17b006b3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40358/0 (socket says 172.21.15.120:40358) 2023-12-19T05:39:39.631 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.626+0000 7f17b651b640 1 -- 172.21.15.120:0/3226872033 learned_addr learned my addr 172.21.15.120:0/3226872033 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:39.631 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 -- 172.21.15.120:0/3226872033 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1528550602 0 0) 0x7f17b00b93c0 con 0x7f17b006af90 2023-12-19T05:39:39.631 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 -- 172.21.15.120:0/3226872033 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f179c003520 con 0x7f17b006af90 2023-12-19T05:39:39.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b5d1a640 1 --2- 172.21.15.120:0/3226872033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b00b68b0 0x7f17b00702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 -- 172.21.15.120:0/3226872033 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2919760077 0 0) 0x7f179c003520 con 0x7f17b006af90 2023-12-19T05:39:39.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 -- 172.21.15.120:0/3226872033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b00b68b0 msgr2=0x7f17b00702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:39.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 --2- 172.21.15.120:0/3226872033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b00b68b0 0x7f17b00702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 -- 172.21.15.120:0/3226872033 >> v1:172.21.15.155:6789/0 conn(0x7f17b00b95d0 legacy=0x7f17b01426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 -- 172.21.15.120:0/3226872033 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b0071090 con 0x7f17b006af90 2023-12-19T05:39:39.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 -- 172.21.15.120:0/3226872033 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f17a80019f0 con 0x7f17b006af90 2023-12-19T05:39:39.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b5d1a640 1 --2- 172.21.15.120:0/3226872033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b00b68b0 0x7f17b00702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:39.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 -- 172.21.15.120:0/3226872033 >> v1:172.21.15.120:6789/0 conn(0x7f17b006af90 legacy=0x7f17b006b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 --2- 172.21.15.120:0/3226872033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c0039a0 0x7f179c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 --2- 172.21.15.120:0/3226872033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f179c0047c0 0x7f179c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 --2- 172.21.15.120:0/3226872033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b00b68b0 0x7f179c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.632 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 -- 172.21.15.120:0/3226872033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b0071a30 con 0x7f179c0039a0 2023-12-19T05:39:39.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 -- 172.21.15.120:0/3226872033 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c00bb10 con 0x7f179c0047c0 2023-12-19T05:39:39.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b4d18640 1 -- 172.21.15.120:0/3226872033 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c00bcd0 con 0x7f17b00b68b0 2023-12-19T05:39:39.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b5d1a640 1 --2- 172.21.15.120:0/3226872033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c0039a0 0x7f179c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b651b640 1 --2- 172.21.15.120:0/3226872033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b00b68b0 0x7f179c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b5519640 1 --2- 172.21.15.120:0/3226872033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f179c0047c0 0x7f179c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b5d1a640 1 -- 172.21.15.120:0/3226872033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b00b68b0 msgr2=0x7f179c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:39.633 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b5d1a640 1 --2- 172.21.15.120:0/3226872033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b00b68b0 0x7f179c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.634 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b5d1a640 1 -- 172.21.15.120:0/3226872033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f179c0047c0 msgr2=0x7f179c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:39.634 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b5d1a640 1 --2- 172.21.15.120:0/3226872033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f179c0047c0 0x7f179c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.634 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b5d1a640 1 -- 172.21.15.120:0/3226872033 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c003520 con 0x7f179c0039a0 2023-12-19T05:39:39.634 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.627+0000 7f17b651b640 1 --2- 172.21.15.120:0/3226872033 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f17b00b68b0 0x7f179c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:39.634 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.628+0000 7f17b5d1a640 1 --2- 172.21.15.120:0/3226872033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c0039a0 0x7f179c003dc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f17a40098a0 tx=0x7f179c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e50456a76eed51 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:39.634 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.628+0000 7f17b4d18640 1 -- 172.21.15.120:0/3226872033 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a4004230 con 0x7f179c0039a0 2023-12-19T05:39:39.634 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.628+0000 7f17b4d18640 1 -- 172.21.15.120:0/3226872033 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a4004390 con 0x7f179c0039a0 2023-12-19T05:39:39.634 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.628+0000 7f17b4d18640 1 -- 172.21.15.120:0/3226872033 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a4003830 con 0x7f179c0039a0 2023-12-19T05:39:39.634 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.629+0000 7f17b7f7e640 1 -- 172.21.15.120:0/3226872033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c0039a0 msgr2=0x7f179c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.634 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.629+0000 7f17b7f7e640 1 --2- 172.21.15.120:0/3226872033 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f179c0039a0 0x7f179c003dc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f17a40098a0 tx=0x7f179c0057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.634 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.629+0000 7f17b651b640 1 -- 172.21.15.120:0/3226872033 reap_dead start 2023-12-19T05:39:39.635 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.629+0000 7f17b7f7e640 1 -- 172.21.15.120:0/3226872033 shutdown_connections 2023-12-19T05:39:39.635 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.629+0000 7f17b7f7e640 1 -- 172.21.15.120:0/3226872033 >> 172.21.15.120:0/3226872033 conn(0x7f17b00bcfd0 msgr2=0x7f17b00bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:39.635 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.629+0000 7f17b7f7e640 1 -- 172.21.15.120:0/3226872033 shutdown_connections 2023-12-19T05:39:39.635 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.629+0000 7f17b7f7e640 1 -- 172.21.15.120:0/3226872033 wait complete. 2023-12-19T05:39:39.635 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.630+0000 7f17b7f7e640 1 Processor -- start 2023-12-19T05:39:39.635 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.630+0000 7f17b7f7e640 1 -- start start 2023-12-19T05:39:39.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.630+0000 7f17b7f7e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179c0039a0 0x7f17b014a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.630+0000 7f17b7f7e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17b014b070 0x7f17b0134150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.630+0000 7f17b7f7e640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17b014b4d0 0x7f17b0134690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.638 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.630+0000 7f17b7f7e640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b014aa00 con 0x7f17b014b4d0 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.630+0000 7f17b7f7e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b0134bd0 con 0x7f17b014b070 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.630+0000 7f17b7f7e640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b014bc80 con 0x7f179c0039a0 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.630+0000 7f17b651b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17b014b4d0 0x7f17b0134690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.630+0000 7f17b651b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17b014b4d0 0x7f17b0134690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46620/0 (socket says 172.21.15.120:46620) 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.630+0000 7f17b651b640 1 -- 172.21.15.120:0/2666878881 learned_addr learned my addr 172.21.15.120:0/2666878881 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.631+0000 7f17b651b640 1 -- 172.21.15.120:0/2666878881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179c0039a0 msgr2=0x7f17b014a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.631+0000 7f17b651b640 1 --2- 172.21.15.120:0/2666878881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179c0039a0 0x7f17b014a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.631+0000 7f17b651b640 1 -- 172.21.15.120:0/2666878881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17b014b070 msgr2=0x7f17b0134150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.631+0000 7f17b651b640 1 --2- 172.21.15.120:0/2666878881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17b014b070 0x7f17b0134150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.631+0000 7f17b651b640 1 -- 172.21.15.120:0/2666878881 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b014abe0 con 0x7f17b014b4d0 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.631+0000 7f17b651b640 1 --2- 172.21.15.120:0/2666878881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17b014b4d0 0x7f17b0134690 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f17b0149910 tx=0x7f17a800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.631+0000 7f17a27fc640 1 -- 172.21.15.120:0/2666878881 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a800eb60 con 0x7f17b014b4d0 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.631+0000 7f17a27fc640 1 -- 172.21.15.120:0/2666878881 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a800ecc0 con 0x7f17b014b4d0 2023-12-19T05:39:39.639 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.631+0000 7f17b7f7e640 1 -- 172.21.15.120:0/2666878881 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b0141d00 con 0x7f17b014b4d0 2023-12-19T05:39:39.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.631+0000 7f17a27fc640 1 -- 172.21.15.120:0/2666878881 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a8014430 con 0x7f17b014b4d0 2023-12-19T05:39:39.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.631+0000 7f17b7f7e640 1 -- 172.21.15.120:0/2666878881 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b0139c20 con 0x7f17b014b4d0 2023-12-19T05:39:39.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.632+0000 7f17b7f7e640 1 -- 172.21.15.120:0/2666878881 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b004e080 con 0x7f17b014b4d0 2023-12-19T05:39:39.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.632+0000 7f17a27fc640 1 -- 172.21.15.120:0/2666878881 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f17a80145b0 con 0x7f17b014b4d0 2023-12-19T05:39:39.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.633+0000 7f17a27fc640 1 --2- 172.21.15.120:0/2666878881 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f179406a430 0x7f179406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.633+0000 7f17a27fc640 1 -- 172.21.15.120:0/2666878881 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17a8088600 con 0x7f17b014b4d0 2023-12-19T05:39:39.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.633+0000 7f17b5d1a640 1 --2- 172.21.15.120:0/2666878881 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f179406a430 0x7f179406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.633+0000 7f17b5d1a640 1 --2- 172.21.15.120:0/2666878881 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f179406a430 0x7f179406c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f17a4035000 tx=0x7f17a4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:39.640 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.637+0000 7f17a27fc640 1 -- 172.21.15.120:0/2666878881 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f17a8053bf0 con 0x7f17b014b4d0 2023-12-19T05:39:39.806 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.805+0000 7f17b7f7e640 1 -- 172.21.15.120:0/2666878881 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17b014ad90 con 0x7f17b014b4d0 2023-12-19T05:39:39.807 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.806+0000 7f17a27fc640 1 -- 172.21.15.120:0/2666878881 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f17b014ad90 con 0x7f17b014b4d0 2023-12-19T05:39:39.807 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:39.808 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":31,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T05:39:38.172302+0000","last_up_change":"2023-12-19T05:38:45.033118+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:35.668117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:36.131433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists","up"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T05:39:39.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.808+0000 7f17b7f7e640 1 -- 172.21.15.120:0/2666878881 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f179406a430 msgr2=0x7f179406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.809 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.808+0000 7f17b7f7e640 1 --2- 172.21.15.120:0/2666878881 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f179406a430 0x7f179406c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f17a4035000 tx=0x7f17a4030000 comp rx=0 tx=0).stop 2023-12-19T05:39:39.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.808+0000 7f17b7f7e640 1 -- 172.21.15.120:0/2666878881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17b014b4d0 msgr2=0x7f17b0134690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.808+0000 7f17b7f7e640 1 --2- 172.21.15.120:0/2666878881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17b014b4d0 0x7f17b0134690 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f17b0149910 tx=0x7f17a800e530 comp rx=0 tx=0).stop 2023-12-19T05:39:39.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.808+0000 7f17b7f7e640 1 -- 172.21.15.120:0/2666878881 shutdown_connections 2023-12-19T05:39:39.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.808+0000 7f17b7f7e640 1 --2- 172.21.15.120:0/2666878881 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f179406a430 0x7f179406c8f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.808+0000 7f17b7f7e640 1 --2- 172.21.15.120:0/2666878881 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f17b014b4d0 0x7f17b0134690 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.808+0000 7f17b7f7e640 1 --2- 172.21.15.120:0/2666878881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17b014b070 0x7f17b0134150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.808+0000 7f17b7f7e640 1 --2- 172.21.15.120:0/2666878881 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f179c0039a0 0x7f17b014a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.808+0000 7f17b7f7e640 1 -- 172.21.15.120:0/2666878881 >> 172.21.15.120:0/2666878881 conn(0x7f17b00bcfd0 msgr2=0x7f17b00bc380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:39.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.808+0000 7f17b7f7e640 1 -- 172.21.15.120:0/2666878881 shutdown_connections 2023-12-19T05:39:39.810 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.808+0000 7f17b7f7e640 1 -- 172.21.15.120:0/2666878881 wait complete. 2023-12-19T05:39:39.821 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T05:39:39.821 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:39.919 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.918+0000 7fa44f077640 1 Processor -- start 2023-12-19T05:39:39.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.918+0000 7fa44f077640 1 -- start start 2023-12-19T05:39:39.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.919+0000 7fa44f077640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4480b68b0 0x7fa4480702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.919+0000 7fa44f077640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4480b95d0 0x7fa4481426f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.919+0000 7fa44f077640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4480b93c0 con 0x7fa448142c30 2023-12-19T05:39:39.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.919+0000 7fa44f077640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa448071a30 con 0x7fa4480b95d0 2023-12-19T05:39:39.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.919+0000 7fa44f077640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa448071090 con 0x7fa4480b68b0 2023-12-19T05:39:39.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.919+0000 7fa44ce13640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4480b68b0 0x7fa4480702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.919+0000 7fa447fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4480b95d0 0x7fa4481426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.919+0000 7fa44ce13640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4480b68b0 0x7fa4480702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:38038/0 (socket says 172.21.15.120:38038) 2023-12-19T05:39:39.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.919+0000 7fa447fff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fa4480b95d0 0x7fa4481426f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:55038/0 (socket says 172.21.15.120:55038) 2023-12-19T05:39:39.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.919+0000 7fa44d614640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fa448142c30 0x7fa44806af90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:52888/0 (socket says 172.21.15.120:52888) 2023-12-19T05:39:39.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.920+0000 7fa44ce13640 1 -- 172.21.15.120:0/1428868223 learned_addr learned my addr 172.21.15.120:0/1428868223 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:39.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.920+0000 7fa447fff640 1 -- 172.21.15.120:0/1428868223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4480b68b0 msgr2=0x7fa4480702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:39.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.920+0000 7fa447fff640 1 --2- 172.21.15.120:0/1428868223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4480b68b0 0x7fa4480702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.920+0000 7fa447fff640 1 -- 172.21.15.120:0/1428868223 >> v1:172.21.15.155:6789/0 conn(0x7fa448142c30 legacy=0x7fa44806af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.920+0000 7fa4477fe640 1 -- 172.21.15.120:0/1428868223 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259494561 0 0) 0x7fa4480b93c0 con 0x7fa448142c30 2023-12-19T05:39:39.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.920+0000 7fa447fff640 1 -- 172.21.15.120:0/1428868223 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa448070800 con 0x7fa4480b95d0 2023-12-19T05:39:39.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.920+0000 7fa44ce13640 1 --2- 172.21.15.120:0/1428868223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4480b68b0 0x7fa4480702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:39.923 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.921+0000 7fa447fff640 1 --2- 172.21.15.120:0/1428868223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4480b95d0 0x7fa4481426f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa4340097a0 tx=0x7fa43402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bba93fa1da7f1883 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:39.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.921+0000 7fa4477fe640 1 -- 172.21.15.120:0/1428868223 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434030610 con 0x7fa4480b95d0 2023-12-19T05:39:39.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.921+0000 7fa4477fe640 1 -- 172.21.15.120:0/1428868223 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434030770 con 0x7fa4480b95d0 2023-12-19T05:39:39.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.921+0000 7fa4477fe640 1 -- 172.21.15.120:0/1428868223 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434030b00 con 0x7fa4480b95d0 2023-12-19T05:39:39.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.921+0000 7fa44f077640 1 -- 172.21.15.120:0/1428868223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4480b95d0 msgr2=0x7fa4481426f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.921+0000 7fa44f077640 1 --2- 172.21.15.120:0/1428868223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4480b95d0 0x7fa4481426f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa4340097a0 tx=0x7fa43402b960 comp rx=0 tx=0).stop 2023-12-19T05:39:39.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.921+0000 7fa44f077640 1 -- 172.21.15.120:0/1428868223 shutdown_connections 2023-12-19T05:39:39.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.921+0000 7fa44f077640 1 --2- 172.21.15.120:0/1428868223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4480b95d0 0x7fa4481426f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.921+0000 7fa44f077640 1 --2- 172.21.15.120:0/1428868223 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa4480b68b0 0x7fa4480702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.921+0000 7fa44f077640 1 -- 172.21.15.120:0/1428868223 >> 172.21.15.120:0/1428868223 conn(0x7fa4480bcfd0 msgr2=0x7fa4480bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:39.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.921+0000 7fa44f077640 1 -- 172.21.15.120:0/1428868223 shutdown_connections 2023-12-19T05:39:39.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.922+0000 7fa44f077640 1 -- 172.21.15.120:0/1428868223 wait complete. 2023-12-19T05:39:39.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.922+0000 7fa44f077640 1 Processor -- start 2023-12-19T05:39:39.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.923+0000 7fa44f077640 1 -- start start 2023-12-19T05:39:39.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.923+0000 7fa44f077640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4480b68b0 0x7fa4481e08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.923+0000 7fa44f077640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4480b95d0 0x7fa44813d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.923+0000 7fa44f077640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa448142c30 0x7fa448144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.923+0000 7fa44f077640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa448143890 con 0x7fa4480b95d0 2023-12-19T05:39:39.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.923+0000 7fa44f077640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4481449c0 con 0x7fa4480b68b0 2023-12-19T05:39:39.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.923+0000 7fa44f077640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44813db60 con 0x7fa448142c30 2023-12-19T05:39:39.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.923+0000 7fa447fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4480b95d0 0x7fa44813d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.923+0000 7fa447fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4480b95d0 0x7fa44813d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46632/0 (socket says 172.21.15.120:46632) 2023-12-19T05:39:39.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.923+0000 7fa447fff640 1 -- 172.21.15.120:0/2606426011 learned_addr learned my addr 172.21.15.120:0/2606426011 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:39.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa44d614640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa448142c30 0x7fa448144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa44ce13640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4480b68b0 0x7fa4481e08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa447fff640 1 -- 172.21.15.120:0/2606426011 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa448142c30 msgr2=0x7fa448144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa447fff640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa448142c30 0x7fa448144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa447fff640 1 -- 172.21.15.120:0/2606426011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4480b68b0 msgr2=0x7fa4481e08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:39.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa447fff640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4480b68b0 0x7fa4481e08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:39.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa447fff640 1 -- 172.21.15.120:0/2606426011 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c0094d0 con 0x7fa4480b95d0 2023-12-19T05:39:39.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa44d614640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa448142c30 0x7fa448144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:39.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa44ce13640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4480b68b0 0x7fa4481e08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:39.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa447fff640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4480b95d0 0x7fa44813d620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa434000c00 tx=0x7fa4340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:39.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa4457fa640 1 -- 172.21.15.120:0/2606426011 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434039c90 con 0x7fa4480b95d0 2023-12-19T05:39:39.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa4457fa640 1 -- 172.21.15.120:0/2606426011 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43403f040 con 0x7fa4480b95d0 2023-12-19T05:39:39.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa44f077640 1 -- 172.21.15.120:0/2606426011 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa434009400 con 0x7fa4480b95d0 2023-12-19T05:39:39.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa4457fa640 1 -- 172.21.15.120:0/2606426011 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434006e10 con 0x7fa4480b95d0 2023-12-19T05:39:39.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.924+0000 7fa44f077640 1 -- 172.21.15.120:0/2606426011 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa448145370 con 0x7fa4480b95d0 2023-12-19T05:39:39.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.925+0000 7fa44f077640 1 -- 172.21.15.120:0/2606426011 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa448144b00 con 0x7fa4480b95d0 2023-12-19T05:39:39.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.925+0000 7fa4457fa640 1 -- 172.21.15.120:0/2606426011 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa434004030 con 0x7fa4480b95d0 2023-12-19T05:39:39.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.926+0000 7fa4457fa640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa42c06a460 0x7fa42c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:39.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.926+0000 7fa4457fa640 1 -- 172.21.15.120:0/2606426011 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4340aa760 con 0x7fa4480b95d0 2023-12-19T05:39:39.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.926+0000 7fa44ce13640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa42c06a460 0x7fa42c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:39.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.926+0000 7fa44ce13640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa42c06a460 0x7fa42c06c920 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009db0 tx=0x7fa43c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:39.931 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:39.930+0000 7fa4457fa640 1 -- 172.21.15.120:0/2606426011 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa448144b00 con 0x7fa4480b95d0 2023-12-19T05:39:40.095 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.094+0000 7fa44f077640 1 -- 172.21.15.120:0/2606426011 --> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa448071370 con 0x7fa42c06a460 2023-12-19T05:39:40.101 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.100+0000 7fa4457fa640 1 -- 172.21.15.120:0/2606426011 <== mgr.4101 v2:172.21.15.120:6832/89586 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253683 (secure 0 0 0) 0x7fa43c009a00 con 0x7fa42c06a460 2023-12-19T05:39:40.104 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:40.105 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2023-12-19T05:39:40.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.103+0000 7fa44f077640 1 -- 172.21.15.120:0/2606426011 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa42c06a460 msgr2=0x7fa42c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.103+0000 7fa44f077640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa42c06a460 0x7fa42c06c920 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009db0 tx=0x7fa43c008040 comp rx=0 tx=0).stop 2023-12-19T05:39:40.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.103+0000 7fa44f077640 1 -- 172.21.15.120:0/2606426011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4480b95d0 msgr2=0x7fa44813d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.103+0000 7fa44f077640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4480b95d0 0x7fa44813d620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa434000c00 tx=0x7fa4340046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.103+0000 7fa44f077640 1 -- 172.21.15.120:0/2606426011 shutdown_connections 2023-12-19T05:39:40.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.103+0000 7fa44f077640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa42c06a460 0x7fa42c06c920 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.103+0000 7fa44f077640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa448142c30 0x7fa448144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.103+0000 7fa44f077640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa4480b95d0 0x7fa44813d620 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.103+0000 7fa44f077640 1 --2- 172.21.15.120:0/2606426011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4480b68b0 0x7fa4481e08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.103+0000 7fa44f077640 1 -- 172.21.15.120:0/2606426011 >> 172.21.15.120:0/2606426011 conn(0x7fa4480bcfd0 msgr2=0x7fa44806aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:40.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.103+0000 7fa44f077640 1 -- 172.21.15.120:0/2606426011 shutdown_connections 2023-12-19T05:39:40.107 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.103+0000 7fa44f077640 1 -- 172.21.15.120:0/2606426011 wait complete. 2023-12-19T05:39:40.115 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-12-19T05:39:39.943728+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":3488,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":3571712,"data_stored":2051522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.135663"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811456+0000","last_change":"2023-12-19T05:39:35.811456+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811456+0000","last_undegraded":"2023-12-19T05:39:35.811456+0000","last_fullsized":"2023-12-19T05:39:35.811456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:51.733584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812793+0000","last_change":"2023-12-19T05:39:35.812793+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812793+0000","last_undegraded":"2023-12-19T05:39:35.812793+0000","last_fullsized":"2023-12-19T05:39:35.812793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:47:31.445497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814707+0000","last_change":"2023-12-19T05:39:35.814707+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814707+0000","last_undegraded":"2023-12-19T05:39:35.814707+0000","last_fullsized":"2023-12-19T05:39:35.814707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812902+0000","last_change":"2023-12-19T05:39:35.812902+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812902+0000","last_undegraded":"2023-12-19T05:39:35.812902+0000","last_fullsized":"2023-12-19T05:39:35.812902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:43:16.527733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811767+0000","last_change":"2023-12-19T05:39:35.811767+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811767+0000","last_undegraded":"2023-12-19T05:39:35.811767+0000","last_fullsized":"2023-12-19T05:39:35.811767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:29.938867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811183+0000","last_change":"2023-12-19T05:39:35.811183+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811183+0000","last_undegraded":"2023-12-19T05:39:35.811183+0000","last_fullsized":"2023-12-19T05:39:35.811183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:12:49.113154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.815480+0000","last_change":"2023-12-19T05:39:35.815480+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.815480+0000","last_undegraded":"2023-12-19T05:39:35.815480+0000","last_fullsized":"2023-12-19T05:39:35.815480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:18:28.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810651+0000","last_change":"2023-12-19T05:39:35.810651+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810651+0000","last_undegraded":"2023-12-19T05:39:35.810651+0000","last_fullsized":"2023-12-19T05:39:35.810651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:00:04.318274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.815002+0000","last_change":"2023-12-19T05:39:35.815002+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.815002+0000","last_undegraded":"2023-12-19T05:39:35.815002+0000","last_fullsized":"2023-12-19T05:39:35.815002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:49:33.898019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812154+0000","last_change":"2023-12-19T05:39:35.812154+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812154+0000","last_undegraded":"2023-12-19T05:39:35.812154+0000","last_fullsized":"2023-12-19T05:39:35.812154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813520+0000","last_change":"2023-12-19T05:39:35.813520+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813520+0000","last_undegraded":"2023-12-19T05:39:35.813520+0000","last_fullsized":"2023-12-19T05:39:35.813520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814473+0000","last_change":"2023-12-19T05:39:35.814473+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814473+0000","last_undegraded":"2023-12-19T05:39:35.814473+0000","last_fullsized":"2023-12-19T05:39:35.814473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810695+0000","last_change":"2023-12-19T05:39:35.810695+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810695+0000","last_undegraded":"2023-12-19T05:39:35.810695+0000","last_fullsized":"2023-12-19T05:39:35.810695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:25:12.013208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814357+0000","last_change":"2023-12-19T05:39:35.814357+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814357+0000","last_undegraded":"2023-12-19T05:39:35.814357+0000","last_fullsized":"2023-12-19T05:39:35.814357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:04:00.332266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814872+0000","last_change":"2023-12-19T05:39:35.814872+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814872+0000","last_undegraded":"2023-12-19T05:39:35.814872+0000","last_fullsized":"2023-12-19T05:39:35.814872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:47:31.445497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814886+0000","last_change":"2023-12-19T05:39:35.814886+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814886+0000","last_undegraded":"2023-12-19T05:39:35.814886+0000","last_fullsized":"2023-12-19T05:39:35.814886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:00.514986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814154+0000","last_change":"2023-12-19T05:39:35.814154+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814154+0000","last_undegraded":"2023-12-19T05:39:35.814154+0000","last_fullsized":"2023-12-19T05:39:35.814154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:22:01.593157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811928+0000","last_change":"2023-12-19T05:39:35.811928+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811928+0000","last_undegraded":"2023-12-19T05:39:35.811928+0000","last_fullsized":"2023-12-19T05:39:35.811928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:24:10.386915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810676+0000","last_change":"2023-12-19T05:39:35.810676+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810676+0000","last_undegraded":"2023-12-19T05:39:35.810676+0000","last_fullsized":"2023-12-19T05:39:35.810676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:09:30.685286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810693+0000","last_change":"2023-12-19T05:39:35.810693+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810693+0000","last_undegraded":"2023-12-19T05:39:35.810693+0000","last_fullsized":"2023-12-19T05:39:35.810693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:51.733584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811667+0000","last_change":"2023-12-19T05:39:35.811667+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811667+0000","last_undegraded":"2023-12-19T05:39:35.811667+0000","last_fullsized":"2023-12-19T05:39:35.811667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811520+0000","last_change":"2023-12-19T05:39:35.811520+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811520+0000","last_undegraded":"2023-12-19T05:39:35.811520+0000","last_fullsized":"2023-12-19T05:39:35.811520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:06.383246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812117+0000","last_change":"2023-12-19T05:39:35.812117+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812117+0000","last_undegraded":"2023-12-19T05:39:35.812117+0000","last_fullsized":"2023-12-19T05:39:35.812117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:17:54.314037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813442+0000","last_change":"2023-12-19T05:39:35.813442+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813442+0000","last_undegraded":"2023-12-19T05:39:35.813442+0000","last_fullsized":"2023-12-19T05:39:35.813442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813550+0000","last_change":"2023-12-19T05:39:35.813550+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813550+0000","last_undegraded":"2023-12-19T05:39:35.813550+0000","last_fullsized":"2023-12-19T05:39:35.813550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:08:56.288042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811075+0000","last_change":"2023-12-19T05:39:35.811075+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811075+0000","last_undegraded":"2023-12-19T05:39:35.811075+0000","last_fullsized":"2023-12-19T05:39:35.811075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:18:28.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813958+0000","last_change":"2023-12-19T05:39:35.813958+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813958+0000","last_undegraded":"2023-12-19T05:39:35.813958+0000","last_fullsized":"2023-12-19T05:39:35.813958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:06.383246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811075+0000","last_change":"2023-12-19T05:39:35.811075+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811075+0000","last_undegraded":"2023-12-19T05:39:35.811075+0000","last_fullsized":"2023-12-19T05:39:35.811075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:18:47.836073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813559+0000","last_change":"2023-12-19T05:39:35.813559+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813559+0000","last_undegraded":"2023-12-19T05:39:35.813559+0000","last_fullsized":"2023-12-19T05:39:35.813559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:13:18.741953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811575+0000","last_change":"2023-12-19T05:39:35.811575+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811575+0000","last_undegraded":"2023-12-19T05:39:35.811575+0000","last_fullsized":"2023-12-19T05:39:35.811575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:15:22.976217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814442+0000","last_change":"2023-12-19T05:39:35.814442+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814442+0000","last_undegraded":"2023-12-19T05:39:35.814442+0000","last_fullsized":"2023-12-19T05:39:35.814442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:44:21.196968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811392+0000","last_change":"2023-12-19T05:39:35.811392+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811392+0000","last_undegraded":"2023-12-19T05:39:35.811392+0000","last_fullsized":"2023-12-19T05:39:35.811392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:29.938867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-19T05:39:32.119904+0000","last_change":"2023-12-19T05:38:47.150620+0000","last_active":"2023-12-19T05:39:32.119904+0000","last_peered":"2023-12-19T05:39:32.119904+0000","last_clean":"2023-12-19T05:39:32.119904+0000","last_became_active":"2023-12-19T05:38:47.149844+0000","last_became_peered":"2023-12-19T05:38:47.149844+0000","last_unstale":"2023-12-19T05:39:32.119904+0000","last_undegraded":"2023-12-19T05:39:32.119904+0000","last_fullsized":"2023-12-19T05:39:32.119904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_clean_scrub_stamp":"2023-12-19T05:38:46.034642+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:51.920917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":108084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":888832,"data_stored":698452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T05:39:40.119 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:40.254 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.252+0000 7ffa8b39f640 1 Processor -- start 2023-12-19T05:39:40.254 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.253+0000 7ffa8b39f640 1 -- start start 2023-12-19T05:39:40.255 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.253+0000 7ffa8b39f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ffa8406ae10 0x7ffa8414b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.255 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.253+0000 7ffa8b39f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8414b700 0x7ffa84155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.255 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.253+0000 7ffa8b39f640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa840bbb60 con 0x7ffa84144d60 2023-12-19T05:39:40.255 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.253+0000 7ffa8b39f640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa8406b980 con 0x7ffa8406ae10 2023-12-19T05:39:40.255 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.253+0000 7ffa8b39f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8414aa40 con 0x7ffa8414b700 2023-12-19T05:39:40.256 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.253+0000 7ffa8893a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ffa8406ae10 0x7ffa8414b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.256 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.253+0000 7ffa8913b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7ffa84144d60 0x7ffa8406d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40362/0 (socket says 172.21.15.120:40362) 2023-12-19T05:39:40.256 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.253+0000 7ffa8893a640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7ffa8406ae10 0x7ffa8414b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46634/0 (socket says 172.21.15.120:46634) 2023-12-19T05:39:40.256 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.253+0000 7ffa8913b640 1 -- 172.21.15.120:0/3612873420 learned_addr learned my addr 172.21.15.120:0/3612873420 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:40.256 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.254+0000 7ffa8993c640 1 --2- 172.21.15.120:0/3612873420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8414b700 0x7ffa84155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.256 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.254+0000 7ffa8893a640 1 -- 172.21.15.120:0/3612873420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8414b700 msgr2=0x7ffa84155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:40.256 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.254+0000 7ffa8893a640 1 --2- 172.21.15.120:0/3612873420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8414b700 0x7ffa84155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.256 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.254+0000 7ffa8893a640 1 -- 172.21.15.120:0/3612873420 >> v1:172.21.15.120:6789/0 conn(0x7ffa84144d60 legacy=0x7ffa8406d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.256 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.254+0000 7ffa8893a640 1 -- 172.21.15.120:0/3612873420 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa840b8b10 con 0x7ffa8406ae10 2023-12-19T05:39:40.256 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.254+0000 7ffa77fff640 1 -- 172.21.15.120:0/3612873420 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455302801 0 0) 0x7ffa840bbb60 con 0x7ffa84144d60 2023-12-19T05:39:40.256 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.254+0000 7ffa8993c640 1 --2- 172.21.15.120:0/3612873420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8414b700 0x7ffa84155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:40.256 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.254+0000 7ffa8893a640 1 --2- 172.21.15.120:0/3612873420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8406ae10 0x7ffa8414b1c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffa800097a0 tx=0x7ffa8002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92cf690292e5478 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.255+0000 7ffa77fff640 1 -- 172.21.15.120:0/3612873420 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80030610 con 0x7ffa8406ae10 2023-12-19T05:39:40.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.255+0000 7ffa77fff640 1 -- 172.21.15.120:0/3612873420 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa80030770 con 0x7ffa8406ae10 2023-12-19T05:39:40.259 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.255+0000 7ffa77fff640 1 -- 172.21.15.120:0/3612873420 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80030b00 con 0x7ffa8406ae10 2023-12-19T05:39:40.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.255+0000 7ffa8b39f640 1 -- 172.21.15.120:0/3612873420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8406ae10 msgr2=0x7ffa8414b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.255+0000 7ffa8b39f640 1 --2- 172.21.15.120:0/3612873420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8406ae10 0x7ffa8414b1c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffa800097a0 tx=0x7ffa8002b960 comp rx=0 tx=0).stop 2023-12-19T05:39:40.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.255+0000 7ffa8b39f640 1 -- 172.21.15.120:0/3612873420 shutdown_connections 2023-12-19T05:39:40.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.255+0000 7ffa8b39f640 1 --2- 172.21.15.120:0/3612873420 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8406ae10 0x7ffa8414b1c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.255+0000 7ffa8b39f640 1 --2- 172.21.15.120:0/3612873420 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa8414b700 0x7ffa84155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.255+0000 7ffa8b39f640 1 -- 172.21.15.120:0/3612873420 >> 172.21.15.120:0/3612873420 conn(0x7ffa840bac10 msgr2=0x7ffa840bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:40.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.255+0000 7ffa8b39f640 1 -- 172.21.15.120:0/3612873420 shutdown_connections 2023-12-19T05:39:40.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.255+0000 7ffa8b39f640 1 -- 172.21.15.120:0/3612873420 wait complete. 2023-12-19T05:39:40.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.256+0000 7ffa8b39f640 1 Processor -- start 2023-12-19T05:39:40.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.256+0000 7ffa8b39f640 1 -- start start 2023-12-19T05:39:40.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8b39f640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8406ae10 0x7ffa841e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8b39f640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84144d60 0x7ffa841dfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8b39f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa8414b700 0x7ffa84142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.260 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8b39f640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa841e0ad0 con 0x7ffa8406ae10 2023-12-19T05:39:40.261 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8b39f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa841e3100 con 0x7ffa8414b700 2023-12-19T05:39:40.261 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8b39f640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa841e33a0 con 0x7ffa84144d60 2023-12-19T05:39:40.261 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8913b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8406ae10 0x7ffa841e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.261 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8913b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8406ae10 0x7ffa841e3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46648/0 (socket says 172.21.15.120:46648) 2023-12-19T05:39:40.261 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8913b640 1 -- 172.21.15.120:0/717869637 learned_addr learned my addr 172.21.15.120:0/717869637 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:40.261 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8893a640 1 --2- 172.21.15.120:0/717869637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84144d60 0x7ffa841dfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.261 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8913b640 1 -- 172.21.15.120:0/717869637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84144d60 msgr2=0x7ffa841dfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.262 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8913b640 1 --2- 172.21.15.120:0/717869637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84144d60 0x7ffa841dfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.262 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8913b640 1 -- 172.21.15.120:0/717869637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa8414b700 msgr2=0x7ffa84142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.262 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8913b640 1 --2- 172.21.15.120:0/717869637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa8414b700 0x7ffa84142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.262 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8913b640 1 -- 172.21.15.120:0/717869637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa80009400 con 0x7ffa8406ae10 2023-12-19T05:39:40.262 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8913b640 1 --2- 172.21.15.120:0/717869637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8406ae10 0x7ffa841e3ba0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800c4d0 tx=0x7ffa7800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.262 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa75ffb640 1 -- 172.21.15.120:0/717869637 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa780074e0 con 0x7ffa8406ae10 2023-12-19T05:39:40.262 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa75ffb640 1 -- 172.21.15.120:0/717869637 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa78007660 con 0x7ffa8406ae10 2023-12-19T05:39:40.262 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa8b39f640 1 -- 172.21.15.120:0/717869637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa841e3680 con 0x7ffa8406ae10 2023-12-19T05:39:40.262 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.257+0000 7ffa75ffb640 1 -- 172.21.15.120:0/717869637 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78004a20 con 0x7ffa8406ae10 2023-12-19T05:39:40.262 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.258+0000 7ffa8b39f640 1 -- 172.21.15.120:0/717869637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa840bde50 con 0x7ffa8406ae10 2023-12-19T05:39:40.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.259+0000 7ffa8b39f640 1 -- 172.21.15.120:0/717869637 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8404e080 con 0x7ffa8406ae10 2023-12-19T05:39:40.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.259+0000 7ffa75ffb640 1 -- 172.21.15.120:0/717869637 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffa78004b80 con 0x7ffa8406ae10 2023-12-19T05:39:40.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.259+0000 7ffa75ffb640 1 --2- 172.21.15.120:0/717869637 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ffa6806a430 0x7ffa6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.259+0000 7ffa75ffb640 1 -- 172.21.15.120:0/717869637 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa78087e30 con 0x7ffa8406ae10 2023-12-19T05:39:40.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.259+0000 7ffa8893a640 1 --2- 172.21.15.120:0/717869637 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ffa6806a430 0x7ffa6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.263 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.260+0000 7ffa8893a640 1 --2- 172.21.15.120:0/717869637 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ffa6806a430 0x7ffa6806c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffa80036000 tx=0x7ffa8003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.264 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.263+0000 7ffa75ffb640 1 -- 172.21.15.120:0/717869637 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ffa78053420 con 0x7ffa8406ae10 2023-12-19T05:39:40.426 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.425+0000 7ffa8b39f640 1 -- 172.21.15.120:0/717869637 --> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa8406b3c0 con 0x7ffa6806a430 2023-12-19T05:39:40.432 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.431+0000 7ffa75ffb640 1 -- 172.21.15.120:0/717869637 <== mgr.4101 v2:172.21.15.120:6832/89586 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253683 (secure 0 0 0) 0x7ffa8003f040 con 0x7ffa6806a430 2023-12-19T05:39:40.435 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:40.436 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2023-12-19T05:39:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.434+0000 7ffa8b39f640 1 -- 172.21.15.120:0/717869637 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ffa6806a430 msgr2=0x7ffa6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.434+0000 7ffa8b39f640 1 --2- 172.21.15.120:0/717869637 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ffa6806a430 0x7ffa6806c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ffa80036000 tx=0x7ffa8003b040 comp rx=0 tx=0).stop 2023-12-19T05:39:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.434+0000 7ffa8b39f640 1 -- 172.21.15.120:0/717869637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8406ae10 msgr2=0x7ffa841e3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.434+0000 7ffa8b39f640 1 --2- 172.21.15.120:0/717869637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8406ae10 0x7ffa841e3ba0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffa7800c4d0 tx=0x7ffa7800c990 comp rx=0 tx=0).stop 2023-12-19T05:39:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.434+0000 7ffa8b39f640 1 -- 172.21.15.120:0/717869637 shutdown_connections 2023-12-19T05:39:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.434+0000 7ffa8b39f640 1 --2- 172.21.15.120:0/717869637 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ffa6806a430 0x7ffa6806c8f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.434+0000 7ffa8b39f640 1 --2- 172.21.15.120:0/717869637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa8414b700 0x7ffa84142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.434+0000 7ffa8b39f640 1 --2- 172.21.15.120:0/717869637 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ffa84144d60 0x7ffa841dfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.434+0000 7ffa8b39f640 1 --2- 172.21.15.120:0/717869637 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ffa8406ae10 0x7ffa841e3ba0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.434+0000 7ffa8b39f640 1 -- 172.21.15.120:0/717869637 >> 172.21.15.120:0/717869637 conn(0x7ffa840bac10 msgr2=0x7ffa84148900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.434+0000 7ffa8b39f640 1 -- 172.21.15.120:0/717869637 shutdown_connections 2023-12-19T05:39:40.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.434+0000 7ffa8b39f640 1 -- 172.21.15.120:0/717869637 wait complete. 2023-12-19T05:39:40.446 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-12-19T05:39:39.943728+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":3488,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":3571712,"data_stored":2051522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.135663"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811456+0000","last_change":"2023-12-19T05:39:35.811456+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811456+0000","last_undegraded":"2023-12-19T05:39:35.811456+0000","last_fullsized":"2023-12-19T05:39:35.811456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:51.733584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812793+0000","last_change":"2023-12-19T05:39:35.812793+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812793+0000","last_undegraded":"2023-12-19T05:39:35.812793+0000","last_fullsized":"2023-12-19T05:39:35.812793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:47:31.445497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814707+0000","last_change":"2023-12-19T05:39:35.814707+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814707+0000","last_undegraded":"2023-12-19T05:39:35.814707+0000","last_fullsized":"2023-12-19T05:39:35.814707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812902+0000","last_change":"2023-12-19T05:39:35.812902+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812902+0000","last_undegraded":"2023-12-19T05:39:35.812902+0000","last_fullsized":"2023-12-19T05:39:35.812902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:43:16.527733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811767+0000","last_change":"2023-12-19T05:39:35.811767+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811767+0000","last_undegraded":"2023-12-19T05:39:35.811767+0000","last_fullsized":"2023-12-19T05:39:35.811767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:29.938867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811183+0000","last_change":"2023-12-19T05:39:35.811183+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811183+0000","last_undegraded":"2023-12-19T05:39:35.811183+0000","last_fullsized":"2023-12-19T05:39:35.811183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:12:49.113154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.815480+0000","last_change":"2023-12-19T05:39:35.815480+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.815480+0000","last_undegraded":"2023-12-19T05:39:35.815480+0000","last_fullsized":"2023-12-19T05:39:35.815480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:18:28.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810651+0000","last_change":"2023-12-19T05:39:35.810651+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810651+0000","last_undegraded":"2023-12-19T05:39:35.810651+0000","last_fullsized":"2023-12-19T05:39:35.810651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:00:04.318274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.815002+0000","last_change":"2023-12-19T05:39:35.815002+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.815002+0000","last_undegraded":"2023-12-19T05:39:35.815002+0000","last_fullsized":"2023-12-19T05:39:35.815002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:49:33.898019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812154+0000","last_change":"2023-12-19T05:39:35.812154+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812154+0000","last_undegraded":"2023-12-19T05:39:35.812154+0000","last_fullsized":"2023-12-19T05:39:35.812154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813520+0000","last_change":"2023-12-19T05:39:35.813520+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813520+0000","last_undegraded":"2023-12-19T05:39:35.813520+0000","last_fullsized":"2023-12-19T05:39:35.813520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814473+0000","last_change":"2023-12-19T05:39:35.814473+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814473+0000","last_undegraded":"2023-12-19T05:39:35.814473+0000","last_fullsized":"2023-12-19T05:39:35.814473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810695+0000","last_change":"2023-12-19T05:39:35.810695+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810695+0000","last_undegraded":"2023-12-19T05:39:35.810695+0000","last_fullsized":"2023-12-19T05:39:35.810695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:25:12.013208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814357+0000","last_change":"2023-12-19T05:39:35.814357+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814357+0000","last_undegraded":"2023-12-19T05:39:35.814357+0000","last_fullsized":"2023-12-19T05:39:35.814357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:04:00.332266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814872+0000","last_change":"2023-12-19T05:39:35.814872+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814872+0000","last_undegraded":"2023-12-19T05:39:35.814872+0000","last_fullsized":"2023-12-19T05:39:35.814872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:47:31.445497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814886+0000","last_change":"2023-12-19T05:39:35.814886+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814886+0000","last_undegraded":"2023-12-19T05:39:35.814886+0000","last_fullsized":"2023-12-19T05:39:35.814886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:00.514986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814154+0000","last_change":"2023-12-19T05:39:35.814154+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814154+0000","last_undegraded":"2023-12-19T05:39:35.814154+0000","last_fullsized":"2023-12-19T05:39:35.814154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:22:01.593157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811928+0000","last_change":"2023-12-19T05:39:35.811928+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811928+0000","last_undegraded":"2023-12-19T05:39:35.811928+0000","last_fullsized":"2023-12-19T05:39:35.811928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:24:10.386915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810676+0000","last_change":"2023-12-19T05:39:35.810676+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810676+0000","last_undegraded":"2023-12-19T05:39:35.810676+0000","last_fullsized":"2023-12-19T05:39:35.810676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:09:30.685286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810693+0000","last_change":"2023-12-19T05:39:35.810693+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810693+0000","last_undegraded":"2023-12-19T05:39:35.810693+0000","last_fullsized":"2023-12-19T05:39:35.810693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:51.733584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811667+0000","last_change":"2023-12-19T05:39:35.811667+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811667+0000","last_undegraded":"2023-12-19T05:39:35.811667+0000","last_fullsized":"2023-12-19T05:39:35.811667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811520+0000","last_change":"2023-12-19T05:39:35.811520+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811520+0000","last_undegraded":"2023-12-19T05:39:35.811520+0000","last_fullsized":"2023-12-19T05:39:35.811520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:06.383246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812117+0000","last_change":"2023-12-19T05:39:35.812117+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812117+0000","last_undegraded":"2023-12-19T05:39:35.812117+0000","last_fullsized":"2023-12-19T05:39:35.812117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:17:54.314037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813442+0000","last_change":"2023-12-19T05:39:35.813442+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813442+0000","last_undegraded":"2023-12-19T05:39:35.813442+0000","last_fullsized":"2023-12-19T05:39:35.813442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813550+0000","last_change":"2023-12-19T05:39:35.813550+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813550+0000","last_undegraded":"2023-12-19T05:39:35.813550+0000","last_fullsized":"2023-12-19T05:39:35.813550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:08:56.288042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811075+0000","last_change":"2023-12-19T05:39:35.811075+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811075+0000","last_undegraded":"2023-12-19T05:39:35.811075+0000","last_fullsized":"2023-12-19T05:39:35.811075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:18:28.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813958+0000","last_change":"2023-12-19T05:39:35.813958+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813958+0000","last_undegraded":"2023-12-19T05:39:35.813958+0000","last_fullsized":"2023-12-19T05:39:35.813958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:06.383246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811075+0000","last_change":"2023-12-19T05:39:35.811075+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811075+0000","last_undegraded":"2023-12-19T05:39:35.811075+0000","last_fullsized":"2023-12-19T05:39:35.811075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:18:47.836073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813559+0000","last_change":"2023-12-19T05:39:35.813559+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813559+0000","last_undegraded":"2023-12-19T05:39:35.813559+0000","last_fullsized":"2023-12-19T05:39:35.813559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:13:18.741953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811575+0000","last_change":"2023-12-19T05:39:35.811575+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811575+0000","last_undegraded":"2023-12-19T05:39:35.811575+0000","last_fullsized":"2023-12-19T05:39:35.811575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:15:22.976217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814442+0000","last_change":"2023-12-19T05:39:35.814442+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814442+0000","last_undegraded":"2023-12-19T05:39:35.814442+0000","last_fullsized":"2023-12-19T05:39:35.814442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:44:21.196968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811392+0000","last_change":"2023-12-19T05:39:35.811392+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811392+0000","last_undegraded":"2023-12-19T05:39:35.811392+0000","last_fullsized":"2023-12-19T05:39:35.811392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:29.938867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-19T05:39:32.119904+0000","last_change":"2023-12-19T05:38:47.150620+0000","last_active":"2023-12-19T05:39:32.119904+0000","last_peered":"2023-12-19T05:39:32.119904+0000","last_clean":"2023-12-19T05:39:32.119904+0000","last_became_active":"2023-12-19T05:38:47.149844+0000","last_became_peered":"2023-12-19T05:38:47.149844+0000","last_unstale":"2023-12-19T05:39:32.119904+0000","last_undegraded":"2023-12-19T05:39:32.119904+0000","last_fullsized":"2023-12-19T05:39:32.119904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_clean_scrub_stamp":"2023-12-19T05:38:46.034642+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:51.920917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":108084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":888832,"data_stored":698452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T05:39:40.450 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:40.585 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.584+0000 7fbd8644b640 1 Processor -- start 2023-12-19T05:39:40.585 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.584+0000 7fbd8644b640 1 -- start start 2023-12-19T05:39:40.587 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.585+0000 7fbd8644b640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbd80144d60 0x7fbd8006d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.587 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.585+0000 7fbd8644b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbd8006ae10 0x7fbd8014b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.587 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.585+0000 7fbd8644b640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd800bbb60 con 0x7fbd8014b700 2023-12-19T05:39:40.587 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.585+0000 7fbd8644b640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8006b980 con 0x7fbd80144d60 2023-12-19T05:39:40.587 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.585+0000 7fbd8644b640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8014aa40 con 0x7fbd8006ae10 2023-12-19T05:39:40.587 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.585+0000 7fbd7ffff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbd80144d60 0x7fbd8006d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.587 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.585+0000 7fbd849e8640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fbd8014b700 0x7fbd8014df90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40374/0 (socket says 172.21.15.120:40374) 2023-12-19T05:39:40.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.585+0000 7fbd849e8640 1 -- 172.21.15.120:0/1351628602 learned_addr learned my addr 172.21.15.120:0/1351628602 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:40.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.585+0000 7fbd7ffff640 1 -- 172.21.15.120:0/1351628602 >> v2:172.21.15.155:3300/0 conn(0x7fbd8006ae10 msgr2=0x7fbd8014b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:40.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.585+0000 7fbd7ffff640 1 --2- 172.21.15.120:0/1351628602 >> v2:172.21.15.155:3300/0 conn(0x7fbd8006ae10 0x7fbd8014b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.585+0000 7fbd7ffff640 1 -- 172.21.15.120:0/1351628602 >> v1:172.21.15.120:6789/0 conn(0x7fbd8014b700 legacy=0x7fbd8014df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.585+0000 7fbd7ffff640 1 -- 172.21.15.120:0/1351628602 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd800b8b10 con 0x7fbd80144d60 2023-12-19T05:39:40.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.585+0000 7fbd7effd640 1 -- 172.21.15.120:0/1351628602 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098221825 0 0) 0x7fbd800bbb60 con 0x7fbd8014b700 2023-12-19T05:39:40.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.586+0000 7fbd7ffff640 1 --2- 172.21.15.120:0/1351628602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd80144d60 0x7fbd8006d800 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbd80072280 tx=0x7fbd7002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fc1400811a65f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.586+0000 7fbd7effd640 1 -- 172.21.15.120:0/1351628602 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70030610 con 0x7fbd80144d60 2023-12-19T05:39:40.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.586+0000 7fbd7effd640 1 -- 172.21.15.120:0/1351628602 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd70030770 con 0x7fbd80144d60 2023-12-19T05:39:40.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.586+0000 7fbd7effd640 1 -- 172.21.15.120:0/1351628602 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70030b00 con 0x7fbd80144d60 2023-12-19T05:39:40.589 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.587+0000 7fbd8644b640 1 -- 172.21.15.120:0/1351628602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd80144d60 msgr2=0x7fbd8006d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.589 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.587+0000 7fbd8644b640 1 --2- 172.21.15.120:0/1351628602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd80144d60 0x7fbd8006d800 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbd80072280 tx=0x7fbd7002b960 comp rx=0 tx=0).stop 2023-12-19T05:39:40.589 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.587+0000 7fbd8644b640 1 -- 172.21.15.120:0/1351628602 shutdown_connections 2023-12-19T05:39:40.589 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.587+0000 7fbd8644b640 1 --2- 172.21.15.120:0/1351628602 >> v2:172.21.15.155:3300/0 conn(0x7fbd8006ae10 0x7fbd8014b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.589 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.587+0000 7fbd8644b640 1 --2- 172.21.15.120:0/1351628602 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd80144d60 0x7fbd8006d800 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.590 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.587+0000 7fbd8644b640 1 -- 172.21.15.120:0/1351628602 >> 172.21.15.120:0/1351628602 conn(0x7fbd800bac10 msgr2=0x7fbd800bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:40.590 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.587+0000 7fbd8644b640 1 -- 172.21.15.120:0/1351628602 shutdown_connections 2023-12-19T05:39:40.590 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.587+0000 7fbd8644b640 1 -- 172.21.15.120:0/1351628602 wait complete. 2023-12-19T05:39:40.590 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.588+0000 7fbd8644b640 1 Processor -- start 2023-12-19T05:39:40.590 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.588+0000 7fbd8644b640 1 -- start start 2023-12-19T05:39:40.592 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.588+0000 7fbd8644b640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd8006ae10 0x7fbd8013e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.592 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.588+0000 7fbd8644b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd80144d60 0x7fbd801e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.592 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.588+0000 7fbd8644b640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd8014b700 0x7fbd801466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.592 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.588+0000 7fbd8644b640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8013eef0 con 0x7fbd8014b700 2023-12-19T05:39:40.592 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.588+0000 7fbd8644b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd801e3a20 con 0x7fbd80144d60 2023-12-19T05:39:40.592 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.588+0000 7fbd8644b640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd801e3f30 con 0x7fbd8006ae10 2023-12-19T05:39:40.592 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.588+0000 7fbd849e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd8014b700 0x7fbd801466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.592 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.588+0000 7fbd849e8640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd8014b700 0x7fbd801466b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46676/0 (socket says 172.21.15.120:46676) 2023-12-19T05:39:40.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.588+0000 7fbd849e8640 1 -- 172.21.15.120:0/1698706141 learned_addr learned my addr 172.21.15.120:0/1698706141 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:40.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.589+0000 7fbd849e8640 1 -- 172.21.15.120:0/1698706141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd8006ae10 msgr2=0x7fbd8013e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.589+0000 7fbd849e8640 1 --2- 172.21.15.120:0/1698706141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd8006ae10 0x7fbd8013e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.589+0000 7fbd849e8640 1 -- 172.21.15.120:0/1698706141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd80144d60 msgr2=0x7fbd801e34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.589+0000 7fbd849e8640 1 --2- 172.21.15.120:0/1698706141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd80144d60 0x7fbd801e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.589+0000 7fbd849e8640 1 -- 172.21.15.120:0/1698706141 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd70009400 con 0x7fbd8014b700 2023-12-19T05:39:40.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.589+0000 7fbd849e8640 1 --2- 172.21.15.120:0/1698706141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd8014b700 0x7fbd801466b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800c7b0 tx=0x7fbd7800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.589+0000 7fbd7cff9640 1 -- 172.21.15.120:0/1698706141 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7800a640 con 0x7fbd8014b700 2023-12-19T05:39:40.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.589+0000 7fbd7cff9640 1 -- 172.21.15.120:0/1698706141 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd7800a7c0 con 0x7fbd8014b700 2023-12-19T05:39:40.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.589+0000 7fbd8644b640 1 -- 172.21.15.120:0/1698706141 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd80146220 con 0x7fbd8014b700 2023-12-19T05:39:40.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.589+0000 7fbd7cff9640 1 -- 172.21.15.120:0/1698706141 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7800ab70 con 0x7fbd8014b700 2023-12-19T05:39:40.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.589+0000 7fbd8644b640 1 -- 172.21.15.120:0/1698706141 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd80145eb0 con 0x7fbd8014b700 2023-12-19T05:39:40.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.590+0000 7fbd8644b640 1 -- 172.21.15.120:0/1698706141 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8004e080 con 0x7fbd8014b700 2023-12-19T05:39:40.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.590+0000 7fbd7cff9640 1 -- 172.21.15.120:0/1698706141 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbd7800acd0 con 0x7fbd8014b700 2023-12-19T05:39:40.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.591+0000 7fbd7cff9640 1 --2- 172.21.15.120:0/1698706141 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbd6c06a430 0x7fbd6c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.591+0000 7fbd7ffff640 1 --2- 172.21.15.120:0/1698706141 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbd6c06a430 0x7fbd6c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.591+0000 7fbd7cff9640 1 -- 172.21.15.120:0/1698706141 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd78087ca0 con 0x7fbd8014b700 2023-12-19T05:39:40.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.591+0000 7fbd7ffff640 1 --2- 172.21.15.120:0/1698706141 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbd6c06a430 0x7fbd6c06c8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbd70036000 tx=0x7fbd7003b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.595+0000 7fbd7cff9640 1 -- 172.21.15.120:0/1698706141 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbd78053320 con 0x7fbd8014b700 2023-12-19T05:39:40.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.760+0000 7fbd8644b640 1 -- 172.21.15.120:0/1698706141 --> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd8006b6a0 con 0x7fbd6c06a430 2023-12-19T05:39:40.767 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.766+0000 7fbd7cff9640 1 -- 172.21.15.120:0/1698706141 <== mgr.4101 v2:172.21.15.120:6832/89586 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253683 (secure 0 0 0) 0x7fbd70030960 con 0x7fbd6c06a430 2023-12-19T05:39:40.771 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:40.772 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2023-12-19T05:39:40.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.770+0000 7fbd8644b640 1 -- 172.21.15.120:0/1698706141 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbd6c06a430 msgr2=0x7fbd6c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.770+0000 7fbd8644b640 1 --2- 172.21.15.120:0/1698706141 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbd6c06a430 0x7fbd6c06c8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbd70036000 tx=0x7fbd7003b040 comp rx=0 tx=0).stop 2023-12-19T05:39:40.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.770+0000 7fbd8644b640 1 -- 172.21.15.120:0/1698706141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd8014b700 msgr2=0x7fbd801466b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.770+0000 7fbd8644b640 1 --2- 172.21.15.120:0/1698706141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd8014b700 0x7fbd801466b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800c7b0 tx=0x7fbd7800cc70 comp rx=0 tx=0).stop 2023-12-19T05:39:40.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.770+0000 7fbd8644b640 1 -- 172.21.15.120:0/1698706141 shutdown_connections 2023-12-19T05:39:40.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.770+0000 7fbd8644b640 1 --2- 172.21.15.120:0/1698706141 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbd6c06a430 0x7fbd6c06c8f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.770+0000 7fbd8644b640 1 --2- 172.21.15.120:0/1698706141 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbd8014b700 0x7fbd801466b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.770+0000 7fbd8644b640 1 --2- 172.21.15.120:0/1698706141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbd80144d60 0x7fbd801e34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.770+0000 7fbd8644b640 1 --2- 172.21.15.120:0/1698706141 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbd8006ae10 0x7fbd8013e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.770+0000 7fbd8644b640 1 -- 172.21.15.120:0/1698706141 >> 172.21.15.120:0/1698706141 conn(0x7fbd800bac10 msgr2=0x7fbd8013f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:40.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.770+0000 7fbd8644b640 1 -- 172.21.15.120:0/1698706141 shutdown_connections 2023-12-19T05:39:40.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.770+0000 7fbd8644b640 1 -- 172.21.15.120:0/1698706141 wait complete. 2023-12-19T05:39:40.783 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-12-19T05:39:39.943728+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":3488,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":3571712,"data_stored":2051522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.135663"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811456+0000","last_change":"2023-12-19T05:39:35.811456+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811456+0000","last_undegraded":"2023-12-19T05:39:35.811456+0000","last_fullsized":"2023-12-19T05:39:35.811456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:51.733584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812793+0000","last_change":"2023-12-19T05:39:35.812793+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812793+0000","last_undegraded":"2023-12-19T05:39:35.812793+0000","last_fullsized":"2023-12-19T05:39:35.812793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:47:31.445497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814707+0000","last_change":"2023-12-19T05:39:35.814707+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814707+0000","last_undegraded":"2023-12-19T05:39:35.814707+0000","last_fullsized":"2023-12-19T05:39:35.814707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812902+0000","last_change":"2023-12-19T05:39:35.812902+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812902+0000","last_undegraded":"2023-12-19T05:39:35.812902+0000","last_fullsized":"2023-12-19T05:39:35.812902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:43:16.527733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811767+0000","last_change":"2023-12-19T05:39:35.811767+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811767+0000","last_undegraded":"2023-12-19T05:39:35.811767+0000","last_fullsized":"2023-12-19T05:39:35.811767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:29.938867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811183+0000","last_change":"2023-12-19T05:39:35.811183+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811183+0000","last_undegraded":"2023-12-19T05:39:35.811183+0000","last_fullsized":"2023-12-19T05:39:35.811183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:12:49.113154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.815480+0000","last_change":"2023-12-19T05:39:35.815480+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.815480+0000","last_undegraded":"2023-12-19T05:39:35.815480+0000","last_fullsized":"2023-12-19T05:39:35.815480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:18:28.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810651+0000","last_change":"2023-12-19T05:39:35.810651+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810651+0000","last_undegraded":"2023-12-19T05:39:35.810651+0000","last_fullsized":"2023-12-19T05:39:35.810651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:00:04.318274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.815002+0000","last_change":"2023-12-19T05:39:35.815002+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.815002+0000","last_undegraded":"2023-12-19T05:39:35.815002+0000","last_fullsized":"2023-12-19T05:39:35.815002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:49:33.898019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812154+0000","last_change":"2023-12-19T05:39:35.812154+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812154+0000","last_undegraded":"2023-12-19T05:39:35.812154+0000","last_fullsized":"2023-12-19T05:39:35.812154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813520+0000","last_change":"2023-12-19T05:39:35.813520+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813520+0000","last_undegraded":"2023-12-19T05:39:35.813520+0000","last_fullsized":"2023-12-19T05:39:35.813520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814473+0000","last_change":"2023-12-19T05:39:35.814473+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814473+0000","last_undegraded":"2023-12-19T05:39:35.814473+0000","last_fullsized":"2023-12-19T05:39:35.814473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810695+0000","last_change":"2023-12-19T05:39:35.810695+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810695+0000","last_undegraded":"2023-12-19T05:39:35.810695+0000","last_fullsized":"2023-12-19T05:39:35.810695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:25:12.013208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814357+0000","last_change":"2023-12-19T05:39:35.814357+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814357+0000","last_undegraded":"2023-12-19T05:39:35.814357+0000","last_fullsized":"2023-12-19T05:39:35.814357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:04:00.332266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814872+0000","last_change":"2023-12-19T05:39:35.814872+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814872+0000","last_undegraded":"2023-12-19T05:39:35.814872+0000","last_fullsized":"2023-12-19T05:39:35.814872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:47:31.445497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814886+0000","last_change":"2023-12-19T05:39:35.814886+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814886+0000","last_undegraded":"2023-12-19T05:39:35.814886+0000","last_fullsized":"2023-12-19T05:39:35.814886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:00.514986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814154+0000","last_change":"2023-12-19T05:39:35.814154+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814154+0000","last_undegraded":"2023-12-19T05:39:35.814154+0000","last_fullsized":"2023-12-19T05:39:35.814154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:22:01.593157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811928+0000","last_change":"2023-12-19T05:39:35.811928+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811928+0000","last_undegraded":"2023-12-19T05:39:35.811928+0000","last_fullsized":"2023-12-19T05:39:35.811928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:24:10.386915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810676+0000","last_change":"2023-12-19T05:39:35.810676+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810676+0000","last_undegraded":"2023-12-19T05:39:35.810676+0000","last_fullsized":"2023-12-19T05:39:35.810676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:09:30.685286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810693+0000","last_change":"2023-12-19T05:39:35.810693+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810693+0000","last_undegraded":"2023-12-19T05:39:35.810693+0000","last_fullsized":"2023-12-19T05:39:35.810693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:51.733584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811667+0000","last_change":"2023-12-19T05:39:35.811667+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811667+0000","last_undegraded":"2023-12-19T05:39:35.811667+0000","last_fullsized":"2023-12-19T05:39:35.811667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811520+0000","last_change":"2023-12-19T05:39:35.811520+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811520+0000","last_undegraded":"2023-12-19T05:39:35.811520+0000","last_fullsized":"2023-12-19T05:39:35.811520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:06.383246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812117+0000","last_change":"2023-12-19T05:39:35.812117+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812117+0000","last_undegraded":"2023-12-19T05:39:35.812117+0000","last_fullsized":"2023-12-19T05:39:35.812117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:17:54.314037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813442+0000","last_change":"2023-12-19T05:39:35.813442+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813442+0000","last_undegraded":"2023-12-19T05:39:35.813442+0000","last_fullsized":"2023-12-19T05:39:35.813442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813550+0000","last_change":"2023-12-19T05:39:35.813550+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813550+0000","last_undegraded":"2023-12-19T05:39:35.813550+0000","last_fullsized":"2023-12-19T05:39:35.813550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:08:56.288042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811075+0000","last_change":"2023-12-19T05:39:35.811075+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811075+0000","last_undegraded":"2023-12-19T05:39:35.811075+0000","last_fullsized":"2023-12-19T05:39:35.811075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:18:28.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813958+0000","last_change":"2023-12-19T05:39:35.813958+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813958+0000","last_undegraded":"2023-12-19T05:39:35.813958+0000","last_fullsized":"2023-12-19T05:39:35.813958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:06.383246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811075+0000","last_change":"2023-12-19T05:39:35.811075+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811075+0000","last_undegraded":"2023-12-19T05:39:35.811075+0000","last_fullsized":"2023-12-19T05:39:35.811075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:18:47.836073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813559+0000","last_change":"2023-12-19T05:39:35.813559+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813559+0000","last_undegraded":"2023-12-19T05:39:35.813559+0000","last_fullsized":"2023-12-19T05:39:35.813559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:13:18.741953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811575+0000","last_change":"2023-12-19T05:39:35.811575+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811575+0000","last_undegraded":"2023-12-19T05:39:35.811575+0000","last_fullsized":"2023-12-19T05:39:35.811575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:15:22.976217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814442+0000","last_change":"2023-12-19T05:39:35.814442+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814442+0000","last_undegraded":"2023-12-19T05:39:35.814442+0000","last_fullsized":"2023-12-19T05:39:35.814442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:44:21.196968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811392+0000","last_change":"2023-12-19T05:39:35.811392+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811392+0000","last_undegraded":"2023-12-19T05:39:35.811392+0000","last_fullsized":"2023-12-19T05:39:35.811392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:29.938867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-19T05:39:32.119904+0000","last_change":"2023-12-19T05:38:47.150620+0000","last_active":"2023-12-19T05:39:32.119904+0000","last_peered":"2023-12-19T05:39:32.119904+0000","last_clean":"2023-12-19T05:39:32.119904+0000","last_became_active":"2023-12-19T05:38:47.149844+0000","last_became_peered":"2023-12-19T05:38:47.149844+0000","last_unstale":"2023-12-19T05:39:32.119904+0000","last_undegraded":"2023-12-19T05:39:32.119904+0000","last_fullsized":"2023-12-19T05:39:32.119904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_clean_scrub_stamp":"2023-12-19T05:38:46.034642+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:51.920917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":108084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":888832,"data_stored":698452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T05:39:40.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-12-19T05:39:40.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-12-19T05:39:40.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-12-19T05:39:40.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-12-19T05:39:40.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-12-19T05:39:40.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-12-19T05:39:40.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-12-19T05:39:40.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-12-19T05:39:40.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-12-19T05:39:40.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-12-19T05:39:40.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-12-19T05:39:40.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-12-19T05:39:40.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-12-19T05:39:40.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-12-19T05:39:40.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-12-19T05:39:40.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-12-19T05:39:40.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-12-19T05:39:40.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-12-19T05:39:40.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-12-19T05:39:40.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-12-19T05:39:40.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-12-19T05:39:40.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-12-19T05:39:40.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-12-19T05:39:40.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-12-19T05:39:40.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-12-19T05:39:40.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-12-19T05:39:40.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-12-19T05:39:40.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-12-19T05:39:40.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-12-19T05:39:40.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-12-19T05:39:40.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-12-19T05:39:40.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-12-19T05:39:40.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-12-19T05:39:40.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-12-19T05:39:40.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.811456+0000', 'last_change': '2023-12-19T05:39:35.811456+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.811456+0000', 'last_undegraded': '2023-12-19T05:39:35.811456+0000', 'last_fullsized': '2023-12-19T05:39:35.811456+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T11:08:51.733584+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T05:39:40.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-12-19T05:39:40.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-12-19T05:39:40.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.812793+0000', 'last_change': '2023-12-19T05:39:35.812793+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.812793+0000', 'last_undegraded': '2023-12-19T05:39:35.812793+0000', 'last_fullsized': '2023-12-19T05:39:35.812793+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T10:47:31.445497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T05:39:40.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-12-19T05:39:40.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-12-19T05:39:40.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.814707+0000', 'last_change': '2023-12-19T05:39:35.814707+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.814707+0000', 'last_undegraded': '2023-12-19T05:39:35.814707+0000', 'last_fullsized': '2023-12-19T05:39:35.814707+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T05:39:40.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-12-19T05:39:40.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-12-19T05:39:40.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.812902+0000', 'last_change': '2023-12-19T05:39:35.812902+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.812902+0000', 'last_undegraded': '2023-12-19T05:39:35.812902+0000', 'last_fullsized': '2023-12-19T05:39:35.812902+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T13:43:16.527733+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T05:39:40.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-12-19T05:39:40.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-12-19T05:39:40.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.811767+0000', 'last_change': '2023-12-19T05:39:35.811767+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.811767+0000', 'last_undegraded': '2023-12-19T05:39:35.811767+0000', 'last_fullsized': '2023-12-19T05:39:35.811767+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T08:59:29.938867+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T05:39:40.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-12-19T05:39:40.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-12-19T05:39:40.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.811183+0000', 'last_change': '2023-12-19T05:39:35.811183+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.811183+0000', 'last_undegraded': '2023-12-19T05:39:35.811183+0000', 'last_fullsized': '2023-12-19T05:39:35.811183+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T12:12:49.113154+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T05:39:40.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-12-19T05:39:40.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-12-19T05:39:40.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.815480+0000', 'last_change': '2023-12-19T05:39:35.815480+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.815480+0000', 'last_undegraded': '2023-12-19T05:39:35.815480+0000', 'last_fullsized': '2023-12-19T05:39:35.815480+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T06:18:28.935562+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T05:39:40.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-12-19T05:39:40.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-12-19T05:39:40.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.810651+0000', 'last_change': '2023-12-19T05:39:35.810651+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.810651+0000', 'last_undegraded': '2023-12-19T05:39:35.810651+0000', 'last_fullsized': '2023-12-19T05:39:35.810651+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T08:00:04.318274+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T05:39:40.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-12-19T05:39:40.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-12-19T05:39:40.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.815002+0000', 'last_change': '2023-12-19T05:39:35.815002+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.815002+0000', 'last_undegraded': '2023-12-19T05:39:35.815002+0000', 'last_fullsized': '2023-12-19T05:39:35.815002+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T05:49:33.898019+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T05:39:40.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-12-19T05:39:40.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-12-19T05:39:40.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.812154+0000', 'last_change': '2023-12-19T05:39:35.812154+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.812154+0000', 'last_undegraded': '2023-12-19T05:39:35.812154+0000', 'last_fullsized': '2023-12-19T05:39:35.812154+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T05:39:40.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-12-19T05:39:40.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-12-19T05:39:40.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.813520+0000', 'last_change': '2023-12-19T05:39:35.813520+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.813520+0000', 'last_undegraded': '2023-12-19T05:39:35.813520+0000', 'last_fullsized': '2023-12-19T05:39:35.813520+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T05:39:40.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-12-19T05:39:40.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-12-19T05:39:40.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.814473+0000', 'last_change': '2023-12-19T05:39:35.814473+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.814473+0000', 'last_undegraded': '2023-12-19T05:39:35.814473+0000', 'last_fullsized': '2023-12-19T05:39:35.814473+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T05:39:40.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-12-19T05:39:40.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-12-19T05:39:40.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.810695+0000', 'last_change': '2023-12-19T05:39:35.810695+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.810695+0000', 'last_undegraded': '2023-12-19T05:39:35.810695+0000', 'last_fullsized': '2023-12-19T05:39:35.810695+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T12:25:12.013208+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T05:39:40.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-12-19T05:39:40.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-12-19T05:39:40.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.814357+0000', 'last_change': '2023-12-19T05:39:35.814357+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.814357+0000', 'last_undegraded': '2023-12-19T05:39:35.814357+0000', 'last_fullsized': '2023-12-19T05:39:35.814357+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T06:04:00.332266+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T05:39:40.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-12-19T05:39:40.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-12-19T05:39:40.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.814872+0000', 'last_change': '2023-12-19T05:39:35.814872+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.814872+0000', 'last_undegraded': '2023-12-19T05:39:35.814872+0000', 'last_fullsized': '2023-12-19T05:39:35.814872+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T10:47:31.445497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T05:39:40.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-12-19T05:39:40.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-12-19T05:39:40.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.814886+0000', 'last_change': '2023-12-19T05:39:35.814886+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.814886+0000', 'last_undegraded': '2023-12-19T05:39:35.814886+0000', 'last_fullsized': '2023-12-19T05:39:35.814886+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T13:09:00.514986+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T05:39:40.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-12-19T05:39:40.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-12-19T05:39:40.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.814154+0000', 'last_change': '2023-12-19T05:39:35.814154+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.814154+0000', 'last_undegraded': '2023-12-19T05:39:35.814154+0000', 'last_fullsized': '2023-12-19T05:39:35.814154+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T07:22:01.593157+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T05:39:40.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-12-19T05:39:40.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-12-19T05:39:40.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.811928+0000', 'last_change': '2023-12-19T05:39:35.811928+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.811928+0000', 'last_undegraded': '2023-12-19T05:39:35.811928+0000', 'last_fullsized': '2023-12-19T05:39:35.811928+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T08:24:10.386915+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T05:39:40.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-12-19T05:39:40.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-12-19T05:39:40.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.810676+0000', 'last_change': '2023-12-19T05:39:35.810676+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.810676+0000', 'last_undegraded': '2023-12-19T05:39:35.810676+0000', 'last_fullsized': '2023-12-19T05:39:35.810676+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T10:09:30.685286+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T05:39:40.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-12-19T05:39:40.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-12-19T05:39:40.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.810693+0000', 'last_change': '2023-12-19T05:39:35.810693+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.810693+0000', 'last_undegraded': '2023-12-19T05:39:35.810693+0000', 'last_fullsized': '2023-12-19T05:39:35.810693+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T11:08:51.733584+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T05:39:40.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-12-19T05:39:40.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-12-19T05:39:40.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.811667+0000', 'last_change': '2023-12-19T05:39:35.811667+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.811667+0000', 'last_undegraded': '2023-12-19T05:39:35.811667+0000', 'last_fullsized': '2023-12-19T05:39:35.811667+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T05:39:40.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-12-19T05:39:40.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-12-19T05:39:40.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.811520+0000', 'last_change': '2023-12-19T05:39:35.811520+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.811520+0000', 'last_undegraded': '2023-12-19T05:39:35.811520+0000', 'last_fullsized': '2023-12-19T05:39:35.811520+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T12:02:06.383246+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T05:39:40.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-12-19T05:39:40.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-12-19T05:39:40.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.812117+0000', 'last_change': '2023-12-19T05:39:35.812117+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.812117+0000', 'last_undegraded': '2023-12-19T05:39:35.812117+0000', 'last_fullsized': '2023-12-19T05:39:35.812117+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T10:17:54.314037+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T05:39:40.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-12-19T05:39:40.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-12-19T05:39:40.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.813442+0000', 'last_change': '2023-12-19T05:39:35.813442+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.813442+0000', 'last_undegraded': '2023-12-19T05:39:35.813442+0000', 'last_fullsized': '2023-12-19T05:39:35.813442+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T05:39:40.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-12-19T05:39:40.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-12-19T05:39:40.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.813550+0000', 'last_change': '2023-12-19T05:39:35.813550+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.813550+0000', 'last_undegraded': '2023-12-19T05:39:35.813550+0000', 'last_fullsized': '2023-12-19T05:39:35.813550+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T07:08:56.288042+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T05:39:40.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-12-19T05:39:40.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-12-19T05:39:40.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.811075+0000', 'last_change': '2023-12-19T05:39:35.811075+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.811075+0000', 'last_undegraded': '2023-12-19T05:39:35.811075+0000', 'last_fullsized': '2023-12-19T05:39:35.811075+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T06:18:28.935562+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T05:39:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-12-19T05:39:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-12-19T05:39:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.813958+0000', 'last_change': '2023-12-19T05:39:35.813958+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.813958+0000', 'last_undegraded': '2023-12-19T05:39:35.813958+0000', 'last_fullsized': '2023-12-19T05:39:35.813958+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T12:02:06.383246+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T05:39:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-12-19T05:39:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-12-19T05:39:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.811075+0000', 'last_change': '2023-12-19T05:39:35.811075+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.811075+0000', 'last_undegraded': '2023-12-19T05:39:35.811075+0000', 'last_fullsized': '2023-12-19T05:39:35.811075+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T12:18:47.836073+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T05:39:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-12-19T05:39:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-12-19T05:39:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.813559+0000', 'last_change': '2023-12-19T05:39:35.813559+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.813559+0000', 'last_undegraded': '2023-12-19T05:39:35.813559+0000', 'last_fullsized': '2023-12-19T05:39:35.813559+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T11:13:18.741953+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T05:39:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-12-19T05:39:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-12-19T05:39:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.811575+0000', 'last_change': '2023-12-19T05:39:35.811575+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.811575+0000', 'last_undegraded': '2023-12-19T05:39:35.811575+0000', 'last_fullsized': '2023-12-19T05:39:35.811575+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T08:15:22.976217+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T05:39:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-12-19T05:39:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-12-19T05:39:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.814442+0000', 'last_change': '2023-12-19T05:39:35.814442+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.814442+0000', 'last_undegraded': '2023-12-19T05:39:35.814442+0000', 'last_fullsized': '2023-12-19T05:39:35.814442+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T06:44:21.196968+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T05:39:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-12-19T05:39:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T05:39:36.808267+0000', 'last_change': '2023-12-19T05:39:36.808267+0000', 'last_active': '2023-12-19T05:39:36.808267+0000', 'last_peered': '2023-12-19T05:39:36.808267+0000', 'last_clean': '2023-12-19T05:39:36.808267+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:36.808267+0000', 'last_undegraded': '2023-12-19T05:39:36.808267+0000', 'last_fullsized': '2023-12-19T05:39:36.808267+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:36.808267+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T05:39:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-12-19T05:39:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T05:39:35.811392+0000', 'last_change': '2023-12-19T05:39:35.811392+0000', 'last_active': '2023-12-19T05:39:35.805910+0000', 'last_peered': '2023-12-19T05:39:35.805910+0000', 'last_clean': '2023-12-19T05:39:35.805910+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T05:39:35.811392+0000', 'last_undegraded': '2023-12-19T05:39:35.811392+0000', 'last_fullsized': '2023-12-19T05:39:35.811392+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'last_clean_scrub_stamp': '2023-12-19T05:39:35.805910+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-20T08:59:29.938867+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T05:39:40.813 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T05:39:40.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.921+0000 7fd6e41b9640 1 Processor -- start 2023-12-19T05:39:40.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.921+0000 7fd6e41b9640 1 -- start start 2023-12-19T05:39:40.923 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.921+0000 7fd6e41b9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd6dc06da70 0x7fd6dc1429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.923 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.921+0000 7fd6e41b9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc142ee0 0x7fd6dc0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.923 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.921+0000 7fd6e41b9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6dc06e690 con 0x7fd6dc0b4e30 2023-12-19T05:39:40.923 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.921+0000 7fd6e41b9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc06ebc0 con 0x7fd6dc06da70 2023-12-19T05:39:40.923 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.921+0000 7fd6e41b9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0b3db0 con 0x7fd6dc142ee0 2023-12-19T05:39:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.922+0000 7fd6e1754640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc142ee0 0x7fd6dc0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.922+0000 7fd6e1f55640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd6dc06da70 0x7fd6dc1429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.922+0000 7fd6e1754640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc142ee0 0x7fd6dc0b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:38084/0 (socket says 172.21.15.120:38084) 2023-12-19T05:39:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.922+0000 7fd6e1754640 1 -- 172.21.15.120:0/2801604953 learned_addr learned my addr 172.21.15.120:0/2801604953 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.922+0000 7fd6e2756640 1 --1- 172.21.15.120:0/2801604953 >> v1:172.21.15.155:6789/0 conn(0x7fd6dc0b4e30 0x7fd6dc14bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:52896/0 (socket says 172.21.15.120:52896) 2023-12-19T05:39:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.922+0000 7fd6e1754640 1 -- 172.21.15.120:0/2801604953 >> v2:172.21.15.155:3300/0 conn(0x7fd6dc06da70 msgr2=0x7fd6dc1429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.922+0000 7fd6e1754640 1 --2- 172.21.15.120:0/2801604953 >> v2:172.21.15.155:3300/0 conn(0x7fd6dc06da70 0x7fd6dc1429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.922+0000 7fd6e1754640 1 -- 172.21.15.120:0/2801604953 >> v1:172.21.15.155:6789/0 conn(0x7fd6dc0b4e30 legacy=0x7fd6dc14bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.922+0000 7fd6e1754640 1 -- 172.21.15.120:0/2801604953 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0b9f60 con 0x7fd6dc142ee0 2023-12-19T05:39:40.924 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.922+0000 7fd6e1f55640 1 --2- 172.21.15.120:0/2801604953 >> v2:172.21.15.155:3300/0 conn(0x7fd6dc06da70 0x7fd6dc1429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:40.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.923+0000 7fd6e1754640 1 --2- 172.21.15.120:0/2801604953 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc142ee0 0x7fd6dc0b3090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009870 tx=0x7fd6cc02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ba51fa99cef9390 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.923+0000 7fd6e0f53640 1 -- 172.21.15.120:0/2801604953 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc031640 con 0x7fd6dc142ee0 2023-12-19T05:39:40.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.923+0000 7fd6e0f53640 1 -- 172.21.15.120:0/2801604953 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc0317a0 con 0x7fd6dc142ee0 2023-12-19T05:39:40.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.923+0000 7fd6e0f53640 1 -- 172.21.15.120:0/2801604953 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc031b30 con 0x7fd6dc142ee0 2023-12-19T05:39:40.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.924+0000 7fd6e41b9640 1 -- 172.21.15.120:0/2801604953 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc142ee0 msgr2=0x7fd6dc0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.924+0000 7fd6e41b9640 1 --2- 172.21.15.120:0/2801604953 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc142ee0 0x7fd6dc0b3090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009870 tx=0x7fd6cc02b8f0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.924+0000 7fd6e41b9640 1 -- 172.21.15.120:0/2801604953 shutdown_connections 2023-12-19T05:39:40.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.924+0000 7fd6e41b9640 1 --2- 172.21.15.120:0/2801604953 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc142ee0 0x7fd6dc0b3090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.924+0000 7fd6e41b9640 1 --2- 172.21.15.120:0/2801604953 >> v2:172.21.15.155:3300/0 conn(0x7fd6dc06da70 0x7fd6dc1429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.924+0000 7fd6e41b9640 1 -- 172.21.15.120:0/2801604953 >> 172.21.15.120:0/2801604953 conn(0x7fd6dc0bac10 msgr2=0x7fd6dc0bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:40.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.924+0000 7fd6e41b9640 1 -- 172.21.15.120:0/2801604953 shutdown_connections 2023-12-19T05:39:40.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.924+0000 7fd6e41b9640 1 -- 172.21.15.120:0/2801604953 wait complete. 2023-12-19T05:39:40.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.925+0000 7fd6e41b9640 1 Processor -- start 2023-12-19T05:39:40.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.925+0000 7fd6e41b9640 1 -- start start 2023-12-19T05:39:40.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.925+0000 7fd6e41b9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06da70 0x7fd6dc06ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.925+0000 7fd6e41b9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0b4e30 0x7fd6dc06ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.925+0000 7fd6e41b9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6dc142ee0 0x7fd6dc141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.929 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.925+0000 7fd6e41b9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc1e3da0 con 0x7fd6dc142ee0 2023-12-19T05:39:40.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.925+0000 7fd6e41b9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc146ce0 con 0x7fd6dc0b4e30 2023-12-19T05:39:40.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.925+0000 7fd6e41b9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0a4440 con 0x7fd6dc06da70 2023-12-19T05:39:40.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.925+0000 7fd6e2756640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6dc142ee0 0x7fd6dc141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.925+0000 7fd6e2756640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6dc142ee0 0x7fd6dc141810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46680/0 (socket says 172.21.15.120:46680) 2023-12-19T05:39:40.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.925+0000 7fd6e2756640 1 -- 172.21.15.120:0/4097291334 learned_addr learned my addr 172.21.15.120:0/4097291334 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:40.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.925+0000 7fd6e1f55640 1 --2- 172.21.15.120:0/4097291334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06da70 0x7fd6dc06ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.926+0000 7fd6e1754640 1 --2- 172.21.15.120:0/4097291334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0b4e30 0x7fd6dc06ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.926+0000 7fd6e2756640 1 -- 172.21.15.120:0/4097291334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06da70 msgr2=0x7fd6dc06ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.926+0000 7fd6e2756640 1 --2- 172.21.15.120:0/4097291334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06da70 0x7fd6dc06ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.931 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.926+0000 7fd6e2756640 1 -- 172.21.15.120:0/4097291334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0b4e30 msgr2=0x7fd6dc06ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:40.931 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.926+0000 7fd6e2756640 1 --2- 172.21.15.120:0/4097291334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0b4e30 0x7fd6dc06ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:40.931 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.926+0000 7fd6e2756640 1 -- 172.21.15.120:0/4097291334 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d8009400 con 0x7fd6dc142ee0 2023-12-19T05:39:40.931 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.926+0000 7fd6e2756640 1 --2- 172.21.15.120:0/4097291334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6dc142ee0 0x7fd6dc141810 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c7b0 tx=0x7fd6d400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.931 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.926+0000 7fd6d27fc640 1 -- 172.21.15.120:0/4097291334 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400a640 con 0x7fd6dc142ee0 2023-12-19T05:39:40.931 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.926+0000 7fd6d27fc640 1 -- 172.21.15.120:0/4097291334 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d400a7a0 con 0x7fd6dc142ee0 2023-12-19T05:39:40.931 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.926+0000 7fd6e41b9640 1 -- 172.21.15.120:0/4097291334 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc0094d0 con 0x7fd6dc142ee0 2023-12-19T05:39:40.931 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.926+0000 7fd6d27fc640 1 -- 172.21.15.120:0/4097291334 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400ab10 con 0x7fd6dc142ee0 2023-12-19T05:39:40.931 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.926+0000 7fd6e41b9640 1 -- 172.21.15.120:0/4097291334 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc06b350 con 0x7fd6dc142ee0 2023-12-19T05:39:40.931 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.927+0000 7fd6e41b9640 1 -- 172.21.15.120:0/4097291334 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6dc066630 con 0x7fd6dc142ee0 2023-12-19T05:39:40.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.927+0000 7fd6d27fc640 1 -- 172.21.15.120:0/4097291334 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd6d400ac70 con 0x7fd6dc142ee0 2023-12-19T05:39:40.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.928+0000 7fd6d27fc640 1 --2- 172.21.15.120:0/4097291334 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd6c006a430 0x7fd6c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:40.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.928+0000 7fd6d27fc640 1 -- 172.21.15.120:0/4097291334 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6d4087f30 con 0x7fd6dc142ee0 2023-12-19T05:39:40.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.928+0000 7fd6e1f55640 1 --2- 172.21.15.120:0/4097291334 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd6c006a430 0x7fd6c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:40.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.928+0000 7fd6e1f55640 1 --2- 172.21.15.120:0/4097291334 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd6c006a430 0x7fd6c006c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009cd0 tx=0x7fd6d8009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:40.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:40.932+0000 7fd6d27fc640 1 -- 172.21.15.120:0/4097291334 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd6d4053660 con 0x7fd6dc142ee0 2023-12-19T05:39:41.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.164+0000 7fd6e41b9640 1 -- 172.21.15.120:0/4097291334 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd6dc1e3ee0 con 0x7fd6dc142ee0 2023-12-19T05:39:41.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.164+0000 7fd6d27fc640 1 -- 172.21.15.120:0/4097291334 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2591 (secure 0 0 0) 0x7fd6d4017a30 con 0x7fd6dc142ee0 2023-12-19T05:39:41.166 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:41.166 INFO:teuthology.orchestra.run.smithi120.stdout:{"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":67,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1702964325,"num_in_osds":8,"osd_in_since":1702964316,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224362496,"bytes_avail":772869750784,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4998}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-12-19T05:39:39.943764+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-19T05:39:41.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.166+0000 7fd6e41b9640 1 -- 172.21.15.120:0/4097291334 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd6c006a430 msgr2=0x7fd6c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.166+0000 7fd6e41b9640 1 --2- 172.21.15.120:0/4097291334 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd6c006a430 0x7fd6c006c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8009cd0 tx=0x7fd6d8009190 comp rx=0 tx=0).stop 2023-12-19T05:39:41.167 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.166+0000 7fd6e41b9640 1 -- 172.21.15.120:0/4097291334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6dc142ee0 msgr2=0x7fd6dc141810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.166+0000 7fd6e41b9640 1 --2- 172.21.15.120:0/4097291334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6dc142ee0 0x7fd6dc141810 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c7b0 tx=0x7fd6d400cc70 comp rx=0 tx=0).stop 2023-12-19T05:39:41.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.166+0000 7fd6e41b9640 1 -- 172.21.15.120:0/4097291334 shutdown_connections 2023-12-19T05:39:41.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.166+0000 7fd6e41b9640 1 --2- 172.21.15.120:0/4097291334 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd6c006a430 0x7fd6c006c8f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.166+0000 7fd6e41b9640 1 --2- 172.21.15.120:0/4097291334 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd6dc142ee0 0x7fd6dc141810 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.166+0000 7fd6e41b9640 1 --2- 172.21.15.120:0/4097291334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6dc0b4e30 0x7fd6dc06ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.166+0000 7fd6e41b9640 1 --2- 172.21.15.120:0/4097291334 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd6dc06da70 0x7fd6dc06ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.166+0000 7fd6e41b9640 1 -- 172.21.15.120:0/4097291334 >> 172.21.15.120:0/4097291334 conn(0x7fd6dc0bac10 msgr2=0x7fd6dc0b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:41.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.166+0000 7fd6e41b9640 1 -- 172.21.15.120:0/4097291334 shutdown_connections 2023-12-19T05:39:41.168 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.166+0000 7fd6e41b9640 1 -- 172.21.15.120:0/4097291334 wait complete. 2023-12-19T05:39:41.178 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T05:39:41.178 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:41.278 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.276+0000 7faa5e07d640 1 Processor -- start 2023-12-19T05:39:41.278 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.276+0000 7faa5e07d640 1 -- start start 2023-12-19T05:39:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.277+0000 7faa5e07d640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7faa58070c30 0x7faa581415e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.277+0000 7faa5e07d640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa580b9450 con 0x7faa5806b080 2023-12-19T05:39:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.277+0000 7faa5e07d640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa58070830 con 0x7faa581477d0 2023-12-19T05:39:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.277+0000 7faa5e07d640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5806ff80 con 0x7faa58070c30 2023-12-19T05:39:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.277+0000 7faa577fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7faa5806b080 0x7faa58071410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:40388/0 (socket says 172.21.15.120:40388) 2023-12-19T05:39:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.277+0000 7faa577fe640 1 -- 172.21.15.120:0/325815038 learned_addr learned my addr 172.21.15.120:0/325815038 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.277+0000 7faa567fc640 1 -- 172.21.15.120:0/325815038 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3384092384 0 0) 0x7faa580b9450 con 0x7faa5806b080 2023-12-19T05:39:41.281 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.277+0000 7faa56ffd640 1 --2- 172.21.15.120:0/325815038 >> v2:172.21.15.155:3300/0 conn(0x7faa58070c30 0x7faa581415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.277+0000 7faa567fc640 1 -- 172.21.15.120:0/325815038 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa40003520 con 0x7faa5806b080 2023-12-19T05:39:41.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa567fc640 1 -- 172.21.15.120:0/325815038 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3497030354 0 0) 0x7faa40003520 con 0x7faa5806b080 2023-12-19T05:39:41.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa567fc640 1 -- 172.21.15.120:0/325815038 >> v2:172.21.15.155:3300/0 conn(0x7faa58070c30 msgr2=0x7faa581415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:41.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa567fc640 1 --2- 172.21.15.120:0/325815038 >> v2:172.21.15.155:3300/0 conn(0x7faa58070c30 0x7faa581415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa567fc640 1 -- 172.21.15.120:0/325815038 >> v1:172.21.15.155:6789/0 conn(0x7faa581477d0 legacy=0x7faa58152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa567fc640 1 -- 172.21.15.120:0/325815038 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa58070260 con 0x7faa5806b080 2023-12-19T05:39:41.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa567fc640 1 -- 172.21.15.120:0/325815038 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7faa48001670 con 0x7faa5806b080 2023-12-19T05:39:41.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa567fc640 1 -- 172.21.15.120:0/325815038 >> v1:172.21.15.120:6789/0 conn(0x7faa5806b080 legacy=0x7faa58071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa567fc640 1 --2- 172.21.15.120:0/325815038 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa40003970 0x7faa40003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa567fc640 1 --2- 172.21.15.120:0/325815038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa400047c0 0x7faa40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa567fc640 1 --2- 172.21.15.120:0/325815038 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa40005180 0x7faa4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa567fc640 1 -- 172.21.15.120:0/325815038 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5806ff80 con 0x7faa40003970 2023-12-19T05:39:41.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa567fc640 1 -- 172.21.15.120:0/325815038 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4000c030 con 0x7faa400047c0 2023-12-19T05:39:41.282 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa567fc640 1 -- 172.21.15.120:0/325815038 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4000c1f0 con 0x7faa40005180 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa577fe640 1 --2- 172.21.15.120:0/325815038 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa40003970 0x7faa40003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa56ffd640 1 --2- 172.21.15.120:0/325815038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa400047c0 0x7faa40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa57fff640 1 --2- 172.21.15.120:0/325815038 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa40005180 0x7faa4000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa577fe640 1 -- 172.21.15.120:0/325815038 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa40005180 msgr2=0x7faa4000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa577fe640 1 --2- 172.21.15.120:0/325815038 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa40005180 0x7faa4000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa577fe640 1 -- 172.21.15.120:0/325815038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa400047c0 msgr2=0x7faa40004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa577fe640 1 --2- 172.21.15.120:0/325815038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa400047c0 0x7faa40004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa577fe640 1 -- 172.21.15.120:0/325815038 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa40003520 con 0x7faa40003970 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.278+0000 7faa57fff640 1 -- 172.21.15.120:0/325815038 reap_dead start 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.279+0000 7faa577fe640 1 --2- 172.21.15.120:0/325815038 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa40003970 0x7faa40003d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c240 tx=0x7faa400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c6187169c6e65c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.279+0000 7faa567fc640 1 -- 172.21.15.120:0/325815038 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48005ad0 con 0x7faa40003970 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.279+0000 7faa567fc640 1 -- 172.21.15.120:0/325815038 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa48005c30 con 0x7faa40003970 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.279+0000 7faa567fc640 1 -- 172.21.15.120:0/325815038 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4802caf0 con 0x7faa40003970 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.279+0000 7faa5e07d640 1 -- 172.21.15.120:0/325815038 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa40003970 msgr2=0x7faa40003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.283 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.279+0000 7faa5e07d640 1 --2- 172.21.15.120:0/325815038 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa40003970 0x7faa40003d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c240 tx=0x7faa400057f0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.280+0000 7faa5e07d640 1 -- 172.21.15.120:0/325815038 shutdown_connections 2023-12-19T05:39:41.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.280+0000 7faa5e07d640 1 --2- 172.21.15.120:0/325815038 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa40003970 0x7faa40003d90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.280+0000 7faa5e07d640 1 -- 172.21.15.120:0/325815038 >> 172.21.15.120:0/325815038 conn(0x7faa580bcfd0 msgr2=0x7faa580bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:41.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.280+0000 7faa5e07d640 1 -- 172.21.15.120:0/325815038 shutdown_connections 2023-12-19T05:39:41.284 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.280+0000 7faa5e07d640 1 -- 172.21.15.120:0/325815038 wait complete. 2023-12-19T05:39:41.287 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.281+0000 7faa5e07d640 1 Processor -- start 2023-12-19T05:39:41.287 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.281+0000 7faa5e07d640 1 -- start start 2023-12-19T05:39:41.287 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.281+0000 7faa5e07d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa40003970 0x7faa580b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.287 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.281+0000 7faa5e07d640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa581e1570 0x7faa581e19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.287 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.281+0000 7faa5e07d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa5813d0e0 0x7faa5813d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.287 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.281+0000 7faa5e07d640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa580b70e0 con 0x7faa5813d0e0 2023-12-19T05:39:41.287 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.281+0000 7faa5e07d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa581cdfb0 con 0x7faa40003970 2023-12-19T05:39:41.287 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.281+0000 7faa5e07d640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa58144850 con 0x7faa581e1570 2023-12-19T05:39:41.287 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.281+0000 7faa57fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa5813d0e0 0x7faa5813d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.287 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa57fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa5813d0e0 0x7faa5813d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:46696/0 (socket says 172.21.15.120:46696) 2023-12-19T05:39:41.287 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa57fff640 1 -- 172.21.15.120:0/2021013634 learned_addr learned my addr 172.21.15.120:0/2021013634 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:41.287 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa56ffd640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa581e1570 0x7faa581e19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.287 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa577fe640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa40003970 0x7faa580b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.288 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa57fff640 1 -- 172.21.15.120:0/2021013634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa581e1570 msgr2=0x7faa581e19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.288 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa57fff640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa581e1570 0x7faa581e19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.288 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa57fff640 1 -- 172.21.15.120:0/2021013634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa40003970 msgr2=0x7faa580b6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.288 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa57fff640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa40003970 0x7faa580b6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.288 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa57fff640 1 -- 172.21.15.120:0/2021013634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa58144b30 con 0x7faa5813d0e0 2023-12-19T05:39:41.288 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa577fe640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa40003970 0x7faa580b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:41.288 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa57fff640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa5813d0e0 0x7faa5813d560 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7faa58147bb0 tx=0x7faa5000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:41.288 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa3ffff640 1 -- 172.21.15.120:0/2021013634 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50003970 con 0x7faa5813d0e0 2023-12-19T05:39:41.288 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa3ffff640 1 -- 172.21.15.120:0/2021013634 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa50003af0 con 0x7faa5813d0e0 2023-12-19T05:39:41.288 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa5e07d640 1 -- 172.21.15.120:0/2021013634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa58144e10 con 0x7faa5813d0e0 2023-12-19T05:39:41.288 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa3ffff640 1 -- 172.21.15.120:0/2021013634 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50003ea0 con 0x7faa5813d0e0 2023-12-19T05:39:41.288 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.282+0000 7faa5e07d640 1 -- 172.21.15.120:0/2021013634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa58144160 con 0x7faa5813d0e0 2023-12-19T05:39:41.288 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.283+0000 7faa5e07d640 1 -- 172.21.15.120:0/2021013634 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa581e1290 con 0x7faa5813d0e0 2023-12-19T05:39:41.288 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.284+0000 7faa3ffff640 1 -- 172.21.15.120:0/2021013634 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faa500050d0 con 0x7faa5813d0e0 2023-12-19T05:39:41.289 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.284+0000 7faa3ffff640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7faa4406a430 0x7faa4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:41.289 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.284+0000 7faa3ffff640 1 -- 172.21.15.120:0/2021013634 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa50088690 con 0x7faa5813d0e0 2023-12-19T05:39:41.289 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.284+0000 7faa577fe640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7faa4406a430 0x7faa4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:41.289 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.284+0000 7faa577fe640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7faa4406a430 0x7faa4406c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faa48034000 tx=0x7faa48009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:41.289 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.288+0000 7faa3ffff640 1 -- 172.21.15.120:0/2021013634 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7faa581e1290 con 0x7faa5813d0e0 2023-12-19T05:39:41.452 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.451+0000 7faa5e07d640 1 -- 172.21.15.120:0/2021013634 --> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faa5806b460 con 0x7faa4406a430 2023-12-19T05:39:41.458 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.457+0000 7faa3ffff640 1 -- 172.21.15.120:0/2021013634 <== mgr.4101 v2:172.21.15.120:6832/89586 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253683 (secure 0 0 0) 0x7faa48005da0 con 0x7faa4406a430 2023-12-19T05:39:41.461 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:41.462 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2023-12-19T05:39:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.460+0000 7faa5e07d640 1 -- 172.21.15.120:0/2021013634 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7faa4406a430 msgr2=0x7faa4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.460+0000 7faa5e07d640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7faa4406a430 0x7faa4406c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faa48034000 tx=0x7faa48009030 comp rx=0 tx=0).stop 2023-12-19T05:39:41.463 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.460+0000 7faa5e07d640 1 -- 172.21.15.120:0/2021013634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa5813d0e0 msgr2=0x7faa5813d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.460+0000 7faa5e07d640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa5813d0e0 0x7faa5813d560 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7faa58147bb0 tx=0x7faa5000ec10 comp rx=0 tx=0).stop 2023-12-19T05:39:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.460+0000 7faa5e07d640 1 -- 172.21.15.120:0/2021013634 shutdown_connections 2023-12-19T05:39:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.460+0000 7faa5e07d640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7faa4406a430 0x7faa4406c8f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.460+0000 7faa5e07d640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7faa5813d0e0 0x7faa5813d560 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.460+0000 7faa5e07d640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7faa581e1570 0x7faa581e19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.460+0000 7faa5e07d640 1 --2- 172.21.15.120:0/2021013634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa40003970 0x7faa580b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.460+0000 7faa5e07d640 1 -- 172.21.15.120:0/2021013634 >> 172.21.15.120:0/2021013634 conn(0x7faa580bcfd0 msgr2=0x7faa581d3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.460+0000 7faa5e07d640 1 -- 172.21.15.120:0/2021013634 shutdown_connections 2023-12-19T05:39:41.464 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:41.460+0000 7faa5e07d640 1 -- 172.21.15.120:0/2021013634 wait complete. 2023-12-19T05:39:41.472 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-12-19T05:39:39.943728+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219104,"kb_used_data":3488,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755616,"statfs":{"total":773094113280,"available":772869750784,"internally_reserved":0,"allocated":3571712,"data_stored":2051522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.135663"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811456+0000","last_change":"2023-12-19T05:39:35.811456+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811456+0000","last_undegraded":"2023-12-19T05:39:35.811456+0000","last_fullsized":"2023-12-19T05:39:35.811456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:51.733584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812793+0000","last_change":"2023-12-19T05:39:35.812793+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812793+0000","last_undegraded":"2023-12-19T05:39:35.812793+0000","last_fullsized":"2023-12-19T05:39:35.812793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:47:31.445497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814707+0000","last_change":"2023-12-19T05:39:35.814707+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814707+0000","last_undegraded":"2023-12-19T05:39:35.814707+0000","last_fullsized":"2023-12-19T05:39:35.814707+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812902+0000","last_change":"2023-12-19T05:39:35.812902+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812902+0000","last_undegraded":"2023-12-19T05:39:35.812902+0000","last_fullsized":"2023-12-19T05:39:35.812902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:43:16.527733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811767+0000","last_change":"2023-12-19T05:39:35.811767+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811767+0000","last_undegraded":"2023-12-19T05:39:35.811767+0000","last_fullsized":"2023-12-19T05:39:35.811767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:29.938867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811183+0000","last_change":"2023-12-19T05:39:35.811183+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811183+0000","last_undegraded":"2023-12-19T05:39:35.811183+0000","last_fullsized":"2023-12-19T05:39:35.811183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:12:49.113154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.815480+0000","last_change":"2023-12-19T05:39:35.815480+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.815480+0000","last_undegraded":"2023-12-19T05:39:35.815480+0000","last_fullsized":"2023-12-19T05:39:35.815480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:18:28.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810651+0000","last_change":"2023-12-19T05:39:35.810651+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810651+0000","last_undegraded":"2023-12-19T05:39:35.810651+0000","last_fullsized":"2023-12-19T05:39:35.810651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:00:04.318274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.815002+0000","last_change":"2023-12-19T05:39:35.815002+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.815002+0000","last_undegraded":"2023-12-19T05:39:35.815002+0000","last_fullsized":"2023-12-19T05:39:35.815002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:49:33.898019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812154+0000","last_change":"2023-12-19T05:39:35.812154+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812154+0000","last_undegraded":"2023-12-19T05:39:35.812154+0000","last_fullsized":"2023-12-19T05:39:35.812154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813520+0000","last_change":"2023-12-19T05:39:35.813520+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813520+0000","last_undegraded":"2023-12-19T05:39:35.813520+0000","last_fullsized":"2023-12-19T05:39:35.813520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814473+0000","last_change":"2023-12-19T05:39:35.814473+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814473+0000","last_undegraded":"2023-12-19T05:39:35.814473+0000","last_fullsized":"2023-12-19T05:39:35.814473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810695+0000","last_change":"2023-12-19T05:39:35.810695+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810695+0000","last_undegraded":"2023-12-19T05:39:35.810695+0000","last_fullsized":"2023-12-19T05:39:35.810695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:25:12.013208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814357+0000","last_change":"2023-12-19T05:39:35.814357+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814357+0000","last_undegraded":"2023-12-19T05:39:35.814357+0000","last_fullsized":"2023-12-19T05:39:35.814357+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:04:00.332266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814872+0000","last_change":"2023-12-19T05:39:35.814872+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814872+0000","last_undegraded":"2023-12-19T05:39:35.814872+0000","last_fullsized":"2023-12-19T05:39:35.814872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:47:31.445497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814886+0000","last_change":"2023-12-19T05:39:35.814886+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814886+0000","last_undegraded":"2023-12-19T05:39:35.814886+0000","last_fullsized":"2023-12-19T05:39:35.814886+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:00.514986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814154+0000","last_change":"2023-12-19T05:39:35.814154+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814154+0000","last_undegraded":"2023-12-19T05:39:35.814154+0000","last_fullsized":"2023-12-19T05:39:35.814154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:22:01.593157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811928+0000","last_change":"2023-12-19T05:39:35.811928+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811928+0000","last_undegraded":"2023-12-19T05:39:35.811928+0000","last_fullsized":"2023-12-19T05:39:35.811928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:24:10.386915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810676+0000","last_change":"2023-12-19T05:39:35.810676+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810676+0000","last_undegraded":"2023-12-19T05:39:35.810676+0000","last_fullsized":"2023-12-19T05:39:35.810676+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:09:30.685286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.810693+0000","last_change":"2023-12-19T05:39:35.810693+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.810693+0000","last_undegraded":"2023-12-19T05:39:35.810693+0000","last_fullsized":"2023-12-19T05:39:35.810693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:51.733584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811667+0000","last_change":"2023-12-19T05:39:35.811667+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811667+0000","last_undegraded":"2023-12-19T05:39:35.811667+0000","last_fullsized":"2023-12-19T05:39:35.811667+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811520+0000","last_change":"2023-12-19T05:39:35.811520+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811520+0000","last_undegraded":"2023-12-19T05:39:35.811520+0000","last_fullsized":"2023-12-19T05:39:35.811520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:06.383246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.812117+0000","last_change":"2023-12-19T05:39:35.812117+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.812117+0000","last_undegraded":"2023-12-19T05:39:35.812117+0000","last_fullsized":"2023-12-19T05:39:35.812117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:17:54.314037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813442+0000","last_change":"2023-12-19T05:39:35.813442+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813442+0000","last_undegraded":"2023-12-19T05:39:35.813442+0000","last_fullsized":"2023-12-19T05:39:35.813442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813550+0000","last_change":"2023-12-19T05:39:35.813550+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813550+0000","last_undegraded":"2023-12-19T05:39:35.813550+0000","last_fullsized":"2023-12-19T05:39:35.813550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:08:56.288042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811075+0000","last_change":"2023-12-19T05:39:35.811075+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811075+0000","last_undegraded":"2023-12-19T05:39:35.811075+0000","last_fullsized":"2023-12-19T05:39:35.811075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:18:28.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813958+0000","last_change":"2023-12-19T05:39:35.813958+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813958+0000","last_undegraded":"2023-12-19T05:39:35.813958+0000","last_fullsized":"2023-12-19T05:39:35.813958+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:06.383246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811075+0000","last_change":"2023-12-19T05:39:35.811075+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811075+0000","last_undegraded":"2023-12-19T05:39:35.811075+0000","last_fullsized":"2023-12-19T05:39:35.811075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:18:47.836073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.813559+0000","last_change":"2023-12-19T05:39:35.813559+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.813559+0000","last_undegraded":"2023-12-19T05:39:35.813559+0000","last_fullsized":"2023-12-19T05:39:35.813559+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:13:18.741953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811575+0000","last_change":"2023-12-19T05:39:35.811575+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811575+0000","last_undegraded":"2023-12-19T05:39:35.811575+0000","last_fullsized":"2023-12-19T05:39:35.811575+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:15:22.976217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.814442+0000","last_change":"2023-12-19T05:39:35.814442+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.814442+0000","last_undegraded":"2023-12-19T05:39:35.814442+0000","last_fullsized":"2023-12-19T05:39:35.814442+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:44:21.196968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T05:39:36.808267+0000","last_change":"2023-12-19T05:39:36.808267+0000","last_active":"2023-12-19T05:39:36.808267+0000","last_peered":"2023-12-19T05:39:36.808267+0000","last_clean":"2023-12-19T05:39:36.808267+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:36.808267+0000","last_undegraded":"2023-12-19T05:39:36.808267+0000","last_fullsized":"2023-12-19T05:39:36.808267+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T05:39:35.811392+0000","last_change":"2023-12-19T05:39:35.811392+0000","last_active":"2023-12-19T05:39:35.805910+0000","last_peered":"2023-12-19T05:39:35.805910+0000","last_clean":"2023-12-19T05:39:35.805910+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T05:39:35.811392+0000","last_undegraded":"2023-12-19T05:39:35.811392+0000","last_fullsized":"2023-12-19T05:39:35.811392+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:29.938867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":169,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-19T05:39:32.119904+0000","last_change":"2023-12-19T05:38:47.150620+0000","last_active":"2023-12-19T05:39:32.119904+0000","last_peered":"2023-12-19T05:39:32.119904+0000","last_clean":"2023-12-19T05:39:32.119904+0000","last_became_active":"2023-12-19T05:38:47.149844+0000","last_became_peered":"2023-12-19T05:38:47.149844+0000","last_unstale":"2023-12-19T05:39:32.119904+0000","last_undegraded":"2023-12-19T05:39:32.119904+0000","last_fullsized":"2023-12-19T05:39:32.119904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_clean_scrub_stamp":"2023-12-19T05:38:46.034642+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:51.920917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":872,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":892928,"data_stored":699471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":108084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.214}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":109103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":888832,"data_stored":698452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T05:39:41.794 INFO:tasks.ceph.mds.c.smithi120.stderr:2023-12-19T05:39:41.793+0000 7fdc84b8b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T05:39:44.477 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T05:39:44.586 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.585+0000 7fd233dab640 1 Processor -- start 2023-12-19T05:39:44.586 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.585+0000 7fd233dab640 1 -- start start 2023-12-19T05:39:44.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd233dab640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd22c0b79b0 0x7fd22c0b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd233dab640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd22c0b8860 0x7fd22c144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd233dab640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd22c145010 0x7fd22c14b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd233dab640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22c14ae10 con 0x7fd22c0b8860 2023-12-19T05:39:44.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd233dab640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22c0bacc0 con 0x7fd22c145010 2023-12-19T05:39:44.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd233dab640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c14ab20 con 0x7fd22c0b79b0 2023-12-19T05:39:44.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd231346640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd22c0b8860 0x7fd22c144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd231346640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fd22c0b8860 0x7fd22c144ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:32924/0 (socket says 172.21.15.120:32924) 2023-12-19T05:39:44.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd231346640 1 -- 172.21.15.120:0/3155773281 learned_addr learned my addr 172.21.15.120:0/3155773281 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:44.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd232348640 1 --2- 172.21.15.120:0/3155773281 >> v2:172.21.15.155:3300/0 conn(0x7fd22c145010 0x7fd22c14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd231b47640 1 --2- 172.21.15.120:0/3155773281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd22c0b79b0 0x7fd22c0b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd231346640 1 -- 172.21.15.120:0/3155773281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd22c0b79b0 msgr2=0x7fd22c0b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:44.588 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd231346640 1 --2- 172.21.15.120:0/3155773281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd22c0b79b0 0x7fd22c0b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.589 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd231346640 1 -- 172.21.15.120:0/3155773281 >> v2:172.21.15.155:3300/0 conn(0x7fd22c145010 msgr2=0x7fd22c14b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:44.589 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd231346640 1 --2- 172.21.15.120:0/3155773281 >> v2:172.21.15.155:3300/0 conn(0x7fd22c145010 0x7fd22c14b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.589 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.586+0000 7fd231346640 1 -- 172.21.15.120:0/3155773281 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c0b96b0 con 0x7fd22c0b8860 2023-12-19T05:39:44.590 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.587+0000 7fd231346640 1 --2- 172.21.15.120:0/3155773281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd22c0b8860 0x7fd22c144ad0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd22c066840 tx=0x7fd21c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d3cf41e84b1348 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:44.590 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.587+0000 7fd230b45640 1 -- 172.21.15.120:0/3155773281 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c031870 con 0x7fd22c0b8860 2023-12-19T05:39:44.590 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.587+0000 7fd230b45640 1 -- 172.21.15.120:0/3155773281 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c0319d0 con 0x7fd22c0b8860 2023-12-19T05:39:44.590 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.587+0000 7fd230b45640 1 -- 172.21.15.120:0/3155773281 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c031d60 con 0x7fd22c0b8860 2023-12-19T05:39:44.590 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.588+0000 7fd233dab640 1 -- 172.21.15.120:0/3155773281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd22c0b8860 msgr2=0x7fd22c144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.590 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.588+0000 7fd233dab640 1 --2- 172.21.15.120:0/3155773281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd22c0b8860 0x7fd22c144ad0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd22c066840 tx=0x7fd21c02b910 comp rx=0 tx=0).stop 2023-12-19T05:39:44.590 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.588+0000 7fd233dab640 1 -- 172.21.15.120:0/3155773281 shutdown_connections 2023-12-19T05:39:44.591 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.588+0000 7fd233dab640 1 --2- 172.21.15.120:0/3155773281 >> v2:172.21.15.155:3300/0 conn(0x7fd22c145010 0x7fd22c14b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.591 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.588+0000 7fd233dab640 1 --2- 172.21.15.120:0/3155773281 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd22c0b8860 0x7fd22c144ad0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.591 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.588+0000 7fd233dab640 1 --2- 172.21.15.120:0/3155773281 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd22c0b79b0 0x7fd22c0b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.591 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.588+0000 7fd233dab640 1 -- 172.21.15.120:0/3155773281 >> 172.21.15.120:0/3155773281 conn(0x7fd22c0c0340 msgr2=0x7fd22c0c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:44.591 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.588+0000 7fd233dab640 1 -- 172.21.15.120:0/3155773281 shutdown_connections 2023-12-19T05:39:44.591 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.588+0000 7fd233dab640 1 -- 172.21.15.120:0/3155773281 wait complete. 2023-12-19T05:39:44.591 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.589+0000 7fd233dab640 1 Processor -- start 2023-12-19T05:39:44.591 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.589+0000 7fd233dab640 1 -- start start 2023-12-19T05:39:44.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd233dab640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd22c0b79b0 0x7fd22c0b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd233dab640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd22c145010 0x7fd22c1e2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd233dab640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd22c0a7a90 0x7fd22c147c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.593 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd233dab640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0a67d0 con 0x7fd22c0a7a90 2023-12-19T05:39:44.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd233dab640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1e3840 con 0x7fd22c145010 2023-12-19T05:39:44.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd233dab640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1e3b20 con 0x7fd22c0b79b0 2023-12-19T05:39:44.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd232348640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd22c0a7a90 0x7fd22c147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd232348640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd22c0a7a90 0x7fd22c147c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:32938/0 (socket says 172.21.15.120:32938) 2023-12-19T05:39:44.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd232348640 1 -- 172.21.15.120:0/3216213607 learned_addr learned my addr 172.21.15.120:0/3216213607 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:44.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd231b47640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd22c0b79b0 0x7fd22c0b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd231346640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd22c145010 0x7fd22c1e2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd232348640 1 -- 172.21.15.120:0/3216213607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd22c0b79b0 msgr2=0x7fd22c0b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd232348640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd22c0b79b0 0x7fd22c0b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd232348640 1 -- 172.21.15.120:0/3216213607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd22c145010 msgr2=0x7fd22c1e2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd232348640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd22c145010 0x7fd22c1e2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd232348640 1 -- 172.21.15.120:0/3216213607 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c0094d0 con 0x7fd22c0a7a90 2023-12-19T05:39:44.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd231346640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd22c145010 0x7fd22c1e2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:44.594 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd232348640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd22c0a7a90 0x7fd22c147c30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd22400d5a0 tx=0x7fd22400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:44.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd2227fc640 1 -- 172.21.15.120:0/3216213607 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2240125f0 con 0x7fd22c0a7a90 2023-12-19T05:39:44.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd2227fc640 1 -- 172.21.15.120:0/3216213607 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd224012750 con 0x7fd22c0a7a90 2023-12-19T05:39:44.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd233dab640 1 -- 172.21.15.120:0/3216213607 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c1e3520 con 0x7fd22c0a7a90 2023-12-19T05:39:44.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd2227fc640 1 -- 172.21.15.120:0/3216213607 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224012ae0 con 0x7fd22c0a7a90 2023-12-19T05:39:44.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.590+0000 7fd233dab640 1 -- 172.21.15.120:0/3216213607 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c146f60 con 0x7fd22c0a7a90 2023-12-19T05:39:44.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.591+0000 7fd233dab640 1 -- 172.21.15.120:0/3216213607 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22c1e36b0 con 0x7fd22c0a7a90 2023-12-19T05:39:44.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.592+0000 7fd2227fc640 1 -- 172.21.15.120:0/3216213607 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd224012c40 con 0x7fd22c0a7a90 2023-12-19T05:39:44.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.592+0000 7fd2227fc640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd21006a430 0x7fd21006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.592+0000 7fd2227fc640 1 -- 172.21.15.120:0/3216213607 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd224088d90 con 0x7fd22c0a7a90 2023-12-19T05:39:44.595 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.592+0000 7fd231b47640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd21006a430 0x7fd21006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.596 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.593+0000 7fd231b47640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd21006a430 0x7fd21006c8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd228004410 tx=0x7fd2280039f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:44.597 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.597+0000 7fd2227fc640 1 -- 172.21.15.120:0/3216213607 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd224054390 con 0x7fd22c0a7a90 2023-12-19T05:39:44.763 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.761+0000 7fd233dab640 1 -- 172.21.15.120:0/3216213607 --> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd22c0b93d0 con 0x7fd21006a430 2023-12-19T05:39:44.769 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.768+0000 7fd2227fc640 1 -- 172.21.15.120:0/3216213607 <== mgr.4101 v2:172.21.15.120:6832/89586 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264621 (secure 0 0 0) 0x7fd228009c90 con 0x7fd21006a430 2023-12-19T05:39:44.772 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:44.774 INFO:teuthology.orchestra.run.smithi120.stderr:dumped all 2023-12-19T05:39:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.771+0000 7fd233dab640 1 -- 172.21.15.120:0/3216213607 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd21006a430 msgr2=0x7fd21006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.771+0000 7fd233dab640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd21006a430 0x7fd21006c8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd228004410 tx=0x7fd2280039f0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.771+0000 7fd233dab640 1 -- 172.21.15.120:0/3216213607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd22c0a7a90 msgr2=0x7fd22c147c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.771+0000 7fd233dab640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd22c0a7a90 0x7fd22c147c30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd22400d5a0 tx=0x7fd22400da60 comp rx=0 tx=0).stop 2023-12-19T05:39:44.775 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.771+0000 7fd233dab640 1 -- 172.21.15.120:0/3216213607 shutdown_connections 2023-12-19T05:39:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.771+0000 7fd233dab640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd21006a430 0x7fd21006c8f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.771+0000 7fd233dab640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd22c0a7a90 0x7fd22c147c30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.771+0000 7fd233dab640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd22c145010 0x7fd22c1e2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.771+0000 7fd233dab640 1 --2- 172.21.15.120:0/3216213607 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd22c0b79b0 0x7fd22c0b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.771+0000 7fd233dab640 1 -- 172.21.15.120:0/3216213607 >> 172.21.15.120:0/3216213607 conn(0x7fd22c0c0340 msgr2=0x7fd22c144800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.771+0000 7fd233dab640 1 -- 172.21.15.120:0/3216213607 shutdown_connections 2023-12-19T05:39:44.776 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.771+0000 7fd233dab640 1 -- 172.21.15.120:0/3216213607 wait complete. 2023-12-19T05:39:44.783 INFO:teuthology.orchestra.run.smithi120.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-12-19T05:39:43.944515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219552,"kb_used_data":3936,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755168,"statfs":{"total":773094113280,"available":772869292032,"internally_reserved":0,"allocated":4030464,"data_stored":2257518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.131256"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.181924+0000","last_change":"2023-12-19T05:39:37.182689+0000","last_active":"2023-12-19T05:39:38.181924+0000","last_peered":"2023-12-19T05:39:38.181924+0000","last_clean":"2023-12-19T05:39:38.181924+0000","last_became_active":"2023-12-19T05:39:37.182436+0000","last_became_peered":"2023-12-19T05:39:37.182436+0000","last_unstale":"2023-12-19T05:39:38.181924+0000","last_undegraded":"2023-12-19T05:39:38.181924+0000","last_fullsized":"2023-12-19T05:39:38.181924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:49:34.900376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959733+0000","last_change":"2023-12-19T05:39:37.191189+0000","last_active":"2023-12-19T05:39:38.959733+0000","last_peered":"2023-12-19T05:39:38.959733+0000","last_clean":"2023-12-19T05:39:38.959733+0000","last_became_active":"2023-12-19T05:39:37.190670+0000","last_became_peered":"2023-12-19T05:39:37.190670+0000","last_unstale":"2023-12-19T05:39:38.959733+0000","last_undegraded":"2023-12-19T05:39:38.959733+0000","last_fullsized":"2023-12-19T05:39:38.959733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:38:33.755667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.180771+0000","last_change":"2023-12-19T05:39:37.195555+0000","last_active":"2023-12-19T05:39:38.180771+0000","last_peered":"2023-12-19T05:39:38.180771+0000","last_clean":"2023-12-19T05:39:38.180771+0000","last_became_active":"2023-12-19T05:39:37.195218+0000","last_became_peered":"2023-12-19T05:39:37.195218+0000","last_unstale":"2023-12-19T05:39:38.180771+0000","last_undegraded":"2023-12-19T05:39:38.180771+0000","last_fullsized":"2023-12-19T05:39:38.180771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:37.161184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.458545+0000","last_change":"2023-12-19T05:39:37.190934+0000","last_active":"2023-12-19T05:39:38.458545+0000","last_peered":"2023-12-19T05:39:38.458545+0000","last_clean":"2023-12-19T05:39:38.458545+0000","last_became_active":"2023-12-19T05:39:37.190703+0000","last_became_peered":"2023-12-19T05:39:37.190703+0000","last_unstale":"2023-12-19T05:39:38.458545+0000","last_undegraded":"2023-12-19T05:39:38.458545+0000","last_fullsized":"2023-12-19T05:39:38.458545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:21:30.488810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959164+0000","last_change":"2023-12-19T05:39:37.191351+0000","last_active":"2023-12-19T05:39:38.959164+0000","last_peered":"2023-12-19T05:39:38.959164+0000","last_clean":"2023-12-19T05:39:38.959164+0000","last_became_active":"2023-12-19T05:39:37.191106+0000","last_became_peered":"2023-12-19T05:39:37.191106+0000","last_unstale":"2023-12-19T05:39:38.959164+0000","last_undegraded":"2023-12-19T05:39:38.959164+0000","last_fullsized":"2023-12-19T05:39:38.959164+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:17:55.316394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959185+0000","last_change":"2023-12-19T05:39:37.186958+0000","last_active":"2023-12-19T05:39:38.959185+0000","last_peered":"2023-12-19T05:39:38.959185+0000","last_clean":"2023-12-19T05:39:38.959185+0000","last_became_active":"2023-12-19T05:39:37.186704+0000","last_became_peered":"2023-12-19T05:39:37.186704+0000","last_unstale":"2023-12-19T05:39:38.959185+0000","last_undegraded":"2023-12-19T05:39:38.959185+0000","last_fullsized":"2023-12-19T05:39:38.959185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:37:21.233510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.960155+0000","last_change":"2023-12-19T05:39:37.184663+0000","last_active":"2023-12-19T05:39:38.960155+0000","last_peered":"2023-12-19T05:39:38.960155+0000","last_clean":"2023-12-19T05:39:38.960155+0000","last_became_active":"2023-12-19T05:39:37.184420+0000","last_became_peered":"2023-12-19T05:39:37.184420+0000","last_unstale":"2023-12-19T05:39:38.960155+0000","last_undegraded":"2023-12-19T05:39:38.960155+0000","last_fullsized":"2023-12-19T05:39:38.960155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:29:07.846007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.960075+0000","last_change":"2023-12-19T05:39:37.189881+0000","last_active":"2023-12-19T05:39:38.960075+0000","last_peered":"2023-12-19T05:39:38.960075+0000","last_clean":"2023-12-19T05:39:38.960075+0000","last_became_active":"2023-12-19T05:39:37.189638+0000","last_became_peered":"2023-12-19T05:39:37.189638+0000","last_unstale":"2023-12-19T05:39:38.960075+0000","last_undegraded":"2023-12-19T05:39:38.960075+0000","last_fullsized":"2023-12-19T05:39:38.960075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:37.161184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.182749+0000","last_change":"2023-12-19T05:39:37.186373+0000","last_active":"2023-12-19T05:39:38.182749+0000","last_peered":"2023-12-19T05:39:38.182749+0000","last_clean":"2023-12-19T05:39:38.182749+0000","last_became_active":"2023-12-19T05:39:37.186048+0000","last_became_peered":"2023-12-19T05:39:37.186048+0000","last_unstale":"2023-12-19T05:39:38.182749+0000","last_undegraded":"2023-12-19T05:39:38.182749+0000","last_fullsized":"2023-12-19T05:39:38.182749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:21:30.488810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.458812+0000","last_change":"2023-12-19T05:39:37.198738+0000","last_active":"2023-12-19T05:39:38.458812+0000","last_peered":"2023-12-19T05:39:38.458812+0000","last_clean":"2023-12-19T05:39:38.458812+0000","last_became_active":"2023-12-19T05:39:37.198476+0000","last_became_peered":"2023-12-19T05:39:37.198476+0000","last_unstale":"2023-12-19T05:39:38.458812+0000","last_undegraded":"2023-12-19T05:39:38.458812+0000","last_fullsized":"2023-12-19T05:39:38.458812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:33:01.381678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.960122+0000","last_change":"2023-12-19T05:39:37.188487+0000","last_active":"2023-12-19T05:39:38.960122+0000","last_peered":"2023-12-19T05:39:38.960122+0000","last_clean":"2023-12-19T05:39:38.960122+0000","last_became_active":"2023-12-19T05:39:37.188235+0000","last_became_peered":"2023-12-19T05:39:37.188235+0000","last_unstale":"2023-12-19T05:39:38.960122+0000","last_undegraded":"2023-12-19T05:39:38.960122+0000","last_fullsized":"2023-12-19T05:39:38.960122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:38:33.755667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.180806+0000","last_change":"2023-12-19T05:39:37.195253+0000","last_active":"2023-12-19T05:39:38.180806+0000","last_peered":"2023-12-19T05:39:38.180806+0000","last_clean":"2023-12-19T05:39:38.180806+0000","last_became_active":"2023-12-19T05:39:37.194973+0000","last_became_peered":"2023-12-19T05:39:37.194973+0000","last_unstale":"2023-12-19T05:39:38.180806+0000","last_undegraded":"2023-12-19T05:39:38.180806+0000","last_fullsized":"2023-12-19T05:39:38.180806+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:02.725383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959257+0000","last_change":"2023-12-19T05:39:37.188808+0000","last_active":"2023-12-19T05:39:38.959257+0000","last_peered":"2023-12-19T05:39:38.959257+0000","last_clean":"2023-12-19T05:39:38.959257+0000","last_became_active":"2023-12-19T05:39:37.188562+0000","last_became_peered":"2023-12-19T05:39:37.188562+0000","last_unstale":"2023-12-19T05:39:38.959257+0000","last_undegraded":"2023-12-19T05:39:38.959257+0000","last_fullsized":"2023-12-19T05:39:38.959257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:52.735941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959264+0000","last_change":"2023-12-19T05:39:37.186868+0000","last_active":"2023-12-19T05:39:38.959264+0000","last_peered":"2023-12-19T05:39:38.959264+0000","last_clean":"2023-12-19T05:39:38.959264+0000","last_became_active":"2023-12-19T05:39:37.186635+0000","last_became_peered":"2023-12-19T05:39:37.186635+0000","last_unstale":"2023-12-19T05:39:38.959264+0000","last_undegraded":"2023-12-19T05:39:38.959264+0000","last_fullsized":"2023-12-19T05:39:38.959264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:02.725383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.180277+0000","last_change":"2023-12-19T05:39:37.183703+0000","last_active":"2023-12-19T05:39:38.180277+0000","last_peered":"2023-12-19T05:39:38.180277+0000","last_clean":"2023-12-19T05:39:38.180277+0000","last_became_active":"2023-12-19T05:39:37.183438+0000","last_became_peered":"2023-12-19T05:39:37.183438+0000","last_unstale":"2023-12-19T05:39:38.180277+0000","last_undegraded":"2023-12-19T05:39:38.180277+0000","last_fullsized":"2023-12-19T05:39:38.180277+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:37:57.760333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.960191+0000","last_change":"2023-12-19T05:39:37.192292+0000","last_active":"2023-12-19T05:39:38.960191+0000","last_peered":"2023-12-19T05:39:38.960191+0000","last_clean":"2023-12-19T05:39:38.960191+0000","last_became_active":"2023-12-19T05:39:37.192047+0000","last_became_peered":"2023-12-19T05:39:37.192047+0000","last_unstale":"2023-12-19T05:39:38.960191+0000","last_undegraded":"2023-12-19T05:39:38.960191+0000","last_fullsized":"2023-12-19T05:39:38.960191+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:37:21.233510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.960301+0000","last_change":"2023-12-19T05:39:37.184211+0000","last_active":"2023-12-19T05:39:38.960301+0000","last_peered":"2023-12-19T05:39:38.960301+0000","last_clean":"2023-12-19T05:39:38.960301+0000","last_became_active":"2023-12-19T05:39:37.183933+0000","last_became_peered":"2023-12-19T05:39:37.183933+0000","last_unstale":"2023-12-19T05:39:38.960301+0000","last_undegraded":"2023-12-19T05:39:38.960301+0000","last_fullsized":"2023-12-19T05:39:38.960301+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:02:46.585340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959718+0000","last_change":"2023-12-19T05:39:37.197369+0000","last_active":"2023-12-19T05:39:38.959718+0000","last_peered":"2023-12-19T05:39:38.959718+0000","last_clean":"2023-12-19T05:39:38.959718+0000","last_became_active":"2023-12-19T05:39:37.197148+0000","last_became_peered":"2023-12-19T05:39:37.197148+0000","last_unstale":"2023-12-19T05:39:38.959718+0000","last_undegraded":"2023-12-19T05:39:38.959718+0000","last_fullsized":"2023-12-19T05:39:38.959718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:27:48.370776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959589+0000","last_change":"2023-12-19T05:39:37.196607+0000","last_active":"2023-12-19T05:39:38.959589+0000","last_peered":"2023-12-19T05:39:38.959589+0000","last_clean":"2023-12-19T05:39:38.959589+0000","last_became_active":"2023-12-19T05:39:37.196378+0000","last_became_peered":"2023-12-19T05:39:37.196378+0000","last_unstale":"2023-12-19T05:39:38.959589+0000","last_undegraded":"2023-12-19T05:39:38.959589+0000","last_fullsized":"2023-12-19T05:39:38.959589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:18:16.225898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959504+0000","last_change":"2023-12-19T05:39:37.190062+0000","last_active":"2023-12-19T05:39:38.959504+0000","last_peered":"2023-12-19T05:39:38.959504+0000","last_clean":"2023-12-19T05:39:38.959504+0000","last_became_active":"2023-12-19T05:39:37.189826+0000","last_became_peered":"2023-12-19T05:39:37.189826+0000","last_unstale":"2023-12-19T05:39:38.959504+0000","last_undegraded":"2023-12-19T05:39:38.959504+0000","last_fullsized":"2023-12-19T05:39:38.959504+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:12:50.115511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.182101+0000","last_change":"2023-12-19T05:39:37.186947+0000","last_active":"2023-12-19T05:39:38.182101+0000","last_peered":"2023-12-19T05:39:38.182101+0000","last_clean":"2023-12-19T05:39:38.182101+0000","last_became_active":"2023-12-19T05:39:37.186713+0000","last_became_peered":"2023-12-19T05:39:37.186713+0000","last_unstale":"2023-12-19T05:39:38.182101+0000","last_undegraded":"2023-12-19T05:39:38.182101+0000","last_fullsized":"2023-12-19T05:39:38.182101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:39.867176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.182659+0000","last_change":"2023-12-19T05:39:37.188637+0000","last_active":"2023-12-19T05:39:38.182659+0000","last_peered":"2023-12-19T05:39:38.182659+0000","last_clean":"2023-12-19T05:39:38.182659+0000","last_became_active":"2023-12-19T05:39:37.188313+0000","last_became_peered":"2023-12-19T05:39:37.188313+0000","last_unstale":"2023-12-19T05:39:38.182659+0000","last_undegraded":"2023-12-19T05:39:38.182659+0000","last_fullsized":"2023-12-19T05:39:38.182659+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:49:34.900376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.456370+0000","last_change":"2023-12-19T05:39:37.183010+0000","last_active":"2023-12-19T05:39:38.456370+0000","last_peered":"2023-12-19T05:39:38.456370+0000","last_clean":"2023-12-19T05:39:38.456370+0000","last_became_active":"2023-12-19T05:39:37.182734+0000","last_became_peered":"2023-12-19T05:39:37.182734+0000","last_unstale":"2023-12-19T05:39:38.456370+0000","last_undegraded":"2023-12-19T05:39:38.456370+0000","last_fullsized":"2023-12-19T05:39:38.456370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:46:19.322253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.180122+0000","last_change":"2023-12-19T05:39:37.190328+0000","last_active":"2023-12-19T05:39:38.180122+0000","last_peered":"2023-12-19T05:39:38.180122+0000","last_clean":"2023-12-19T05:39:38.180122+0000","last_became_active":"2023-12-19T05:39:37.190090+0000","last_became_peered":"2023-12-19T05:39:37.190090+0000","last_unstale":"2023-12-19T05:39:38.180122+0000","last_undegraded":"2023-12-19T05:39:38.180122+0000","last_fullsized":"2023-12-19T05:39:38.180122+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:02:46.585340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.458869+0000","last_change":"2023-12-19T05:39:37.186039+0000","last_active":"2023-12-19T05:39:38.458869+0000","last_peered":"2023-12-19T05:39:38.458869+0000","last_clean":"2023-12-19T05:39:38.458869+0000","last_became_active":"2023-12-19T05:39:37.185797+0000","last_became_peered":"2023-12-19T05:39:37.185797+0000","last_unstale":"2023-12-19T05:39:38.458869+0000","last_undegraded":"2023-12-19T05:39:38.458869+0000","last_fullsized":"2023-12-19T05:39:38.458869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:46:19.322253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959766+0000","last_change":"2023-12-19T05:39:37.195211+0000","last_active":"2023-12-19T05:39:38.959766+0000","last_peered":"2023-12-19T05:39:38.959766+0000","last_clean":"2023-12-19T05:39:38.959766+0000","last_became_active":"2023-12-19T05:39:37.190925+0000","last_became_peered":"2023-12-19T05:39:37.190925+0000","last_unstale":"2023-12-19T05:39:38.959766+0000","last_undegraded":"2023-12-19T05:39:38.959766+0000","last_fullsized":"2023-12-19T05:39:38.959766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:40:20.097226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.458747+0000","last_change":"2023-12-19T05:39:37.193596+0000","last_active":"2023-12-19T05:39:38.458747+0000","last_peered":"2023-12-19T05:39:38.458747+0000","last_clean":"2023-12-19T05:39:38.458747+0000","last_became_active":"2023-12-19T05:39:37.193307+0000","last_became_peered":"2023-12-19T05:39:37.193307+0000","last_unstale":"2023-12-19T05:39:38.458747+0000","last_undegraded":"2023-12-19T05:39:38.458747+0000","last_fullsized":"2023-12-19T05:39:38.458747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:17:29.247949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.180907+0000","last_change":"2023-12-19T05:39:37.186350+0000","last_active":"2023-12-19T05:39:38.180907+0000","last_peered":"2023-12-19T05:39:38.180907+0000","last_clean":"2023-12-19T05:39:38.180907+0000","last_became_active":"2023-12-19T05:39:37.186111+0000","last_became_peered":"2023-12-19T05:39:37.186111+0000","last_unstale":"2023-12-19T05:39:38.180907+0000","last_undegraded":"2023-12-19T05:39:38.180907+0000","last_fullsized":"2023-12-19T05:39:38.180907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:37:21.233510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.182400+0000","last_change":"2023-12-19T05:39:37.191402+0000","last_active":"2023-12-19T05:39:38.182400+0000","last_peered":"2023-12-19T05:39:38.182400+0000","last_clean":"2023-12-19T05:39:38.182400+0000","last_became_active":"2023-12-19T05:39:37.191161+0000","last_became_peered":"2023-12-19T05:39:37.191161+0000","last_unstale":"2023-12-19T05:39:38.182400+0000","last_undegraded":"2023-12-19T05:39:38.182400+0000","last_fullsized":"2023-12-19T05:39:38.182400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:44:22.199325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959954+0000","last_change":"2023-12-19T05:39:37.184084+0000","last_active":"2023-12-19T05:39:38.959954+0000","last_peered":"2023-12-19T05:39:38.959954+0000","last_clean":"2023-12-19T05:39:38.959954+0000","last_became_active":"2023-12-19T05:39:37.183822+0000","last_became_peered":"2023-12-19T05:39:37.183822+0000","last_unstale":"2023-12-19T05:39:38.959954+0000","last_undegraded":"2023-12-19T05:39:38.959954+0000","last_fullsized":"2023-12-19T05:39:38.959954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T15:59:02.725383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.181772+0000","last_change":"2023-12-19T05:39:37.189358+0000","last_active":"2023-12-19T05:39:38.181772+0000","last_peered":"2023-12-19T05:39:38.181772+0000","last_clean":"2023-12-19T05:39:38.181772+0000","last_became_active":"2023-12-19T05:39:37.189104+0000","last_became_peered":"2023-12-19T05:39:37.189104+0000","last_unstale":"2023-12-19T05:39:38.181772+0000","last_undegraded":"2023-12-19T05:39:38.181772+0000","last_fullsized":"2023-12-19T05:39:38.181772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:03.646819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.960044+0000","last_change":"2023-12-19T05:39:37.187924+0000","last_active":"2023-12-19T05:39:38.960044+0000","last_peered":"2023-12-19T05:39:38.960044+0000","last_clean":"2023-12-19T05:39:38.960044+0000","last_became_active":"2023-12-19T05:39:37.187629+0000","last_became_peered":"2023-12-19T05:39:37.187629+0000","last_unstale":"2023-12-19T05:39:38.960044+0000","last_undegraded":"2023-12-19T05:39:38.960044+0000","last_fullsized":"2023-12-19T05:39:38.960044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:58:27.888624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.456484+0000","last_change":"2023-12-19T05:39:37.183834+0000","last_active":"2023-12-19T05:39:38.456484+0000","last_peered":"2023-12-19T05:39:38.456484+0000","last_clean":"2023-12-19T05:39:38.456484+0000","last_became_active":"2023-12-19T05:39:37.183570+0000","last_became_peered":"2023-12-19T05:39:37.183570+0000","last_unstale":"2023-12-19T05:39:38.456484+0000","last_undegraded":"2023-12-19T05:39:38.456484+0000","last_fullsized":"2023-12-19T05:39:38.456484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:33:01.381678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.201529+0000","last_change":"2023-12-19T05:39:36.825294+0000","last_active":"2023-12-19T05:39:37.201529+0000","last_peered":"2023-12-19T05:39:37.201529+0000","last_clean":"2023-12-19T05:39:37.201529+0000","last_became_active":"2023-12-19T05:39:36.825056+0000","last_became_peered":"2023-12-19T05:39:36.825056+0000","last_unstale":"2023-12-19T05:39:37.201529+0000","last_undegraded":"2023-12-19T05:39:37.201529+0000","last_fullsized":"2023-12-19T05:39:37.201529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:51.733584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.182039+0000","last_change":"2023-12-19T05:39:37.189029+0000","last_active":"2023-12-19T05:39:38.182039+0000","last_peered":"2023-12-19T05:39:38.182039+0000","last_clean":"2023-12-19T05:39:38.182039+0000","last_became_active":"2023-12-19T05:39:37.188753+0000","last_became_peered":"2023-12-19T05:39:37.188753+0000","last_unstale":"2023-12-19T05:39:38.182039+0000","last_undegraded":"2023-12-19T05:39:38.182039+0000","last_fullsized":"2023-12-19T05:39:38.182039+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:01.517343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.201185+0000","last_change":"2023-12-19T05:39:36.828943+0000","last_active":"2023-12-19T05:39:37.201185+0000","last_peered":"2023-12-19T05:39:37.201185+0000","last_clean":"2023-12-19T05:39:37.201185+0000","last_became_active":"2023-12-19T05:39:36.828621+0000","last_became_peered":"2023-12-19T05:39:36.828621+0000","last_unstale":"2023-12-19T05:39:37.201185+0000","last_undegraded":"2023-12-19T05:39:37.201185+0000","last_fullsized":"2023-12-19T05:39:37.201185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:47:31.445497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.182508+0000","last_change":"2023-12-19T05:39:37.191984+0000","last_active":"2023-12-19T05:39:38.182508+0000","last_peered":"2023-12-19T05:39:38.182508+0000","last_clean":"2023-12-19T05:39:38.182508+0000","last_became_active":"2023-12-19T05:39:37.191360+0000","last_became_peered":"2023-12-19T05:39:37.191360+0000","last_unstale":"2023-12-19T05:39:38.182508+0000","last_undegraded":"2023-12-19T05:39:38.182508+0000","last_fullsized":"2023-12-19T05:39:38.182508+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:12:42.239166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.196130+0000","last_change":"2023-12-19T05:39:36.834593+0000","last_active":"2023-12-19T05:39:37.196130+0000","last_peered":"2023-12-19T05:39:37.196130+0000","last_clean":"2023-12-19T05:39:37.196130+0000","last_became_active":"2023-12-19T05:39:36.834311+0000","last_became_peered":"2023-12-19T05:39:36.834311+0000","last_unstale":"2023-12-19T05:39:37.196130+0000","last_undegraded":"2023-12-19T05:39:37.196130+0000","last_fullsized":"2023-12-19T05:39:37.196130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.458788+0000","last_change":"2023-12-19T05:39:37.188560+0000","last_active":"2023-12-19T05:39:38.458788+0000","last_peered":"2023-12-19T05:39:38.458788+0000","last_clean":"2023-12-19T05:39:38.458788+0000","last_became_active":"2023-12-19T05:39:37.188331+0000","last_became_peered":"2023-12-19T05:39:37.188331+0000","last_unstale":"2023-12-19T05:39:38.458788+0000","last_undegraded":"2023-12-19T05:39:38.458788+0000","last_fullsized":"2023-12-19T05:39:38.458788+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:38:39.867176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.194184+0000","last_change":"2023-12-19T05:39:36.826730+0000","last_active":"2023-12-19T05:39:37.194184+0000","last_peered":"2023-12-19T05:39:37.194184+0000","last_clean":"2023-12-19T05:39:37.194184+0000","last_became_active":"2023-12-19T05:39:36.826465+0000","last_became_peered":"2023-12-19T05:39:36.826465+0000","last_unstale":"2023-12-19T05:39:37.194184+0000","last_undegraded":"2023-12-19T05:39:37.194184+0000","last_fullsized":"2023-12-19T05:39:37.194184+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:43:16.527733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.960016+0000","last_change":"2023-12-19T05:39:37.188698+0000","last_active":"2023-12-19T05:39:38.960016+0000","last_peered":"2023-12-19T05:39:38.960016+0000","last_clean":"2023-12-19T05:39:38.960016+0000","last_became_active":"2023-12-19T05:39:37.188396+0000","last_became_peered":"2023-12-19T05:39:37.188396+0000","last_unstale":"2023-12-19T05:39:38.960016+0000","last_undegraded":"2023-12-19T05:39:38.960016+0000","last_fullsized":"2023-12-19T05:39:38.960016+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:17:29.247949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.198431+0000","last_change":"2023-12-19T05:39:36.827584+0000","last_active":"2023-12-19T05:39:37.198431+0000","last_peered":"2023-12-19T05:39:37.198431+0000","last_clean":"2023-12-19T05:39:37.198431+0000","last_became_active":"2023-12-19T05:39:36.827315+0000","last_became_peered":"2023-12-19T05:39:36.827315+0000","last_unstale":"2023-12-19T05:39:37.198431+0000","last_undegraded":"2023-12-19T05:39:37.198431+0000","last_fullsized":"2023-12-19T05:39:37.198431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:29.938867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.180393+0000","last_change":"2023-12-19T05:39:37.189687+0000","last_active":"2023-12-19T05:39:38.180393+0000","last_peered":"2023-12-19T05:39:38.180393+0000","last_clean":"2023-12-19T05:39:38.180393+0000","last_became_active":"2023-12-19T05:39:37.187439+0000","last_became_peered":"2023-12-19T05:39:37.187439+0000","last_unstale":"2023-12-19T05:39:38.180393+0000","last_undegraded":"2023-12-19T05:39:38.180393+0000","last_fullsized":"2023-12-19T05:39:38.180393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:38:33.755667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.198365+0000","last_change":"2023-12-19T05:39:36.828137+0000","last_active":"2023-12-19T05:39:37.198365+0000","last_peered":"2023-12-19T05:39:37.198365+0000","last_clean":"2023-12-19T05:39:37.198365+0000","last_became_active":"2023-12-19T05:39:36.827828+0000","last_became_peered":"2023-12-19T05:39:36.827828+0000","last_unstale":"2023-12-19T05:39:37.198365+0000","last_undegraded":"2023-12-19T05:39:37.198365+0000","last_fullsized":"2023-12-19T05:39:37.198365+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:12:49.113154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.182576+0000","last_change":"2023-12-19T05:39:37.185661+0000","last_active":"2023-12-19T05:39:38.182576+0000","last_peered":"2023-12-19T05:39:38.182576+0000","last_clean":"2023-12-19T05:39:38.182576+0000","last_became_active":"2023-12-19T05:39:37.185405+0000","last_became_peered":"2023-12-19T05:39:37.185405+0000","last_unstale":"2023-12-19T05:39:38.182576+0000","last_undegraded":"2023-12-19T05:39:38.182576+0000","last_fullsized":"2023-12-19T05:39:38.182576+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:47:32.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.180306+0000","last_change":"2023-12-19T05:39:36.826813+0000","last_active":"2023-12-19T05:39:37.180306+0000","last_peered":"2023-12-19T05:39:37.180306+0000","last_clean":"2023-12-19T05:39:37.180306+0000","last_became_active":"2023-12-19T05:39:36.826547+0000","last_became_peered":"2023-12-19T05:39:36.826547+0000","last_unstale":"2023-12-19T05:39:37.180306+0000","last_undegraded":"2023-12-19T05:39:37.180306+0000","last_fullsized":"2023-12-19T05:39:37.180306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:18:28.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.458465+0000","last_change":"2023-12-19T05:39:37.196323+0000","last_active":"2023-12-19T05:39:38.458465+0000","last_peered":"2023-12-19T05:39:38.458465+0000","last_clean":"2023-12-19T05:39:38.458465+0000","last_became_active":"2023-12-19T05:39:37.195865+0000","last_became_peered":"2023-12-19T05:39:37.195865+0000","last_unstale":"2023-12-19T05:39:38.458465+0000","last_undegraded":"2023-12-19T05:39:38.458465+0000","last_fullsized":"2023-12-19T05:39:38.458465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:17:10.378062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.177669+0000","last_change":"2023-12-19T05:39:36.822815+0000","last_active":"2023-12-19T05:39:37.177669+0000","last_peered":"2023-12-19T05:39:37.177669+0000","last_clean":"2023-12-19T05:39:37.177669+0000","last_became_active":"2023-12-19T05:39:36.822556+0000","last_became_peered":"2023-12-19T05:39:36.822556+0000","last_unstale":"2023-12-19T05:39:37.177669+0000","last_undegraded":"2023-12-19T05:39:37.177669+0000","last_fullsized":"2023-12-19T05:39:37.177669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:00:04.318274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.180760+0000","last_change":"2023-12-19T05:39:37.195454+0000","last_active":"2023-12-19T05:39:38.180760+0000","last_peered":"2023-12-19T05:39:38.180760+0000","last_clean":"2023-12-19T05:39:38.180760+0000","last_became_active":"2023-12-19T05:39:37.195206+0000","last_became_peered":"2023-12-19T05:39:37.195206+0000","last_unstale":"2023-12-19T05:39:38.180760+0000","last_undegraded":"2023-12-19T05:39:38.180760+0000","last_fullsized":"2023-12-19T05:39:38.180760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:32.341338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.181845+0000","last_change":"2023-12-19T05:39:36.832089+0000","last_active":"2023-12-19T05:39:37.181845+0000","last_peered":"2023-12-19T05:39:37.181845+0000","last_clean":"2023-12-19T05:39:37.181845+0000","last_became_active":"2023-12-19T05:39:36.831516+0000","last_became_peered":"2023-12-19T05:39:36.831516+0000","last_unstale":"2023-12-19T05:39:37.181845+0000","last_undegraded":"2023-12-19T05:39:37.181845+0000","last_fullsized":"2023-12-19T05:39:37.181845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T05:49:33.898019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959750+0000","last_change":"2023-12-19T05:39:37.193277+0000","last_active":"2023-12-19T05:39:38.959750+0000","last_peered":"2023-12-19T05:39:38.959750+0000","last_clean":"2023-12-19T05:39:38.959750+0000","last_became_active":"2023-12-19T05:39:37.193025+0000","last_became_peered":"2023-12-19T05:39:37.193025+0000","last_unstale":"2023-12-19T05:39:38.959750+0000","last_undegraded":"2023-12-19T05:39:38.959750+0000","last_fullsized":"2023-12-19T05:39:38.959750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:55:45.648562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.176618+0000","last_change":"2023-12-19T05:39:36.827564+0000","last_active":"2023-12-19T05:39:37.176618+0000","last_peered":"2023-12-19T05:39:37.176618+0000","last_clean":"2023-12-19T05:39:37.176618+0000","last_became_active":"2023-12-19T05:39:36.827323+0000","last_became_peered":"2023-12-19T05:39:36.827323+0000","last_unstale":"2023-12-19T05:39:37.176618+0000","last_undegraded":"2023-12-19T05:39:37.176618+0000","last_fullsized":"2023-12-19T05:39:37.176618+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959520+0000","last_change":"2023-12-19T05:39:37.188676+0000","last_active":"2023-12-19T05:39:38.959520+0000","last_peered":"2023-12-19T05:39:38.959520+0000","last_clean":"2023-12-19T05:39:38.959520+0000","last_became_active":"2023-12-19T05:39:37.188420+0000","last_became_peered":"2023-12-19T05:39:37.188420+0000","last_unstale":"2023-12-19T05:39:38.959520+0000","last_undegraded":"2023-12-19T05:39:38.959520+0000","last_fullsized":"2023-12-19T05:39:38.959520+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:58:27.888624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.201332+0000","last_change":"2023-12-19T05:39:36.829146+0000","last_active":"2023-12-19T05:39:37.201332+0000","last_peered":"2023-12-19T05:39:37.201332+0000","last_clean":"2023-12-19T05:39:37.201332+0000","last_became_active":"2023-12-19T05:39:36.828787+0000","last_became_peered":"2023-12-19T05:39:36.828787+0000","last_unstale":"2023-12-19T05:39:37.201332+0000","last_undegraded":"2023-12-19T05:39:37.201332+0000","last_fullsized":"2023-12-19T05:39:37.201332+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:07:02.644462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.180643+0000","last_change":"2023-12-19T05:39:37.192371+0000","last_active":"2023-12-19T05:39:38.180643+0000","last_peered":"2023-12-19T05:39:38.180643+0000","last_clean":"2023-12-19T05:39:38.180643+0000","last_became_active":"2023-12-19T05:39:37.192128+0000","last_became_peered":"2023-12-19T05:39:37.192128+0000","last_unstale":"2023-12-19T05:39:38.180643+0000","last_undegraded":"2023-12-19T05:39:38.180643+0000","last_fullsized":"2023-12-19T05:39:38.180643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:58:27.888624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":17,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.203907+0000","last_change":"2023-12-19T05:39:36.834231+0000","last_active":"2023-12-19T05:39:37.203907+0000","last_peered":"2023-12-19T05:39:37.203907+0000","last_clean":"2023-12-19T05:39:37.203907+0000","last_became_active":"2023-12-19T05:39:36.833976+0000","last_became_peered":"2023-12-19T05:39:36.833976+0000","last_unstale":"2023-12-19T05:39:37.203907+0000","last_undegraded":"2023-12-19T05:39:37.203907+0000","last_fullsized":"2023-12-19T05:39:37.203907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.458479+0000","last_change":"2023-12-19T05:39:37.196374+0000","last_active":"2023-12-19T05:39:38.458479+0000","last_peered":"2023-12-19T05:39:38.458479+0000","last_clean":"2023-12-19T05:39:38.458479+0000","last_became_active":"2023-12-19T05:39:37.196141+0000","last_became_peered":"2023-12-19T05:39:37.196141+0000","last_unstale":"2023-12-19T05:39:38.458479+0000","last_undegraded":"2023-12-19T05:39:38.458479+0000","last_fullsized":"2023-12-19T05:39:38.458479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:29:07.846007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.198525+0000","last_change":"2023-12-19T05:39:36.820887+0000","last_active":"2023-12-19T05:39:37.198525+0000","last_peered":"2023-12-19T05:39:37.198525+0000","last_clean":"2023-12-19T05:39:37.198525+0000","last_became_active":"2023-12-19T05:39:36.820117+0000","last_became_peered":"2023-12-19T05:39:36.820117+0000","last_unstale":"2023-12-19T05:39:37.198525+0000","last_undegraded":"2023-12-19T05:39:37.198525+0000","last_fullsized":"2023-12-19T05:39:37.198525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:25:12.013208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959329+0000","last_change":"2023-12-19T05:39:37.189407+0000","last_active":"2023-12-19T05:39:38.959329+0000","last_peered":"2023-12-19T05:39:38.959329+0000","last_clean":"2023-12-19T05:39:38.959329+0000","last_became_active":"2023-12-19T05:39:37.189095+0000","last_became_peered":"2023-12-19T05:39:37.189095+0000","last_unstale":"2023-12-19T05:39:38.959329+0000","last_undegraded":"2023-12-19T05:39:38.959329+0000","last_fullsized":"2023-12-19T05:39:38.959329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:32.341338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.181534+0000","last_change":"2023-12-19T05:39:36.831168+0000","last_active":"2023-12-19T05:39:37.181534+0000","last_peered":"2023-12-19T05:39:37.181534+0000","last_clean":"2023-12-19T05:39:37.181534+0000","last_became_active":"2023-12-19T05:39:36.830476+0000","last_became_peered":"2023-12-19T05:39:36.830476+0000","last_unstale":"2023-12-19T05:39:37.181534+0000","last_undegraded":"2023-12-19T05:39:37.181534+0000","last_fullsized":"2023-12-19T05:39:37.181534+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:04:00.332266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.960201+0000","last_change":"2023-12-19T05:39:37.191242+0000","last_active":"2023-12-19T05:39:38.960201+0000","last_peered":"2023-12-19T05:39:38.960201+0000","last_clean":"2023-12-19T05:39:38.960201+0000","last_became_active":"2023-12-19T05:39:37.190975+0000","last_became_peered":"2023-12-19T05:39:37.190975+0000","last_unstale":"2023-12-19T05:39:38.960201+0000","last_undegraded":"2023-12-19T05:39:38.960201+0000","last_fullsized":"2023-12-19T05:39:38.960201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:55:45.648562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.180390+0000","last_change":"2023-12-19T05:39:36.830673+0000","last_active":"2023-12-19T05:39:37.180390+0000","last_peered":"2023-12-19T05:39:37.180390+0000","last_clean":"2023-12-19T05:39:37.180390+0000","last_became_active":"2023-12-19T05:39:36.830425+0000","last_became_peered":"2023-12-19T05:39:36.830425+0000","last_unstale":"2023-12-19T05:39:37.180390+0000","last_undegraded":"2023-12-19T05:39:37.180390+0000","last_fullsized":"2023-12-19T05:39:37.180390+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:47:31.445497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.181924+0000","last_change":"2023-12-19T05:39:37.185941+0000","last_active":"2023-12-19T05:39:38.181924+0000","last_peered":"2023-12-19T05:39:38.181924+0000","last_clean":"2023-12-19T05:39:38.181924+0000","last_became_active":"2023-12-19T05:39:37.185649+0000","last_became_peered":"2023-12-19T05:39:37.185649+0000","last_unstale":"2023-12-19T05:39:38.181924+0000","last_undegraded":"2023-12-19T05:39:38.181924+0000","last_fullsized":"2023-12-19T05:39:38.181924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:47:32.447854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":19,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.198341+0000","last_change":"2023-12-19T05:39:36.833638+0000","last_active":"2023-12-19T05:39:37.198341+0000","last_peered":"2023-12-19T05:39:37.198341+0000","last_clean":"2023-12-19T05:39:37.198341+0000","last_became_active":"2023-12-19T05:39:36.833431+0000","last_became_peered":"2023-12-19T05:39:36.833431+0000","last_unstale":"2023-12-19T05:39:37.198341+0000","last_undegraded":"2023-12-19T05:39:37.198341+0000","last_fullsized":"2023-12-19T05:39:37.198341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:00.514986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.182450+0000","last_change":"2023-12-19T05:39:37.182635+0000","last_active":"2023-12-19T05:39:38.182450+0000","last_peered":"2023-12-19T05:39:38.182450+0000","last_clean":"2023-12-19T05:39:38.182450+0000","last_became_active":"2023-12-19T05:39:37.182373+0000","last_became_peered":"2023-12-19T05:39:37.182373+0000","last_unstale":"2023-12-19T05:39:38.182450+0000","last_undegraded":"2023-12-19T05:39:38.182450+0000","last_fullsized":"2023-12-19T05:39:38.182450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:42:28.672828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.197998+0000","last_change":"2023-12-19T05:39:36.830449+0000","last_active":"2023-12-19T05:39:37.197998+0000","last_peered":"2023-12-19T05:39:37.197998+0000","last_clean":"2023-12-19T05:39:37.197998+0000","last_became_active":"2023-12-19T05:39:36.830188+0000","last_became_peered":"2023-12-19T05:39:36.830188+0000","last_unstale":"2023-12-19T05:39:37.197998+0000","last_undegraded":"2023-12-19T05:39:37.197998+0000","last_fullsized":"2023-12-19T05:39:37.197998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:22:01.593157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.180977+0000","last_change":"2023-12-19T05:39:37.187426+0000","last_active":"2023-12-19T05:39:38.180977+0000","last_peered":"2023-12-19T05:39:38.180977+0000","last_clean":"2023-12-19T05:39:38.180977+0000","last_became_active":"2023-12-19T05:39:37.187169+0000","last_became_peered":"2023-12-19T05:39:37.187169+0000","last_unstale":"2023-12-19T05:39:38.180977+0000","last_undegraded":"2023-12-19T05:39:38.180977+0000","last_fullsized":"2023-12-19T05:39:38.180977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:17:29.247949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.196431+0000","last_change":"2023-12-19T05:39:36.823611+0000","last_active":"2023-12-19T05:39:37.196431+0000","last_peered":"2023-12-19T05:39:37.196431+0000","last_clean":"2023-12-19T05:39:37.196431+0000","last_became_active":"2023-12-19T05:39:36.823108+0000","last_became_peered":"2023-12-19T05:39:36.823108+0000","last_unstale":"2023-12-19T05:39:37.196431+0000","last_undegraded":"2023-12-19T05:39:37.196431+0000","last_fullsized":"2023-12-19T05:39:37.196431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:24:10.386915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.458626+0000","last_change":"2023-12-19T05:39:37.190830+0000","last_active":"2023-12-19T05:39:38.458626+0000","last_peered":"2023-12-19T05:39:38.458626+0000","last_clean":"2023-12-19T05:39:38.458626+0000","last_became_active":"2023-12-19T05:39:37.190616+0000","last_became_peered":"2023-12-19T05:39:37.190616+0000","last_unstale":"2023-12-19T05:39:38.458626+0000","last_undegraded":"2023-12-19T05:39:38.458626+0000","last_fullsized":"2023-12-19T05:39:38.458626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:42:28.672828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.198341+0000","last_change":"2023-12-19T05:39:36.821648+0000","last_active":"2023-12-19T05:39:37.198341+0000","last_peered":"2023-12-19T05:39:37.198341+0000","last_clean":"2023-12-19T05:39:37.198341+0000","last_became_active":"2023-12-19T05:39:36.821395+0000","last_became_peered":"2023-12-19T05:39:36.821395+0000","last_unstale":"2023-12-19T05:39:37.198341+0000","last_undegraded":"2023-12-19T05:39:37.198341+0000","last_fullsized":"2023-12-19T05:39:37.198341+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:09:30.685286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959503+0000","last_change":"2023-12-19T05:39:37.187999+0000","last_active":"2023-12-19T05:39:38.959503+0000","last_peered":"2023-12-19T05:39:38.959503+0000","last_clean":"2023-12-19T05:39:38.959503+0000","last_became_active":"2023-12-19T05:39:37.187764+0000","last_became_peered":"2023-12-19T05:39:37.187764+0000","last_unstale":"2023-12-19T05:39:38.959503+0000","last_undegraded":"2023-12-19T05:39:38.959503+0000","last_fullsized":"2023-12-19T05:39:38.959503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:30.941224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.179033+0000","last_change":"2023-12-19T05:39:36.823912+0000","last_active":"2023-12-19T05:39:37.179033+0000","last_peered":"2023-12-19T05:39:37.179033+0000","last_clean":"2023-12-19T05:39:37.179033+0000","last_became_active":"2023-12-19T05:39:36.823673+0000","last_became_peered":"2023-12-19T05:39:36.823673+0000","last_unstale":"2023-12-19T05:39:37.179033+0000","last_undegraded":"2023-12-19T05:39:37.179033+0000","last_fullsized":"2023-12-19T05:39:37.179033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:08:51.733584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959162+0000","last_change":"2023-12-19T05:39:37.186543+0000","last_active":"2023-12-19T05:39:38.959162+0000","last_peered":"2023-12-19T05:39:38.959162+0000","last_clean":"2023-12-19T05:39:38.959162+0000","last_became_active":"2023-12-19T05:39:37.186244+0000","last_became_peered":"2023-12-19T05:39:37.186244+0000","last_unstale":"2023-12-19T05:39:38.959162+0000","last_undegraded":"2023-12-19T05:39:38.959162+0000","last_fullsized":"2023-12-19T05:39:38.959162+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:24:11.389272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.198492+0000","last_change":"2023-12-19T05:39:36.831012+0000","last_active":"2023-12-19T05:39:37.198492+0000","last_peered":"2023-12-19T05:39:37.198492+0000","last_clean":"2023-12-19T05:39:37.198492+0000","last_became_active":"2023-12-19T05:39:36.830750+0000","last_became_peered":"2023-12-19T05:39:36.830750+0000","last_unstale":"2023-12-19T05:39:37.198492+0000","last_undegraded":"2023-12-19T05:39:37.198492+0000","last_fullsized":"2023-12-19T05:39:37.198492+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959345+0000","last_change":"2023-12-19T05:39:37.187476+0000","last_active":"2023-12-19T05:39:38.959345+0000","last_peered":"2023-12-19T05:39:38.959345+0000","last_clean":"2023-12-19T05:39:38.959345+0000","last_became_active":"2023-12-19T05:39:37.187213+0000","last_became_peered":"2023-12-19T05:39:37.187213+0000","last_unstale":"2023-12-19T05:39:38.959345+0000","last_undegraded":"2023-12-19T05:39:38.959345+0000","last_fullsized":"2023-12-19T05:39:38.959345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:09:31.687643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.176562+0000","last_change":"2023-12-19T05:39:36.832142+0000","last_active":"2023-12-19T05:39:37.176562+0000","last_peered":"2023-12-19T05:39:37.176562+0000","last_clean":"2023-12-19T05:39:37.176562+0000","last_became_active":"2023-12-19T05:39:36.831736+0000","last_became_peered":"2023-12-19T05:39:36.831736+0000","last_unstale":"2023-12-19T05:39:37.176562+0000","last_undegraded":"2023-12-19T05:39:37.176562+0000","last_fullsized":"2023-12-19T05:39:37.176562+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:06.383246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959158+0000","last_change":"2023-12-19T05:39:37.186935+0000","last_active":"2023-12-19T05:39:38.959158+0000","last_peered":"2023-12-19T05:39:38.959158+0000","last_clean":"2023-12-19T05:39:38.959158+0000","last_became_active":"2023-12-19T05:39:37.186672+0000","last_became_peered":"2023-12-19T05:39:37.186672+0000","last_unstale":"2023-12-19T05:39:38.959158+0000","last_undegraded":"2023-12-19T05:39:38.959158+0000","last_fullsized":"2023-12-19T05:39:38.959158+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:00:05.320631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.179921+0000","last_change":"2023-12-19T05:39:36.829392+0000","last_active":"2023-12-19T05:39:37.179921+0000","last_peered":"2023-12-19T05:39:37.179921+0000","last_clean":"2023-12-19T05:39:37.179921+0000","last_became_active":"2023-12-19T05:39:36.829126+0000","last_became_peered":"2023-12-19T05:39:36.829126+0000","last_unstale":"2023-12-19T05:39:37.179921+0000","last_undegraded":"2023-12-19T05:39:37.179921+0000","last_fullsized":"2023-12-19T05:39:37.179921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:17:54.314037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959903+0000","last_change":"2023-12-19T05:39:37.186051+0000","last_active":"2023-12-19T05:39:38.959903+0000","last_peered":"2023-12-19T05:39:38.959903+0000","last_clean":"2023-12-19T05:39:38.959903+0000","last_became_active":"2023-12-19T05:39:37.185793+0000","last_became_peered":"2023-12-19T05:39:37.185793+0000","last_unstale":"2023-12-19T05:39:38.959903+0000","last_undegraded":"2023-12-19T05:39:38.959903+0000","last_fullsized":"2023-12-19T05:39:38.959903+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:37:57.760333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.176932+0000","last_change":"2023-12-19T05:39:36.829029+0000","last_active":"2023-12-19T05:39:37.176932+0000","last_peered":"2023-12-19T05:39:37.176932+0000","last_clean":"2023-12-19T05:39:37.176932+0000","last_became_active":"2023-12-19T05:39:36.828765+0000","last_became_peered":"2023-12-19T05:39:36.828765+0000","last_unstale":"2023-12-19T05:39:37.176932+0000","last_undegraded":"2023-12-19T05:39:37.176932+0000","last_fullsized":"2023-12-19T05:39:37.176932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:15:59.578117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959539+0000","last_change":"2023-12-19T05:39:37.186329+0000","last_active":"2023-12-19T05:39:38.959539+0000","last_peered":"2023-12-19T05:39:38.959539+0000","last_clean":"2023-12-19T05:39:38.959539+0000","last_became_active":"2023-12-19T05:39:37.186073+0000","last_became_peered":"2023-12-19T05:39:37.186073+0000","last_unstale":"2023-12-19T05:39:38.959539+0000","last_undegraded":"2023-12-19T05:39:38.959539+0000","last_fullsized":"2023-12-19T05:39:38.959539+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:15:23.978574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.196890+0000","last_change":"2023-12-19T05:39:36.831958+0000","last_active":"2023-12-19T05:39:37.196890+0000","last_peered":"2023-12-19T05:39:37.196890+0000","last_clean":"2023-12-19T05:39:37.196890+0000","last_became_active":"2023-12-19T05:39:36.831662+0000","last_became_peered":"2023-12-19T05:39:36.831662+0000","last_unstale":"2023-12-19T05:39:37.196890+0000","last_undegraded":"2023-12-19T05:39:37.196890+0000","last_fullsized":"2023-12-19T05:39:37.196890+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T07:08:56.288042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.181174+0000","last_change":"2023-12-19T05:39:37.191690+0000","last_active":"2023-12-19T05:39:38.181174+0000","last_peered":"2023-12-19T05:39:38.181174+0000","last_clean":"2023-12-19T05:39:38.181174+0000","last_became_active":"2023-12-19T05:39:37.191419+0000","last_became_peered":"2023-12-19T05:39:37.191419+0000","last_unstale":"2023-12-19T05:39:38.181174+0000","last_undegraded":"2023-12-19T05:39:38.181174+0000","last_fullsized":"2023-12-19T05:39:38.181174+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:55:45.648562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.456635+0000","last_change":"2023-12-19T05:39:36.830556+0000","last_active":"2023-12-19T05:39:38.456635+0000","last_peered":"2023-12-19T05:39:38.456635+0000","last_clean":"2023-12-19T05:39:38.456635+0000","last_became_active":"2023-12-19T05:39:36.830281+0000","last_became_peered":"2023-12-19T05:39:36.830281+0000","last_unstale":"2023-12-19T05:39:38.456635+0000","last_undegraded":"2023-12-19T05:39:38.456635+0000","last_fullsized":"2023-12-19T05:39:38.456635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:18:28.935562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.456426+0000","last_change":"2023-12-19T05:39:37.191188+0000","last_active":"2023-12-19T05:39:38.456426+0000","last_peered":"2023-12-19T05:39:38.456426+0000","last_clean":"2023-12-19T05:39:38.456426+0000","last_became_active":"2023-12-19T05:39:37.190923+0000","last_became_peered":"2023-12-19T05:39:37.190923+0000","last_unstale":"2023-12-19T05:39:38.456426+0000","last_undegraded":"2023-12-19T05:39:38.456426+0000","last_fullsized":"2023-12-19T05:39:38.456426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:21:30.488810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.181578+0000","last_change":"2023-12-19T05:39:36.833305+0000","last_active":"2023-12-19T05:39:37.181578+0000","last_peered":"2023-12-19T05:39:37.181578+0000","last_clean":"2023-12-19T05:39:37.181578+0000","last_became_active":"2023-12-19T05:39:36.833035+0000","last_became_peered":"2023-12-19T05:39:36.833035+0000","last_unstale":"2023-12-19T05:39:37.181578+0000","last_undegraded":"2023-12-19T05:39:37.181578+0000","last_fullsized":"2023-12-19T05:39:37.181578+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:02:06.383246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.181737+0000","last_change":"2023-12-19T05:39:37.186649+0000","last_active":"2023-12-19T05:39:38.181737+0000","last_peered":"2023-12-19T05:39:38.181737+0000","last_clean":"2023-12-19T05:39:38.181737+0000","last_became_active":"2023-12-19T05:39:37.186395+0000","last_became_peered":"2023-12-19T05:39:37.186395+0000","last_unstale":"2023-12-19T05:39:38.181737+0000","last_undegraded":"2023-12-19T05:39:38.181737+0000","last_fullsized":"2023-12-19T05:39:38.181737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T16:16:00.580474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.177114+0000","last_change":"2023-12-19T05:39:36.825357+0000","last_active":"2023-12-19T05:39:37.177114+0000","last_peered":"2023-12-19T05:39:37.177114+0000","last_clean":"2023-12-19T05:39:37.177114+0000","last_became_active":"2023-12-19T05:39:36.825068+0000","last_became_peered":"2023-12-19T05:39:36.825068+0000","last_unstale":"2023-12-19T05:39:37.177114+0000","last_undegraded":"2023-12-19T05:39:37.177114+0000","last_fullsized":"2023-12-19T05:39:37.177114+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T12:18:47.836073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.456473+0000","last_change":"2023-12-19T05:39:37.184283+0000","last_active":"2023-12-19T05:39:38.456473+0000","last_peered":"2023-12-19T05:39:38.456473+0000","last_clean":"2023-12-19T05:39:38.456473+0000","last_became_active":"2023-12-19T05:39:37.184017+0000","last_became_peered":"2023-12-19T05:39:37.184017+0000","last_unstale":"2023-12-19T05:39:38.456473+0000","last_undegraded":"2023-12-19T05:39:38.456473+0000","last_fullsized":"2023-12-19T05:39:38.456473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T09:42:28.672828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.181627+0000","last_change":"2023-12-19T05:39:36.832313+0000","last_active":"2023-12-19T05:39:37.181627+0000","last_peered":"2023-12-19T05:39:37.181627+0000","last_clean":"2023-12-19T05:39:37.181627+0000","last_became_active":"2023-12-19T05:39:36.832072+0000","last_became_peered":"2023-12-19T05:39:36.832072+0000","last_unstale":"2023-12-19T05:39:37.181627+0000","last_undegraded":"2023-12-19T05:39:37.181627+0000","last_fullsized":"2023-12-19T05:39:37.181627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T11:13:18.741953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.959356+0000","last_change":"2023-12-19T05:39:37.192562+0000","last_active":"2023-12-19T05:39:38.959356+0000","last_peered":"2023-12-19T05:39:38.959356+0000","last_clean":"2023-12-19T05:39:38.959356+0000","last_became_active":"2023-12-19T05:39:37.191288+0000","last_became_peered":"2023-12-19T05:39:37.191288+0000","last_unstale":"2023-12-19T05:39:38.959356+0000","last_undegraded":"2023-12-19T05:39:38.959356+0000","last_fullsized":"2023-12-19T05:39:38.959356+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:06:37.161184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.180026+0000","last_change":"2023-12-19T05:39:36.825308+0000","last_active":"2023-12-19T05:39:37.180026+0000","last_peered":"2023-12-19T05:39:37.180026+0000","last_clean":"2023-12-19T05:39:37.180026+0000","last_became_active":"2023-12-19T05:39:36.825058+0000","last_became_peered":"2023-12-19T05:39:36.825058+0000","last_unstale":"2023-12-19T05:39:37.180026+0000","last_undegraded":"2023-12-19T05:39:37.180026+0000","last_fullsized":"2023-12-19T05:39:37.180026+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:15:22.976217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.182617+0000","last_change":"2023-12-19T05:39:37.192005+0000","last_active":"2023-12-19T05:39:38.182617+0000","last_peered":"2023-12-19T05:39:38.182617+0000","last_clean":"2023-12-19T05:39:38.182617+0000","last_became_active":"2023-12-19T05:39:37.191725+0000","last_became_peered":"2023-12-19T05:39:37.191725+0000","last_unstale":"2023-12-19T05:39:38.182617+0000","last_undegraded":"2023-12-19T05:39:38.182617+0000","last_fullsized":"2023-12-19T05:39:38.182617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T13:09:01.517343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.179167+0000","last_change":"2023-12-19T05:39:36.831285+0000","last_active":"2023-12-19T05:39:37.179167+0000","last_peered":"2023-12-19T05:39:37.179167+0000","last_clean":"2023-12-19T05:39:37.179167+0000","last_became_active":"2023-12-19T05:39:36.830991+0000","last_became_peered":"2023-12-19T05:39:36.830991+0000","last_unstale":"2023-12-19T05:39:37.179167+0000","last_undegraded":"2023-12-19T05:39:37.179167+0000","last_fullsized":"2023-12-19T05:39:37.179167+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T06:44:21.196968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T05:39:38.960084+0000","last_change":"2023-12-19T05:39:37.190656+0000","last_active":"2023-12-19T05:39:38.960084+0000","last_peered":"2023-12-19T05:39:38.960084+0000","last_clean":"2023-12-19T05:39:38.960084+0000","last_became_active":"2023-12-19T05:39:37.190411+0000","last_became_peered":"2023-12-19T05:39:37.190411+0000","last_unstale":"2023-12-19T05:39:38.960084+0000","last_undegraded":"2023-12-19T05:39:38.960084+0000","last_fullsized":"2023-12-19T05:39:38.960084+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:36.808267+0000","last_clean_scrub_stamp":"2023-12-19T05:39:36.808267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T14:22:32.341338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.175233+0000","last_change":"2023-12-19T05:39:36.819313+0000","last_active":"2023-12-19T05:39:37.175233+0000","last_peered":"2023-12-19T05:39:37.175233+0000","last_clean":"2023-12-19T05:39:37.175233+0000","last_became_active":"2023-12-19T05:39:36.819047+0000","last_became_peered":"2023-12-19T05:39:36.819047+0000","last_unstale":"2023-12-19T05:39:37.175233+0000","last_undegraded":"2023-12-19T05:39:37.175233+0000","last_fullsized":"2023-12-19T05:39:37.175233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:39:35.805910+0000","last_clean_scrub_stamp":"2023-12-19T05:39:35.805910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T08:59:29.938867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":172,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T05:39:37.179489+0000","last_change":"2023-12-19T05:38:47.150620+0000","last_active":"2023-12-19T05:39:37.179489+0000","last_peered":"2023-12-19T05:39:37.179489+0000","last_clean":"2023-12-19T05:39:37.179489+0000","last_became_active":"2023-12-19T05:38:47.149844+0000","last_became_peered":"2023-12-19T05:38:47.149844+0000","last_unstale":"2023-12-19T05:39:37.179489+0000","last_undegraded":"2023-12-19T05:39:37.179489+0000","last_fullsized":"2023-12-19T05:39:37.179489+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T05:38:46.034642+0000","last_clean_scrub_stamp":"2023-12-19T05:38:46.034642+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T10:14:51.920917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":946176,"data_stored":724720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":133915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":356352,"data_stored":134366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":352256,"data_stored":134332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.309}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":364544,"data_stored":135848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":916,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":937984,"data_stored":723611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T05:39:44.788 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T05:39:44.788 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T05:39:44.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.929+0000 7fbfb433c640 1 Processor -- start 2023-12-19T05:39:44.930 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.929+0000 7fbfb433c640 1 -- start start 2023-12-19T05:39:44.932 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb433c640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fbfac06a450 0x7fbfac0b8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.932 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb433c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfac1480f0 0x7fbfac141750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.932 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb433c640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbfac148530 0x7fbfac14ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.932 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb433c640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac0b87d0 con 0x7fbfac148530 2023-12-19T05:39:44.932 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb433c640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfac147930 con 0x7fbfac06a450 2023-12-19T05:39:44.932 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb433c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac0715a0 con 0x7fbfac1480f0 2023-12-19T05:39:44.932 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb28d9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbfac148530 0x7fbfac14ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.932 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb28d9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fbfac148530 0x7fbfac14ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:32946/0 (socket says 172.21.15.120:32946) 2023-12-19T05:39:44.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb28d9640 1 -- 172.21.15.120:0/3874421450 learned_addr learned my addr 172.21.15.120:0/3874421450 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:44.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb18d7640 1 --2- 172.21.15.120:0/3874421450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfac1480f0 0x7fbfac141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb20d8640 1 --2- 172.21.15.120:0/3874421450 >> v2:172.21.15.155:3300/0 conn(0x7fbfac06a450 0x7fbfac0b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb28d9640 1 -- 172.21.15.120:0/3874421450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfac1480f0 msgr2=0x7fbfac141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:44.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb28d9640 1 --2- 172.21.15.120:0/3874421450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfac1480f0 0x7fbfac141750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb28d9640 1 -- 172.21.15.120:0/3874421450 >> v2:172.21.15.155:3300/0 conn(0x7fbfac06a450 msgr2=0x7fbfac0b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:44.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb28d9640 1 --2- 172.21.15.120:0/3874421450 >> v2:172.21.15.155:3300/0 conn(0x7fbfac06a450 0x7fbfac0b8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb28d9640 1 -- 172.21.15.120:0/3874421450 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac147bd0 con 0x7fbfac148530 2023-12-19T05:39:44.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.930+0000 7fbfb20d8640 1 --2- 172.21.15.120:0/3874421450 >> v2:172.21.15.155:3300/0 conn(0x7fbfac06a450 0x7fbfac0b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:44.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.931+0000 7fbfb28d9640 1 --2- 172.21.15.120:0/3874421450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfac148530 0x7fbfac14ad90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0b7c00 tx=0x7fbfa402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40db78fb0e5ab2ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:44.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.931+0000 7fbfb10d6640 1 -- 172.21.15.120:0/3874421450 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa402cb00 con 0x7fbfac148530 2023-12-19T05:39:44.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.931+0000 7fbfb10d6640 1 -- 172.21.15.120:0/3874421450 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa402cc60 con 0x7fbfac148530 2023-12-19T05:39:44.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.931+0000 7fbfb10d6640 1 -- 172.21.15.120:0/3874421450 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40343f0 con 0x7fbfac148530 2023-12-19T05:39:44.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.931+0000 7fbfb433c640 1 -- 172.21.15.120:0/3874421450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfac148530 msgr2=0x7fbfac14ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.931+0000 7fbfb433c640 1 --2- 172.21.15.120:0/3874421450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfac148530 0x7fbfac14ad90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0b7c00 tx=0x7fbfa402bf60 comp rx=0 tx=0).stop 2023-12-19T05:39:44.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.932+0000 7fbfb433c640 1 -- 172.21.15.120:0/3874421450 shutdown_connections 2023-12-19T05:39:44.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.932+0000 7fbfb433c640 1 --2- 172.21.15.120:0/3874421450 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfac148530 0x7fbfac14ad90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.932+0000 7fbfb433c640 1 --2- 172.21.15.120:0/3874421450 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfac1480f0 0x7fbfac141750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.932+0000 7fbfb433c640 1 --2- 172.21.15.120:0/3874421450 >> v2:172.21.15.155:3300/0 conn(0x7fbfac06a450 0x7fbfac0b8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.932+0000 7fbfb433c640 1 -- 172.21.15.120:0/3874421450 >> 172.21.15.120:0/3874421450 conn(0x7fbfac0b8dd0 msgr2=0x7fbfac0b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:44.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.932+0000 7fbfb433c640 1 -- 172.21.15.120:0/3874421450 shutdown_connections 2023-12-19T05:39:44.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.932+0000 7fbfb433c640 1 -- 172.21.15.120:0/3874421450 wait complete. 2023-12-19T05:39:44.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.933+0000 7fbfb433c640 1 Processor -- start 2023-12-19T05:39:44.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.933+0000 7fbfb433c640 1 -- start start 2023-12-19T05:39:44.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.933+0000 7fbfb433c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfac06a450 0x7fbfac1dd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.933+0000 7fbfb433c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfac1480f0 0x7fbfac1d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.933+0000 7fbfb433c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfac148530 0x7fbfac13a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.933+0000 7fbfb433c640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac145d40 con 0x7fbfac1480f0 2023-12-19T05:39:44.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.933+0000 7fbfb433c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac1e0d70 con 0x7fbfac148530 2023-12-19T05:39:44.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.933+0000 7fbfb433c640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac1e1050 con 0x7fbfac06a450 2023-12-19T05:39:44.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.933+0000 7fbfb18d7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfac1480f0 0x7fbfac1d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.933+0000 7fbfb18d7640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfac1480f0 0x7fbfac1d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:32952/0 (socket says 172.21.15.120:32952) 2023-12-19T05:39:44.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.933+0000 7fbfb18d7640 1 -- 172.21.15.120:0/3677604377 learned_addr learned my addr 172.21.15.120:0/3677604377 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:44.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.933+0000 7fbfb20d8640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfac06a450 0x7fbfac1dd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.933+0000 7fbfb28d9640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfac148530 0x7fbfac13a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.934+0000 7fbfb18d7640 1 -- 172.21.15.120:0/3677604377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfac06a450 msgr2=0x7fbfac1dd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.934+0000 7fbfb18d7640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfac06a450 0x7fbfac1dd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.934+0000 7fbfb18d7640 1 -- 172.21.15.120:0/3677604377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfac148530 msgr2=0x7fbfac13a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:44.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.934+0000 7fbfb18d7640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfac148530 0x7fbfac13a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:44.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.934+0000 7fbfb18d7640 1 -- 172.21.15.120:0/3677604377 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa4009b30 con 0x7fbfac1480f0 2023-12-19T05:39:44.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.934+0000 7fbfb20d8640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfac06a450 0x7fbfac1dd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:44.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.934+0000 7fbfb28d9640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfac148530 0x7fbfac13a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:44.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.934+0000 7fbfb18d7640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfac1480f0 0x7fbfac1d0ff0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00e9b0 tx=0x7fbf9c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:44.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.934+0000 7fbfa2ffd640 1 -- 172.21.15.120:0/3677604377 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c009670 con 0x7fbfac1480f0 2023-12-19T05:39:44.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.934+0000 7fbfa2ffd640 1 -- 172.21.15.120:0/3677604377 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c00c9a0 con 0x7fbfac1480f0 2023-12-19T05:39:44.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.934+0000 7fbfb433c640 1 -- 172.21.15.120:0/3677604377 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac1e1330 con 0x7fbfac1480f0 2023-12-19T05:39:44.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.934+0000 7fbfa2ffd640 1 -- 172.21.15.120:0/3677604377 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c00cd50 con 0x7fbfac1480f0 2023-12-19T05:39:44.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.934+0000 7fbfb433c640 1 -- 172.21.15.120:0/3677604377 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac1d1c90 con 0x7fbfac1480f0 2023-12-19T05:39:44.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.935+0000 7fbfb433c640 1 -- 172.21.15.120:0/3677604377 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfac04e080 con 0x7fbfac1480f0 2023-12-19T05:39:44.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.935+0000 7fbfa2ffd640 1 -- 172.21.15.120:0/3677604377 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbf9c013470 con 0x7fbfac1480f0 2023-12-19T05:39:44.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.936+0000 7fbfa2ffd640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbf9006a430 0x7fbf9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:44.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.936+0000 7fbfa2ffd640 1 -- 172.21.15.120:0/3677604377 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf9c088b10 con 0x7fbfac1480f0 2023-12-19T05:39:44.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.936+0000 7fbfb20d8640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbf9006a430 0x7fbf9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:44.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.936+0000 7fbfb20d8640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbf9006a430 0x7fbf9006c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8006fd0 tx=0x7fbfa8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:44.941 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:44.940+0000 7fbfa2ffd640 1 -- 172.21.15.120:0/3677604377 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fbf9c054190 con 0x7fbfac1480f0 2023-12-19T05:39:45.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.170+0000 7fbfb433c640 1 -- 172.21.15.120:0/3677604377 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbfac13dab0 con 0x7fbfac1480f0 2023-12-19T05:39:45.175 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.174+0000 7fbfa2ffd640 1 -- 172.21.15.120:0/3677604377 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbf9c0170e0 con 0x7fbfac1480f0 2023-12-19T05:39:45.175 INFO:teuthology.orchestra.run.smithi120.stderr:updated caps for client.0 2023-12-19T05:39:45.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.176+0000 7fbfb433c640 1 -- 172.21.15.120:0/3677604377 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbf9006a430 msgr2=0x7fbf9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.178 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.176+0000 7fbfb433c640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbf9006a430 0x7fbf9006c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8006fd0 tx=0x7fbfa8008040 comp rx=0 tx=0).stop 2023-12-19T05:39:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.176+0000 7fbfb433c640 1 -- 172.21.15.120:0/3677604377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfac1480f0 msgr2=0x7fbfac1d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.176+0000 7fbfb433c640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfac1480f0 0x7fbfac1d0ff0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00e9b0 tx=0x7fbf9c00ee70 comp rx=0 tx=0).stop 2023-12-19T05:39:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.176+0000 7fbfb433c640 1 -- 172.21.15.120:0/3677604377 shutdown_connections 2023-12-19T05:39:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.176+0000 7fbfb433c640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fbf9006a430 0x7fbf9006c8f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.176+0000 7fbfb433c640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfac148530 0x7fbfac13a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.176+0000 7fbfb433c640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fbfac1480f0 0x7fbfac1d0ff0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.179 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.176+0000 7fbfb433c640 1 --2- 172.21.15.120:0/3677604377 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fbfac06a450 0x7fbfac1dd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.176+0000 7fbfb433c640 1 -- 172.21.15.120:0/3677604377 >> 172.21.15.120:0/3677604377 conn(0x7fbfac0b8dd0 msgr2=0x7fbfac141520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:45.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.176+0000 7fbfb433c640 1 -- 172.21.15.120:0/3677604377 shutdown_connections 2023-12-19T05:39:45.180 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.176+0000 7fbfb433c640 1 -- 172.21.15.120:0/3677604377 wait complete. 2023-12-19T05:39:45.188 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T05:39:45.290 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.286+0000 7f43b9377640 1 Processor -- start 2023-12-19T05:39:45.291 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.286+0000 7f43b9377640 1 -- start start 2023-12-19T05:39:45.291 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43b9377640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f43b40b79b0 0x7f43b40b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.291 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43b9377640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b40b8860 0x7f43b4144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.291 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43b9377640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b40b96b0 con 0x7f43b4145010 2023-12-19T05:39:45.291 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43b9377640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b414ae10 con 0x7f43b40b79b0 2023-12-19T05:39:45.291 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43b9377640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b40bacc0 con 0x7f43b40b8860 2023-12-19T05:39:45.291 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43b2ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f43b40b79b0 0x7f43b40b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.291 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43abfff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b40b8860 0x7f43b4144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.291 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43b2ffd640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f43b40b79b0 0x7f43b40b7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:34990/0 (socket says 172.21.15.120:34990) 2023-12-19T05:39:45.291 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43b37fe640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7f43b4145010 0x7f43b414b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:58896/0 (socket says 172.21.15.120:58896) 2023-12-19T05:39:45.291 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43b2ffd640 1 -- 172.21.15.120:0/1813924566 learned_addr learned my addr 172.21.15.120:0/1813924566 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:45.291 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43abfff640 1 -- 172.21.15.120:0/1813924566 >> v2:172.21.15.155:3300/0 conn(0x7f43b40b79b0 msgr2=0x7f43b40b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43abfff640 1 --2- 172.21.15.120:0/1813924566 >> v2:172.21.15.155:3300/0 conn(0x7f43b40b79b0 0x7f43b40b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43abfff640 1 -- 172.21.15.120:0/1813924566 >> v1:172.21.15.155:6789/0 conn(0x7f43b4145010 legacy=0x7f43b414b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43abfff640 1 -- 172.21.15.120:0/1813924566 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b40b90f0 con 0x7f43b40b8860 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.287+0000 7f43b2ffd640 1 --2- 172.21.15.120:0/1813924566 >> v2:172.21.15.155:3300/0 conn(0x7f43b40b79b0 0x7f43b40b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.288+0000 7f43abfff640 1 --2- 172.21.15.120:0/1813924566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b40b8860 0x7f43b4144ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f439c0097a0 tx=0x7f439c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=667050c715cedfd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.288+0000 7f43b27fc640 1 -- 172.21.15.120:0/1813924566 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c031830 con 0x7f43b40b8860 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.288+0000 7f43b27fc640 1 -- 172.21.15.120:0/1813924566 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c031990 con 0x7f43b40b8860 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.288+0000 7f43b27fc640 1 -- 172.21.15.120:0/1813924566 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c031d20 con 0x7f43b40b8860 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.289+0000 7f43b9377640 1 -- 172.21.15.120:0/1813924566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b40b8860 msgr2=0x7f43b4144ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.289+0000 7f43b9377640 1 --2- 172.21.15.120:0/1813924566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b40b8860 0x7f43b4144ad0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f439c0097a0 tx=0x7f439c02b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.289+0000 7f43b9377640 1 -- 172.21.15.120:0/1813924566 shutdown_connections 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.289+0000 7f43b9377640 1 --2- 172.21.15.120:0/1813924566 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b40b8860 0x7f43b4144ad0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.289+0000 7f43b9377640 1 --2- 172.21.15.120:0/1813924566 >> v2:172.21.15.155:3300/0 conn(0x7f43b40b79b0 0x7f43b40b7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.289+0000 7f43b9377640 1 -- 172.21.15.120:0/1813924566 >> 172.21.15.120:0/1813924566 conn(0x7f43b40c0340 msgr2=0x7f43b40c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:45.292 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.289+0000 7f43b9377640 1 -- 172.21.15.120:0/1813924566 shutdown_connections 2023-12-19T05:39:45.293 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.289+0000 7f43b9377640 1 -- 172.21.15.120:0/1813924566 wait complete. 2023-12-19T05:39:45.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.290+0000 7f43b9377640 1 Processor -- start 2023-12-19T05:39:45.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.290+0000 7f43b9377640 1 -- start start 2023-12-19T05:39:45.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.290+0000 7f43b9377640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b40b79b0 0x7f43b41d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.290+0000 7f43b9377640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b40b8860 0x7f43b41d2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.290+0000 7f43b9377640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43b4145010 0x7f43b41e3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.290+0000 7f43b9377640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b40bb280 con 0x7f43b4145010 2023-12-19T05:39:45.295 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.290+0000 7f43b9377640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b41d3780 con 0x7f43b40b8860 2023-12-19T05:39:45.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.290+0000 7f43b9377640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b41d10c0 con 0x7f43b40b79b0 2023-12-19T05:39:45.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43b37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43b4145010 0x7f43b41e3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43b37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43b4145010 0x7f43b41e3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:32964/0 (socket says 172.21.15.120:32964) 2023-12-19T05:39:45.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43b37fe640 1 -- 172.21.15.120:0/3379844181 learned_addr learned my addr 172.21.15.120:0/3379844181 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:45.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43abfff640 1 --2- 172.21.15.120:0/3379844181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b40b8860 0x7f43b41d2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43b2ffd640 1 --2- 172.21.15.120:0/3379844181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b40b79b0 0x7f43b41d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43b37fe640 1 -- 172.21.15.120:0/3379844181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b40b79b0 msgr2=0x7f43b41d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43b37fe640 1 --2- 172.21.15.120:0/3379844181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b40b79b0 0x7f43b41d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43b37fe640 1 -- 172.21.15.120:0/3379844181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b40b8860 msgr2=0x7f43b41d2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43b37fe640 1 --2- 172.21.15.120:0/3379844181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b40b8860 0x7f43b41d2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43b37fe640 1 -- 172.21.15.120:0/3379844181 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a40094d0 con 0x7f43b4145010 2023-12-19T05:39:45.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43b37fe640 1 --2- 172.21.15.120:0/3379844181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43b4145010 0x7f43b41e3410 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00c6c0 tx=0x7f43ac00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.296 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43ab7fe640 1 -- 172.21.15.120:0/3379844181 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac004d60 con 0x7f43b4145010 2023-12-19T05:39:45.297 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43ab7fe640 1 -- 172.21.15.120:0/3379844181 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac00a640 con 0x7f43b4145010 2023-12-19T05:39:45.297 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43ab7fe640 1 -- 172.21.15.120:0/3379844181 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac00a9f0 con 0x7f43b4145010 2023-12-19T05:39:45.297 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43b9377640 1 -- 172.21.15.120:0/3379844181 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c009400 con 0x7f43b4145010 2023-12-19T05:39:45.297 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.291+0000 7f43b9377640 1 -- 172.21.15.120:0/3379844181 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b41491a0 con 0x7f43b4145010 2023-12-19T05:39:45.297 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.292+0000 7f43b9377640 1 -- 172.21.15.120:0/3379844181 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b404e080 con 0x7f43b4145010 2023-12-19T05:39:45.297 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.293+0000 7f43ab7fe640 1 -- 172.21.15.120:0/3379844181 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f43ac00ab50 con 0x7f43b4145010 2023-12-19T05:39:45.297 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.293+0000 7f43ab7fe640 1 --2- 172.21.15.120:0/3379844181 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f439406a430 0x7f439406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.297 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.293+0000 7f43b2ffd640 1 --2- 172.21.15.120:0/3379844181 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f439406a430 0x7f439406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.297 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.293+0000 7f43ab7fe640 1 -- 172.21.15.120:0/3379844181 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43ac087b30 con 0x7f43b4145010 2023-12-19T05:39:45.297 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.294+0000 7f43b2ffd640 1 --2- 172.21.15.120:0/3379844181 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f439406a430 0x7f439406c8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f43a4006ca0 tx=0x7f43a4009240 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.298 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.298+0000 7f43ab7fe640 1 -- 172.21.15.120:0/3379844181 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f43ac053260 con 0x7f43b4145010 2023-12-19T05:39:45.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.500+0000 7f43b9377640 1 -- 172.21.15.120:0/3379844181 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43b40b5190 con 0x7f43b4145010 2023-12-19T05:39:45.501 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.500+0000 7f43ab7fe640 1 -- 172.21.15.120:0/3379844181 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3900 (secure 0 0 0) 0x7f43ac056880 con 0x7f43b4145010 2023-12-19T05:39:45.502 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:39:45.502 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4604,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2696557648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2696557648},{"type":"v1","addr":"172.21.15.155:6833","nonce":2696557648}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4995,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.120:6836/1519467235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6834","nonce":1519467235},{"type":"v1","addr":"172.21.15.120:6836","nonce":1519467235}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T05:39:37.170513+0000","modified":"2023-12-19T05:39:39.176361+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.120:6837/3161992983","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6835","nonce":3161992983},{"type":"v1","addr":"172.21.15.120:6837","nonce":3161992983}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T05:39:45.502 INFO:teuthology.orchestra.run.smithi120.stderr:dumped fsmap epoch 13 2023-12-19T05:39:45.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.502+0000 7f43b9377640 1 -- 172.21.15.120:0/3379844181 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f439406a430 msgr2=0x7f439406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.502+0000 7f43b9377640 1 --2- 172.21.15.120:0/3379844181 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f439406a430 0x7f439406c8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f43a4006ca0 tx=0x7f43a4009240 comp rx=0 tx=0).stop 2023-12-19T05:39:45.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.502+0000 7f43b9377640 1 -- 172.21.15.120:0/3379844181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43b4145010 msgr2=0x7f43b41e3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.502+0000 7f43b9377640 1 --2- 172.21.15.120:0/3379844181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43b4145010 0x7f43b41e3410 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00c6c0 tx=0x7f43ac00cb80 comp rx=0 tx=0).stop 2023-12-19T05:39:45.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.502+0000 7f43b9377640 1 -- 172.21.15.120:0/3379844181 shutdown_connections 2023-12-19T05:39:45.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.502+0000 7f43b9377640 1 --2- 172.21.15.120:0/3379844181 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f439406a430 0x7f439406c8f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.502+0000 7f43b9377640 1 --2- 172.21.15.120:0/3379844181 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f43b4145010 0x7f43b41e3410 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.504 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.502+0000 7f43b9377640 1 --2- 172.21.15.120:0/3379844181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43b40b8860 0x7f43b41d2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.502+0000 7f43b9377640 1 --2- 172.21.15.120:0/3379844181 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f43b40b79b0 0x7f43b41d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.502+0000 7f43b9377640 1 -- 172.21.15.120:0/3379844181 >> 172.21.15.120:0/3379844181 conn(0x7f43b40c0340 msgr2=0x7f43b40b7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:45.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.503+0000 7f43b9377640 1 -- 172.21.15.120:0/3379844181 shutdown_connections 2023-12-19T05:39:45.505 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.503+0000 7f43b9377640 1 -- 172.21.15.120:0/3379844181 wait complete. 2023-12-19T05:39:45.817 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T05:39:37.170513+0000', 'modified': '2023-12-19T05:39:39.176361+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4998}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4998': {'gid': 4998, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.120:6837/3161992983', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6835', 'nonce': 3161992983}, {'type': 'v1', 'addr': '172.21.15.120:6837', 'nonce': 3161992983}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T05:39:45.817 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T05:39:45.817 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T05:39:45.920 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.917+0000 7f21ce773640 1 Processor -- start 2023-12-19T05:39:45.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.917+0000 7f21ce773640 1 -- start start 2023-12-19T05:39:45.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.918+0000 7f21ce773640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f21c80b4790 0x7f21c806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.918+0000 7f21ce773640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f21c806ca80 0x7f21c814ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.918+0000 7f21ce773640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c80b4b70 con 0x7f21c806ae10 2023-12-19T05:39:45.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.918+0000 7f21ce773640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c806d820 con 0x7f21c806ca80 2023-12-19T05:39:45.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.918+0000 7f21ce773640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c806da70 con 0x7f21c80b4790 2023-12-19T05:39:45.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.918+0000 7f21c77fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f21c806ca80 0x7f21c814ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.918+0000 7f21ccd10640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f21c806ae10 0x7f21c814e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:50366/0 (socket says 172.21.15.120:50366) 2023-12-19T05:39:45.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.918+0000 7f21ccd10640 1 -- 172.21.15.120:0/3904597165 learned_addr learned my addr 172.21.15.120:0/3904597165 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:39:45.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.918+0000 7f21c7fff640 1 --2- 172.21.15.120:0/3904597165 >> v2:172.21.15.155:3300/0 conn(0x7f21c80b4790 0x7f21c806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.918+0000 7f21c77fe640 1 -- 172.21.15.120:0/3904597165 >> v2:172.21.15.155:3300/0 conn(0x7f21c80b4790 msgr2=0x7f21c806ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:45.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.918+0000 7f21c77fe640 1 --2- 172.21.15.120:0/3904597165 >> v2:172.21.15.155:3300/0 conn(0x7f21c80b4790 0x7f21c806ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.918+0000 7f21c77fe640 1 -- 172.21.15.120:0/3904597165 >> v1:172.21.15.120:6789/0 conn(0x7f21c806ae10 legacy=0x7f21c814e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.921 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.918+0000 7f21c77fe640 1 -- 172.21.15.120:0/3904597165 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c806dd50 con 0x7f21c806ca80 2023-12-19T05:39:45.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.918+0000 7f21c6ffd640 1 -- 172.21.15.120:0/3904597165 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993518462 0 0) 0x7f21c80b4b70 con 0x7f21c806ae10 2023-12-19T05:39:45.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.919+0000 7f21c77fe640 1 --2- 172.21.15.120:0/3904597165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21c806ca80 0x7f21c814ab90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f21c8072360 tx=0x7f21bc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b70fa77df00587 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.919+0000 7f21c6ffd640 1 -- 172.21.15.120:0/3904597165 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc031830 con 0x7f21c806ca80 2023-12-19T05:39:45.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.919+0000 7f21c6ffd640 1 -- 172.21.15.120:0/3904597165 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc031990 con 0x7f21c806ca80 2023-12-19T05:39:45.922 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.919+0000 7f21c6ffd640 1 -- 172.21.15.120:0/3904597165 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc031d20 con 0x7f21c806ca80 2023-12-19T05:39:45.925 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.920+0000 7f21ce773640 1 -- 172.21.15.120:0/3904597165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21c806ca80 msgr2=0x7f21c814ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.925 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.920+0000 7f21ce773640 1 --2- 172.21.15.120:0/3904597165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21c806ca80 0x7f21c814ab90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f21c8072360 tx=0x7f21bc02b8d0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.925 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.920+0000 7f21ce773640 1 -- 172.21.15.120:0/3904597165 shutdown_connections 2023-12-19T05:39:45.925 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.920+0000 7f21ce773640 1 --2- 172.21.15.120:0/3904597165 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21c806ca80 0x7f21c814ab90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.925 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.920+0000 7f21ce773640 1 --2- 172.21.15.120:0/3904597165 >> v2:172.21.15.155:3300/0 conn(0x7f21c80b4790 0x7f21c806ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.925 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.920+0000 7f21ce773640 1 -- 172.21.15.120:0/3904597165 >> 172.21.15.120:0/3904597165 conn(0x7f21c80bacb0 msgr2=0x7f21c80bb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:45.925 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.920+0000 7f21ce773640 1 -- 172.21.15.120:0/3904597165 shutdown_connections 2023-12-19T05:39:45.925 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.920+0000 7f21ce773640 1 -- 172.21.15.120:0/3904597165 wait complete. 2023-12-19T05:39:45.926 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.921+0000 7f21ce773640 1 Processor -- start 2023-12-19T05:39:45.926 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.921+0000 7f21ce773640 1 -- start start 2023-12-19T05:39:45.926 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21ce773640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c806ae10 0x7f21c8146c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.926 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21ce773640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21c806ca80 0x7f21c8147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.926 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21ce773640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c80b4790 0x7f21c8145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.926 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21ce773640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c8147840 con 0x7f21c806ca80 2023-12-19T05:39:45.926 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21ce773640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c81456d0 con 0x7f21c806ae10 2023-12-19T05:39:45.926 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21ce773640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c8147560 con 0x7f21c80b4790 2023-12-19T05:39:45.926 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21c77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21c806ca80 0x7f21c8147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21c77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21c806ca80 0x7f21c8147ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:32968/0 (socket says 172.21.15.120:32968) 2023-12-19T05:39:45.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21c77fe640 1 -- 172.21.15.120:0/1315121273 learned_addr learned my addr 172.21.15.120:0/1315121273 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:45.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21c7fff640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c806ae10 0x7f21c8146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21ccd10640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c80b4790 0x7f21c8145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21c77fe640 1 -- 172.21.15.120:0/1315121273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c80b4790 msgr2=0x7f21c8145b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21c77fe640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c80b4790 0x7f21c8145b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21c77fe640 1 -- 172.21.15.120:0/1315121273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c806ae10 msgr2=0x7f21c8146c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21c77fe640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c806ae10 0x7f21c8146c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21c77fe640 1 -- 172.21.15.120:0/1315121273 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc009400 con 0x7f21c806ca80 2023-12-19T05:39:45.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21c7fff640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c806ae10 0x7f21c8146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:45.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21c77fe640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21c806ca80 0x7f21c8147ba0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009890 tx=0x7f21bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21c4ff9640 1 -- 172.21.15.120:0/1315121273 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc03ba70 con 0x7f21c806ca80 2023-12-19T05:39:45.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21c4ff9640 1 -- 172.21.15.120:0/1315121273 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc03bbf0 con 0x7f21c806ca80 2023-12-19T05:39:45.927 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21ce773640 1 -- 172.21.15.120:0/1315121273 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c80b54b0 con 0x7f21c806ca80 2023-12-19T05:39:45.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21c4ff9640 1 -- 172.21.15.120:0/1315121273 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc045400 con 0x7f21c806ca80 2023-12-19T05:39:45.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.922+0000 7f21ce773640 1 -- 172.21.15.120:0/1315121273 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c8147140 con 0x7f21c806ca80 2023-12-19T05:39:45.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.924+0000 7f21c4ff9640 1 -- 172.21.15.120:0/1315121273 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f21bc04e440 con 0x7f21c806ca80 2023-12-19T05:39:45.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.924+0000 7f21c4ff9640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f21b406a460 0x7f21b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.924+0000 7f21c7fff640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f21b406a460 0x7f21b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.928 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.924+0000 7f21c4ff9640 1 -- 172.21.15.120:0/1315121273 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21bc0aab00 con 0x7f21c806ca80 2023-12-19T05:39:45.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.924+0000 7f21c7fff640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f21b406a460 0x7f21b406c920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f21b8006fd0 tx=0x7f21b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.925+0000 7f21d13bc740 1 Processor -- start 2023-12-19T05:39:45.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.925+0000 7f21d13bc740 1 -- start start 2023-12-19T05:39:45.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21d13bc740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee998420 0x564eee95c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21d13bc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee95caf0 0x564eee98d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21d13bc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee98dd00 0x564eee98e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21d13bc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eee8cc030 con 0x564eee95caf0 2023-12-19T05:39:45.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21d13bc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eee8c97c0 con 0x564eee98dd00 2023-12-19T05:39:45.934 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21d13bc740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x564eee8c50b0 con 0x564eee998420 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21c77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee95caf0 0x564eee98d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21c77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee95caf0 0x564eee98d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:32978/0 (socket says 172.21.15.120:32978) 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21c77fe640 1 -- 172.21.15.120:0/803728156 learned_addr learned my addr 172.21.15.120:0/803728156 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21c7fff640 1 --2- 172.21.15.120:0/803728156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee998420 0x564eee95c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21c77fe640 1 -- 172.21.15.120:0/803728156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee998420 msgr2=0x564eee95c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21c77fe640 1 --2- 172.21.15.120:0/803728156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee998420 0x564eee95c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21ccd10640 1 --2- 172.21.15.120:0/803728156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee98dd00 0x564eee98e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21c77fe640 1 -- 172.21.15.120:0/803728156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee98dd00 msgr2=0x564eee98e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21c77fe640 1 --2- 172.21.15.120:0/803728156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee98dd00 0x564eee98e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21c77fe640 1 -- 172.21.15.120:0/803728156 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eee87fbc0 con 0x564eee95caf0 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21c77fe640 1 --2- 172.21.15.120:0/803728156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee95caf0 0x564eee98d7c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0a90e0 tx=0x7f21bc0798b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b237e662208c11 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21adffb640 1 -- 172.21.15.120:0/803728156 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc081e20 con 0x564eee95caf0 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21adffb640 1 -- 172.21.15.120:0/803728156 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc0781e0 con 0x564eee95caf0 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.926+0000 7f21adffb640 1 -- 172.21.15.120:0/803728156 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc02f2e0 con 0x564eee95caf0 2023-12-19T05:39:45.935 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.927+0000 7f21d13bc740 1 -- 172.21.15.120:0/803728156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee95caf0 msgr2=0x564eee98d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.927+0000 7f21d13bc740 1 --2- 172.21.15.120:0/803728156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee95caf0 0x564eee98d7c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0a90e0 tx=0x7f21bc0798b0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.927+0000 7f21d13bc740 1 -- 172.21.15.120:0/803728156 shutdown_connections 2023-12-19T05:39:45.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.927+0000 7f21d13bc740 1 --2- 172.21.15.120:0/803728156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee98dd00 0x564eee98e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.927+0000 7f21d13bc740 1 --2- 172.21.15.120:0/803728156 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee95caf0 0x564eee98d7c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.927+0000 7f21d13bc740 1 --2- 172.21.15.120:0/803728156 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee998420 0x564eee95c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.927+0000 7f21d13bc740 1 -- 172.21.15.120:0/803728156 >> 172.21.15.120:0/803728156 conn(0x564eee95df80 msgr2=0x564eee997b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:45.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.927+0000 7f21d13bc740 1 -- 172.21.15.120:0/803728156 shutdown_connections 2023-12-19T05:39:45.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.927+0000 7f21d13bc740 1 -- 172.21.15.120:0/803728156 wait complete. 2023-12-19T05:39:45.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.927+0000 7f21d13bc740 1 -- start start 2023-12-19T05:39:45.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21d13bc740 1 Processor -- start 2023-12-19T05:39:45.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21d13bc740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee98dd00 0x564eee98cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21d13bc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee998420 0x564eee98d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21d13bc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 0x564eee9a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21d13bc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eee8837c0 con 0x564eee998420 2023-12-19T05:39:45.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21d13bc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eee883460 con 0x564eee987fb0 2023-12-19T05:39:45.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21d13bc740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x564eee8491b0 con 0x564eee98dd00 2023-12-19T05:39:45.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21d13bc740 10 client.0 _ll_register_callbacks cb 0x564eee84c6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:39:45.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21c77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee998420 0x564eee98d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21c77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee998420 0x564eee98d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:32982/0 (socket says 172.21.15.120:32982) 2023-12-19T05:39:45.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21c77fe640 1 -- 172.21.15.120:0/2013309087 learned_addr learned my addr 172.21.15.120:0/2013309087 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:45.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21ccd10640 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 0x564eee9a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21c7fff640 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee98dd00 0x564eee98cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.937 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21c77fe640 1 -- 172.21.15.120:0/2013309087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee98dd00 msgr2=0x564eee98cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:45.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21c77fe640 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee98dd00 0x564eee98cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21c77fe640 1 -- 172.21.15.120:0/2013309087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 msgr2=0x564eee9a3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:45.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21c77fe640 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 0x564eee9a3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21c77fe640 1 -- 172.21.15.120:0/2013309087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c8147140 con 0x564eee998420 2023-12-19T05:39:45.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21ccd10640 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 0x564eee9a3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:45.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.928+0000 7f21c7fff640 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee98dd00 0x564eee98cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:39:45.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21c77fe640 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee998420 0x564eee98d120 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f21bc006ce0 tx=0x7f21bc006f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7ca59964c6bfed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2023-12-19T05:39:45.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21a6ffd640 1 -- 172.21.15.120:0/2013309087 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc02f4e0 con 0x564eee998420 2023-12-19T05:39:45.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21a6ffd640 1 -- 172.21.15.120:0/2013309087 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21bc098270 con 0x564eee998420 2023-12-19T05:39:45.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21d13bc740 1 -- 172.21.15.120:0/2013309087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564eee8b69e0 con 0x564eee998420 2023-12-19T05:39:45.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21a6ffd640 1 -- 172.21.15.120:0/2013309087 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21bc098430 con 0x564eee998420 2023-12-19T05:39:45.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21d13bc740 10 client.5190 fetch_fsmap learned FSMap version 13 2023-12-19T05:39:45.938 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21d13bc740 1 -- 172.21.15.120:0/2013309087 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x564eee8c3730 con 0x564eee998420 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21a6ffd640 1 -- 172.21.15.120:0/2013309087 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564eee8b69e0 con 0x564eee998420 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21a6ffd640 1 -- 172.21.15.120:0/2013309087 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 13) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f21bc04c060 con 0x564eee998420 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21d13bc740 10 client.5190 fetch_fsmap finished waiting for FSMap version 13 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21d13bc740 10 client.5190 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21d13bc740 20 client.5190 populate_metadata read hostname 'smithi120' 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21d13bc740 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.120:6835/3161992983,v1:172.21.15.120:6837/3161992983] conn(0x564eee9a41c0 0x564eee9a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21d13bc740 4 client.5190 mds_command: new command op to 4998 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21d13bc740 1 -- 172.21.15.120:0/2013309087 --> [v2:172.21.15.120:6835/3161992983,v1:172.21.15.120:6837/3161992983] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564eee8be130 con 0x564eee9a41c0 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21c7fff640 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.120:6835/3161992983,v1:172.21.15.120:6837/3161992983] conn(0x564eee9a41c0 0x564eee9a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21a6ffd640 10 client.5190 ms_handle_connect on v2:172.21.15.120:6835/3161992983 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.929+0000 7f21c7fff640 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.120:6835/3161992983,v1:172.21.15.120:6837/3161992983] conn(0x564eee9a41c0 0x564eee9a45a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=957802a51e0d978e server_cookie=a132276fc2b02744 in_seq=0 out_seq=0 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21a6ffd640 1 -- 172.21.15.120:0/2013309087 <== mds.0 v2:172.21.15.120:6835/3161992983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x564eee8be130 con 0x564eee9a41c0 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21a6ffd640 10 client.5190 handle_command_reply: tid=0 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21d13bc740 1 client.5190 shutdown 2023-12-19T05:39:45.939 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21d13bc740 1 -- 172.21.15.120:0/2013309087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee998420 msgr2=0x564eee98d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21d13bc740 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee998420 0x564eee98d120 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f21bc006ce0 tx=0x7f21bc006f40 comp rx=0 tx=0).stop 2023-12-19T05:39:45.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21d13bc740 1 -- 172.21.15.120:0/2013309087 shutdown_connections 2023-12-19T05:39:45.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21d13bc740 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.120:6835/3161992983,v1:172.21.15.120:6837/3161992983] conn(0x564eee9a41c0 0x564eee9a45a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21d13bc740 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 0x564eee9a3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21d13bc740 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee998420 0x564eee98d120 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21a6ffd640 0 client.5190 ms_handle_reset on v2:172.21.15.120:6835/3161992983 2023-12-19T05:39:45.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21d13bc740 1 --2- 172.21.15.120:0/2013309087 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee98dd00 0x564eee98cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21d13bc740 1 -- 172.21.15.120:0/2013309087 >> 172.21.15.120:0/2013309087 conn(0x564eee95caf0 msgr2=0x564eee997910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:45.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21d13bc740 1 -- 172.21.15.120:0/2013309087 shutdown_connections 2023-12-19T05:39:45.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21d13bc740 1 -- 172.21.15.120:0/2013309087 wait complete. 2023-12-19T05:39:45.940 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.930+0000 7f21d13bc740 20 client.5190 trim_cache size 0 max 16384 2023-12-19T05:39:45.954 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21d13bc740 1 Processor -- start 2023-12-19T05:39:45.954 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21d13bc740 1 -- start start 2023-12-19T05:39:45.954 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21d13bc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 0x564eee992550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.954 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21d13bc740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee98dd00 0x564eee95fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.954 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21d13bc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee998420 0x564eee960420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.954 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21d13bc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eee95ced0 con 0x564eee998420 2023-12-19T05:39:45.954 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21d13bc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eee98db70 con 0x564eee987fb0 2023-12-19T05:39:45.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21d13bc740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x564eee987280 con 0x564eee98dd00 2023-12-19T05:39:45.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21ccd10640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee998420 0x564eee960420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21ccd10640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee998420 0x564eee960420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:32994/0 (socket says 172.21.15.120:32994) 2023-12-19T05:39:45.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21ccd10640 1 -- 172.21.15.120:0/1680080989 learned_addr learned my addr 172.21.15.120:0/1680080989 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:45.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21ccd10640 1 -- 172.21.15.120:0/1680080989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee98dd00 msgr2=0x564eee95fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:45.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21ccd10640 1 --2- 172.21.15.120:0/1680080989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee98dd00 0x564eee95fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21ccd10640 1 -- 172.21.15.120:0/1680080989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 msgr2=0x564eee992550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:45.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.946+0000 7f21ccd10640 1 --2- 172.21.15.120:0/1680080989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 0x564eee992550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.947+0000 7f21ccd10640 1 -- 172.21.15.120:0/1680080989 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eee865b60 con 0x564eee998420 2023-12-19T05:39:45.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.947+0000 7f21ccd10640 1 --2- 172.21.15.120:0/1680080989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee998420 0x564eee960420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f21c00012e0 tx=0x7f21c0010610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c01a9605228abf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.947+0000 7f21ae7fc640 1 -- 172.21.15.120:0/1680080989 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0014660 con 0x564eee998420 2023-12-19T05:39:45.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.947+0000 7f21ae7fc640 1 -- 172.21.15.120:0/1680080989 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c000d040 con 0x564eee998420 2023-12-19T05:39:45.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.947+0000 7f21ae7fc640 1 -- 172.21.15.120:0/1680080989 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c0014a20 con 0x564eee998420 2023-12-19T05:39:45.955 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.947+0000 7f21d13bc740 1 -- 172.21.15.120:0/1680080989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee998420 msgr2=0x564eee960420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.947+0000 7f21d13bc740 1 --2- 172.21.15.120:0/1680080989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee998420 0x564eee960420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f21c00012e0 tx=0x7f21c0010610 comp rx=0 tx=0).stop 2023-12-19T05:39:45.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.947+0000 7f21d13bc740 1 -- 172.21.15.120:0/1680080989 shutdown_connections 2023-12-19T05:39:45.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.947+0000 7f21d13bc740 1 --2- 172.21.15.120:0/1680080989 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee998420 0x564eee960420 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.947+0000 7f21d13bc740 1 --2- 172.21.15.120:0/1680080989 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee98dd00 0x564eee95fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.947+0000 7f21d13bc740 1 --2- 172.21.15.120:0/1680080989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 0x564eee992550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.947+0000 7f21d13bc740 1 -- 172.21.15.120:0/1680080989 >> 172.21.15.120:0/1680080989 conn(0x564eee95caf0 msgr2=0x564eee95d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:45.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.947+0000 7f21d13bc740 1 -- 172.21.15.120:0/1680080989 shutdown_connections 2023-12-19T05:39:45.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.947+0000 7f21d13bc740 1 -- 172.21.15.120:0/1680080989 wait complete. 2023-12-19T05:39:45.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.948+0000 7f21d13bc740 1 -- start start 2023-12-19T05:39:45.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.948+0000 7f21d13bc740 1 Processor -- start 2023-12-19T05:39:45.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21d13bc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 0x564eee9a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21d13bc740 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee98dd00 0x564eee99a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21d13bc740 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee998420 0x564eee9fd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.956 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21d13bc740 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eee960750 con 0x564eee98dd00 2023-12-19T05:39:45.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21d13bc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eee9fa9e0 con 0x564eee987fb0 2023-12-19T05:39:45.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21d13bc740 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x564eee9605a0 con 0x564eee998420 2023-12-19T05:39:45.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21d13bc740 10 client.0 _ll_register_callbacks cb 0x7f21bc006c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T05:39:45.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21c77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee98dd00 0x564eee99a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21c77fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee98dd00 0x564eee99a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:32998/0 (socket says 172.21.15.120:32998) 2023-12-19T05:39:45.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21c77fe640 1 -- 172.21.15.120:0/968605018 learned_addr learned my addr 172.21.15.120:0/968605018 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:45.957 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21ccd10640 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee998420 0x564eee9fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21c7fff640 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 0x564eee9a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21c77fe640 1 -- 172.21.15.120:0/968605018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee998420 msgr2=0x564eee9fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21c77fe640 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee998420 0x564eee9fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21c77fe640 1 -- 172.21.15.120:0/968605018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 msgr2=0x564eee9a0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21c77fe640 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 0x564eee9a0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21c77fe640 1 -- 172.21.15.120:0/968605018 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c0001cc0 con 0x564eee98dd00 2023-12-19T05:39:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21ccd10640 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee998420 0x564eee9fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21c7fff640 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 0x564eee9a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21c77fe640 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee98dd00 0x564eee99a680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f21bc000c00 tx=0x7f21bc0a8f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acc2944b824a746 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21a6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.120:3300/0 2023-12-19T05:39:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21a6ffd640 1 -- 172.21.15.120:0/968605018 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc098470 con 0x564eee98dd00 2023-12-19T05:39:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21a6ffd640 1 -- 172.21.15.120:0/968605018 <== mon.0 v2:172.21.15.120:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21bc081990 con 0x564eee98dd00 2023-12-19T05:39:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.949+0000 7f21d13bc740 1 -- 172.21.15.120:0/968605018 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f21bc0781e0 con 0x564eee98dd00 2023-12-19T05:39:45.958 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21a6ffd640 1 -- 172.21.15.120:0/968605018 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21bc081b50 con 0x564eee98dd00 2023-12-19T05:39:45.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21d13bc740 10 client.5196 fetch_fsmap learned FSMap version 13 2023-12-19T05:39:45.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21d13bc740 1 -- 172.21.15.120:0/968605018 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x564eee88b270 con 0x564eee98dd00 2023-12-19T05:39:45.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21a6ffd640 1 -- 172.21.15.120:0/968605018 <== mon.0 v2:172.21.15.120:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc087080 con 0x564eee98dd00 2023-12-19T05:39:45.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21a6ffd640 1 -- 172.21.15.120:0/968605018 <== mon.0 v2:172.21.15.120:3300/0 5 ==== fsmap(e 13) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f21bc04c040 con 0x564eee98dd00 2023-12-19T05:39:45.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21d13bc740 10 client.5196 fetch_fsmap finished waiting for FSMap version 13 2023-12-19T05:39:45.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21d13bc740 10 client.5196 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T05:39:45.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21d13bc740 20 client.5196 populate_metadata read hostname 'smithi120' 2023-12-19T05:39:45.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21d13bc740 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.120:6835/3161992983,v1:172.21.15.120:6837/3161992983] conn(0x564eee9fdc40 0x564eee9fe020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:45.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21d13bc740 4 client.5196 mds_command: new command op to 4998 tid=0[{"prefix": "status"}] 2023-12-19T05:39:45.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21d13bc740 1 -- 172.21.15.120:0/968605018 --> [v2:172.21.15.120:6835/3161992983,v1:172.21.15.120:6837/3161992983] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564eee8bde50 con 0x564eee9fdc40 2023-12-19T05:39:45.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21c7fff640 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.120:6835/3161992983,v1:172.21.15.120:6837/3161992983] conn(0x564eee9fdc40 0x564eee9fe020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:45.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21a6ffd640 10 client.5196 ms_handle_connect on v2:172.21.15.120:6835/3161992983 2023-12-19T05:39:45.959 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21c7fff640 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.120:6835/3161992983,v1:172.21.15.120:6837/3161992983] conn(0x564eee9fdc40 0x564eee9fe020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=760e52c5f4810093 server_cookie=936277db7dce5aac in_seq=0 out_seq=0 2023-12-19T05:39:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21a6ffd640 1 -- 172.21.15.120:0/968605018 <== mds.0 v2:172.21.15.120:6835/3161992983 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x564eee8bde50 con 0x564eee9fdc40 2023-12-19T05:39:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21a6ffd640 10 client.5196 handle_command_reply: tid=0 2023-12-19T05:39:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.950+0000 7f21d13bc740 1 client.5196 shutdown 2023-12-19T05:39:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21d13bc740 1 -- 172.21.15.120:0/968605018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee98dd00 msgr2=0x564eee99a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21d13bc740 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee98dd00 0x564eee99a680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f21bc000c00 tx=0x7f21bc0a8f90 comp rx=0 tx=0).stop 2023-12-19T05:39:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21d13bc740 1 -- 172.21.15.120:0/968605018 shutdown_connections 2023-12-19T05:39:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21d13bc740 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.120:6835/3161992983,v1:172.21.15.120:6837/3161992983] conn(0x564eee9fdc40 0x564eee9fe020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21d13bc740 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x564eee998420 0x564eee9fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21a6ffd640 0 client.5196 ms_handle_reset on v2:172.21.15.120:6835/3161992983 2023-12-19T05:39:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21d13bc740 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x564eee98dd00 0x564eee99a680 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21d13bc740 1 --2- 172.21.15.120:0/968605018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564eee987fb0 0x564eee9a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21d13bc740 1 -- 172.21.15.120:0/968605018 >> 172.21.15.120:0/968605018 conn(0x564eee95caf0 msgr2=0x564eee95d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21d13bc740 1 -- 172.21.15.120:0/968605018 shutdown_connections 2023-12-19T05:39:45.960 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21d13bc740 1 -- 172.21.15.120:0/968605018 wait complete. 2023-12-19T05:39:45.961 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21d13bc740 20 client.5196 trim_cache size 0 max 16384 2023-12-19T05:39:45.961 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2023-12-19T05:39:45.961 INFO:teuthology.orchestra.run.smithi120.stdout: "cluster_fsid": "90961127-a1a1-4949-bae3-e6c73f63cc7e", 2023-12-19T05:39:45.961 INFO:teuthology.orchestra.run.smithi120.stdout: "whoami": 0, 2023-12-19T05:39:45.961 INFO:teuthology.orchestra.run.smithi120.stdout: "id": 4998, 2023-12-19T05:39:45.961 INFO:teuthology.orchestra.run.smithi120.stdout: "want_state": "up:active", 2023-12-19T05:39:45.961 INFO:teuthology.orchestra.run.smithi120.stdout: "state": "up:active", 2023-12-19T05:39:45.961 INFO:teuthology.orchestra.run.smithi120.stdout: "fs_name": "cephfs", 2023-12-19T05:39:45.961 INFO:teuthology.orchestra.run.smithi120.stdout: "rank_uptime": 8.7793140849999993, 2023-12-19T05:39:45.962 INFO:teuthology.orchestra.run.smithi120.stdout: "mdsmap_epoch": 13, 2023-12-19T05:39:45.962 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch": 31, 2023-12-19T05:39:45.962 INFO:teuthology.orchestra.run.smithi120.stdout: "osdmap_epoch_barrier": 31, 2023-12-19T05:39:45.962 INFO:teuthology.orchestra.run.smithi120.stdout: "uptime": 15.014598836999999 2023-12-19T05:39:45.962 INFO:teuthology.orchestra.run.smithi120.stdout:} 2023-12-19T05:39:45.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21ce773640 1 -- 172.21.15.120:0/1315121273 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f21b406a460 msgr2=0x7f21b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21ce773640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f21b406a460 0x7f21b406c920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f21b8006fd0 tx=0x7f21b8008040 comp rx=0 tx=0).stop 2023-12-19T05:39:45.963 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21ce773640 1 -- 172.21.15.120:0/1315121273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21c806ca80 msgr2=0x7f21c8147ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:45.964 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21ce773640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21c806ca80 0x7f21c8147ba0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009890 tx=0x7f21bc0046c0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.964 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21ce773640 1 -- 172.21.15.120:0/1315121273 shutdown_connections 2023-12-19T05:39:45.964 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21ce773640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f21b406a460 0x7f21b406c920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.964 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21ce773640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f21c80b4790 0x7f21c8145b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.964 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21ce773640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f21c806ca80 0x7f21c8147ba0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.964 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21ce773640 1 --2- 172.21.15.120:0/1315121273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c806ae10 0x7f21c8146c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:45.964 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21ce773640 1 -- 172.21.15.120:0/1315121273 >> 172.21.15.120:0/1315121273 conn(0x7f21c80bacb0 msgr2=0x7f21c80b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:45.964 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21ce773640 1 -- 172.21.15.120:0/1315121273 shutdown_connections 2023-12-19T05:39:45.964 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:45.951+0000 7f21ce773640 1 -- 172.21.15.120:0/1315121273 wait complete. 2023-12-19T05:39:45.965 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T05:39:46.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.062+0000 7f32a93c9640 1 Processor -- start 2023-12-19T05:39:46.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.062+0000 7f32a93c9640 1 -- start start 2023-12-19T05:39:46.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.063+0000 7f32a93c9640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f32a40b79b0 0x7f32a40b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.063+0000 7f32a93c9640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f32a414b230 0x7f32a414b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.063+0000 7f32a93c9640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a40b96b0 con 0x7f32a40b8860 2023-12-19T05:39:46.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.063+0000 7f32a93c9640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a414ae10 con 0x7f32a40b79b0 2023-12-19T05:39:46.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.063+0000 7f32a93c9640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a40bacc0 con 0x7f32a414b230 2023-12-19T05:39:46.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.063+0000 7f32a2ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f32a40b79b0 0x7f32a40b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.063+0000 7f32a2ffd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f32a40b79b0 0x7f32a40b7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33012/0 (socket says 172.21.15.120:33012) 2023-12-19T05:39:46.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.063+0000 7f32a2ffd640 1 -- 172.21.15.120:0/2032461588 learned_addr learned my addr 172.21.15.120:0/2032461588 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:46.066 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.063+0000 7f32a37fe640 1 --2- 172.21.15.120:0/2032461588 >> v2:172.21.15.155:3300/0 conn(0x7f32a414b230 0x7f32a414b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.063+0000 7f32a2ffd640 1 -- 172.21.15.120:0/2032461588 >> v2:172.21.15.155:3300/0 conn(0x7f32a414b230 msgr2=0x7f32a414b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.063+0000 7f32a2ffd640 1 --2- 172.21.15.120:0/2032461588 >> v2:172.21.15.155:3300/0 conn(0x7f32a414b230 0x7f32a414b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.063+0000 7f32a2ffd640 1 -- 172.21.15.120:0/2032461588 >> v1:172.21.15.155:6789/0 conn(0x7f32a40b8860 legacy=0x7f32a4144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.063+0000 7f32a2ffd640 1 -- 172.21.15.120:0/2032461588 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a40b90f0 con 0x7f32a40b79b0 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.063+0000 7f32a37fe640 1 --2- 172.21.15.120:0/2032461588 >> v2:172.21.15.155:3300/0 conn(0x7f32a414b230 0x7f32a414b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.064+0000 7f32a2ffd640 1 --2- 172.21.15.120:0/2032461588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32a40b79b0 0x7f32a40b7d90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f32a40bde20 tx=0x7f329402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800e1fb7be526070 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.064+0000 7f32a1ffb640 1 -- 172.21.15.120:0/2032461588 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329402cb20 con 0x7f32a40b79b0 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.064+0000 7f32a1ffb640 1 -- 172.21.15.120:0/2032461588 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329402cc80 con 0x7f32a40b79b0 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.064+0000 7f32a1ffb640 1 -- 172.21.15.120:0/2032461588 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32940343f0 con 0x7f32a40b79b0 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.065+0000 7f32a93c9640 1 -- 172.21.15.120:0/2032461588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32a40b79b0 msgr2=0x7f32a40b7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.065+0000 7f32a93c9640 1 --2- 172.21.15.120:0/2032461588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32a40b79b0 0x7f32a40b7d90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f32a40bde20 tx=0x7f329402bf80 comp rx=0 tx=0).stop 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.065+0000 7f32a93c9640 1 -- 172.21.15.120:0/2032461588 shutdown_connections 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.065+0000 7f32a93c9640 1 --2- 172.21.15.120:0/2032461588 >> v2:172.21.15.155:3300/0 conn(0x7f32a414b230 0x7f32a414b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.065+0000 7f32a93c9640 1 --2- 172.21.15.120:0/2032461588 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32a40b79b0 0x7f32a40b7d90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.065+0000 7f32a93c9640 1 -- 172.21.15.120:0/2032461588 >> 172.21.15.120:0/2032461588 conn(0x7f32a40c0340 msgr2=0x7f32a40c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:46.068 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.065+0000 7f32a93c9640 1 -- 172.21.15.120:0/2032461588 shutdown_connections 2023-12-19T05:39:46.068 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.065+0000 7f32a93c9640 1 -- 172.21.15.120:0/2032461588 wait complete. 2023-12-19T05:39:46.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.066+0000 7f32a93c9640 1 Processor -- start 2023-12-19T05:39:46.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.066+0000 7f32a93c9640 1 -- start start 2023-12-19T05:39:46.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.066+0000 7f32a93c9640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32a40b79b0 0x7f32a409d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.066+0000 7f32a93c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32a40b8860 0x7f32a40a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.066+0000 7f32a93c9640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32a414b230 0x7f32a40a60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.066+0000 7f32a93c9640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a409dd00 con 0x7f32a414b230 2023-12-19T05:39:46.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.066+0000 7f32a93c9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a409f400 con 0x7f32a40b8860 2023-12-19T05:39:46.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.066+0000 7f32a93c9640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a41e3530 con 0x7f32a40b79b0 2023-12-19T05:39:46.070 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32a414b230 0x7f32a40a60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a37fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32a414b230 0x7f32a40a60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33020/0 (socket says 172.21.15.120:33020) 2023-12-19T05:39:46.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a37fe640 1 -- 172.21.15.120:0/3207729957 learned_addr learned my addr 172.21.15.120:0/3207729957 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:39:46.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a2ffd640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32a40b79b0 0x7f32a409d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a27fc640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32a40b8860 0x7f32a40a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a37fe640 1 -- 172.21.15.120:0/3207729957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32a40b79b0 msgr2=0x7f32a409d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a37fe640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32a40b79b0 0x7f32a409d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a37fe640 1 -- 172.21.15.120:0/3207729957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32a40b8860 msgr2=0x7f32a40a5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a37fe640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32a40b8860 0x7f32a40a5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a37fe640 1 -- 172.21.15.120:0/3207729957 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294009b30 con 0x7f32a414b230 2023-12-19T05:39:46.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a27fc640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32a40b8860 0x7f32a40a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:46.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a2ffd640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32a40b79b0 0x7f32a409d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T05:39:46.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a37fe640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32a414b230 0x7f32a40a60d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f329c00d7d0 tx=0x7f329c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:46.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f328b7fe640 1 -- 172.21.15.120:0/3207729957 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c004030 con 0x7f32a414b230 2023-12-19T05:39:46.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f328b7fe640 1 -- 172.21.15.120:0/3207729957 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c004190 con 0x7f32a414b230 2023-12-19T05:39:46.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a93c9640 1 -- 172.21.15.120:0/3207729957 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a41e3810 con 0x7f32a414b230 2023-12-19T05:39:46.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f328b7fe640 1 -- 172.21.15.120:0/3207729957 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c004500 con 0x7f32a414b230 2023-12-19T05:39:46.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.067+0000 7f32a93c9640 1 -- 172.21.15.120:0/3207729957 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a41e3dd0 con 0x7f32a414b230 2023-12-19T05:39:46.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.068+0000 7f32a93c9640 1 -- 172.21.15.120:0/3207729957 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a404e080 con 0x7f32a414b230 2023-12-19T05:39:46.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.069+0000 7f328b7fe640 1 -- 172.21.15.120:0/3207729957 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f329c0096a0 con 0x7f32a414b230 2023-12-19T05:39:46.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.069+0000 7f328b7fe640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f329006a430 0x7f329006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:39:46.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.069+0000 7f32a2ffd640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f329006a430 0x7f329006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:39:46.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.069+0000 7f328b7fe640 1 -- 172.21.15.120:0/3207729957 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f329c088b40 con 0x7f32a414b230 2023-12-19T05:39:46.073 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.070+0000 7f32a2ffd640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f329006a430 0x7f329006c8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3294035000 tx=0x7f3294030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:39:46.074 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.073+0000 7f328b7fe640 1 -- 172.21.15.120:0/3207729957 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f329c054130 con 0x7f32a414b230 2023-12-19T05:39:46.275 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.274+0000 7f32a93c9640 1 -- 172.21.15.120:0/3207729957 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f32a40b68a0 con 0x7f32a414b230 2023-12-19T05:39:46.276 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.274+0000 7f328b7fe640 1 -- 172.21.15.120:0/3207729957 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f329c057750 con 0x7f32a414b230 2023-12-19T05:39:46.276 INFO:teuthology.orchestra.run.smithi120.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T05:39:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.276+0000 7f32a93c9640 1 -- 172.21.15.120:0/3207729957 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f329006a430 msgr2=0x7f329006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.276+0000 7f32a93c9640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f329006a430 0x7f329006c8f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3294035000 tx=0x7f3294030000 comp rx=0 tx=0).stop 2023-12-19T05:39:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.276+0000 7f32a93c9640 1 -- 172.21.15.120:0/3207729957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32a414b230 msgr2=0x7f32a40a60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:39:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.276+0000 7f32a93c9640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32a414b230 0x7f32a40a60d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f329c00d7d0 tx=0x7f329c00dc90 comp rx=0 tx=0).stop 2023-12-19T05:39:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.276+0000 7f32a93c9640 1 -- 172.21.15.120:0/3207729957 shutdown_connections 2023-12-19T05:39:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.276+0000 7f32a93c9640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f329006a430 0x7f329006c8f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.278 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.276+0000 7f32a93c9640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f32a414b230 0x7f32a40a60d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.276+0000 7f32a93c9640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f32a40b8860 0x7f32a40a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.276+0000 7f32a93c9640 1 --2- 172.21.15.120:0/3207729957 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f32a40b79b0 0x7f32a409d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:39:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.276+0000 7f32a93c9640 1 -- 172.21.15.120:0/3207729957 >> 172.21.15.120:0/3207729957 conn(0x7f32a40c0340 msgr2=0x7f32a414a140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:39:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.276+0000 7f32a93c9640 1 -- 172.21.15.120:0/3207729957 shutdown_connections 2023-12-19T05:39:46.279 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:39:46.276+0000 7f32a93c9640 1 -- 172.21.15.120:0/3207729957 wait complete. 2023-12-19T05:39:46.288 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T05:39:46.288 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T05:39:46.288 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi188.front.sepia.ceph.com 2023-12-19T05:39:46.289 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T05:39:46.289 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T05:39:46.289 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T05:39:46.289 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T05:39:46.289 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T05:39:46.289 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:39:46.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:46.289 DEBUG:teuthology.orchestra.run.smithi188:> ip addr 2023-12-19T05:39:46.351 INFO:teuthology.orchestra.run.smithi188.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T05:39:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T05:39:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T05:39:46.351 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 ::1/128 scope host 2023-12-19T05:39:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:46.352 INFO:teuthology.orchestra.run.smithi188.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:48 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f0 2023-12-19T05:39:46.352 INFO:teuthology.orchestra.run.smithi188.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:d9:37:49 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: altname enp7s0f1 2023-12-19T05:39:46.352 INFO:teuthology.orchestra.run.smithi188.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-19T05:39:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:38 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:46.352 INFO:teuthology.orchestra.run.smithi188.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T05:39:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 0c:c4:7a:88:80:39 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: inet 172.21.15.188/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-19T05:39:46.352 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft 42334sec preferred_lft 42334sec 2023-12-19T05:39:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::ec4:7aff:fe88:8039/64 scope link 2023-12-19T05:39:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:46.353 INFO:teuthology.orchestra.run.smithi188.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T05:39:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 96:15:74:c7:26:29 brd ff:ff:ff:ff:ff:ff 2023-12-19T05:39:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T05:39:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::d456:e5ff:fe4c:a58f/64 scope link 2023-12-19T05:39:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:46.353 INFO:teuthology.orchestra.run.smithi188.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T05:39:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: link/ether 96:15:74:c7:26:29 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T05:39:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: inet6 fe80::9415:74ff:fec7:2629/64 scope link 2023-12-19T05:39:46.353 INFO:teuthology.orchestra.run.smithi188.stdout: valid_lft forever preferred_lft forever 2023-12-19T05:39:46.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:46.355 DEBUG:teuthology.orchestra.run.smithi188:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T05:39:46.449 INFO:teuthology.orchestra.run.smithi188.stdout:1 2023-12-19T05:39:46.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:46.453 DEBUG:teuthology.orchestra.run.smithi188:> route 2023-12-19T05:39:46.507 INFO:teuthology.orchestra.run.smithi188.stdout:Kernel IP routing table 2023-12-19T05:39:46.507 INFO:teuthology.orchestra.run.smithi188.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T05:39:46.507 INFO:teuthology.orchestra.run.smithi188.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T05:39:46.507 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T05:39:46.507 INFO:teuthology.orchestra.run.smithi188.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T05:39:46.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:46.508 DEBUG:teuthology.orchestra.run.smithi188:> (cd / && exec bash -c ' 2023-12-19T05:39:46.508 DEBUG:teuthology.orchestra.run.smithi188:> set -e 2023-12-19T05:39:46.509 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T05:39:46.509 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T05:39:46.509 DEBUG:teuthology.orchestra.run.smithi188:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T05:39:46.509 DEBUG:teuthology.orchestra.run.smithi188:> ') 2023-12-19T05:39:46.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:46.689 DEBUG:teuthology.orchestra.run.smithi188:> ip netns list 2023-12-19T05:39:46.742 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T05:39:46.742 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:39:46.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:46.742 DEBUG:teuthology.orchestra.run.smithi188:> sudo ip link set brx.0 up 2023-12-19T05:39:46.840 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:39:46.841 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T05:39:46.896 INFO:teuthology.orchestra.run.smithi188.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T05:39:46.896 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T05:39:46.896 DEBUG:teuthology.orchestra.run.smithi188:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:39:46.948 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-19T05:39:46.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:46.949 DEBUG:teuthology.orchestra.run.smithi188:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T05:39:47.087 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T05:39:47.087 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T05:39:47.087 INFO:teuthology.orchestra.run.smithi188.stdout:invalid new device string format 2023-12-19T05:39:47.109 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T05:39:47.109 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T05:39:47.109 INFO:teuthology.orchestra.run.smithi188.stdout:invalid new device string format 2023-12-19T05:39:47.109 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-12-19T05:39:47.109 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T05:39:47.132 INFO:teuthology.orchestra.run.smithi188.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-19T05:39:47.132 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-19T05:39:47.132 INFO:teuthology.orchestra.run.smithi188.stdout:invalid new device string format 2023-12-19T05:39:47.132 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.120:3300,172.21.15.155:3300,172.21.15.155:3301" 2023-12-19T05:39:47.132 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-19T05:39:47.133 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: resolved to: "172.21.15.120:6789,172.21.15.155:6789,172.21.15.155:6790" 2023-12-19T05:39:47.133 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.120:6789,172.21.15.155:6789,172.21.15.155:6790:/ 2023-12-19T05:39:47.133 INFO:teuthology.orchestra.run.smithi188.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=90961127-a1a1-4949-bae3-e6c73f63cc7e" will pass to kernel 2023-12-19T05:39:47.137 INFO:teuthology.orchestra.run.smithi188.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-19T05:39:47.137 INFO:teuthology.orchestra.run.smithi188.stdout: You just mounted a file system that supports labels which does not 2023-12-19T05:39:47.137 INFO:teuthology.orchestra.run.smithi188.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-19T05:39:47.137 INFO:teuthology.orchestra.run.smithi188.stdout: applications will generate AVC messages and not be allowed access to 2023-12-19T05:39:47.137 INFO:teuthology.orchestra.run.smithi188.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-19T05:39:47.140 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T05:39:47.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:47.140 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T05:39:47.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:47.219 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T05:39:47.285 INFO:teuthology.orchestra.run.smithi188.stdout:client5205 2023-12-19T05:39:47.285 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:39:47.285 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T05:39:47.337 DEBUG:teuthology.orchestra.run.smithi188:> mktemp -d --suffix=xfstests-dev 2023-12-19T05:39:47.388 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.3GYFeLTziIxfstests-dev 2023-12-19T05:39:47.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:47.389 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.3GYFeLTziIxfstests-dev) 2023-12-19T05:39:47.450 INFO:teuthology.orchestra.run.smithi188.stderr:Cloning into '/tmp/tmp.3GYFeLTziIxfstests-dev'... 2023-12-19T05:39:48.517 DEBUG:teuthology.orchestra.run.smithi188:> mktemp -d --suffix=xfsprogs-dev 2023-12-19T05:39:48.570 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.3ZCPZZ6XHZxfsprogs-dev 2023-12-19T05:39:48.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:48.570 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.3ZCPZZ6XHZxfsprogs-dev) 2023-12-19T05:39:48.626 INFO:teuthology.orchestra.run.smithi188.stderr:Cloning into '/tmp/tmp.3ZCPZZ6XHZxfsprogs-dev'... 2023-12-19T05:39:49.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:49.307 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-12-19T05:39:49.370 DEBUG:teuthology.orchestra.run.smithi188:> mktemp -d --suffix=test 2023-12-19T05:39:49.423 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.gKLPzIzpajtest 2023-12-19T05:39:49.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T05:39:49.423 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-12-19T05:39:49.479 DEBUG:teuthology.orchestra.run.smithi188:> mktemp -d --suffix=scratch 2023-12-19T05:39:49.529 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.5OkJwJdUnTscratch 2023-12-19T05:39:49.530 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-12-19T05:39:49.530 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite inih-devel userspace-rcu-devel libblkid-devel gettext libedit-devel libattr-devel device-mapper-devel libicu-devel xfsprogs-qa-devel 2023-12-19T05:39:50.373 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:03:19 ago on Tue 19 Dec 2023 05:36:31 AM UTC. 2023-12-19T05:39:50.470 INFO:teuthology.orchestra.run.smithi188.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-12-19T05:39:50.471 INFO:teuthology.orchestra.run.smithi188.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T05:39:50.472 INFO:teuthology.orchestra.run.smithi188.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-12-19T05:39:50.473 INFO:teuthology.orchestra.run.smithi188.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-12-19T05:39:50.474 INFO:teuthology.orchestra.run.smithi188.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-12-19T05:39:50.475 INFO:teuthology.orchestra.run.smithi188.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-12-19T05:39:50.477 INFO:teuthology.orchestra.run.smithi188.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-12-19T05:39:50.478 INFO:teuthology.orchestra.run.smithi188.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-12-19T05:39:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-12-19T05:39:50.480 INFO:teuthology.orchestra.run.smithi188.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-12-19T05:39:50.481 INFO:teuthology.orchestra.run.smithi188.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-12-19T05:39:50.482 INFO:teuthology.orchestra.run.smithi188.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-12-19T05:39:50.483 INFO:teuthology.orchestra.run.smithi188.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-12-19T05:39:50.484 INFO:teuthology.orchestra.run.smithi188.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-12-19T05:39:50.485 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2023-12-19T05:39:50.486 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T05:39:50.487 INFO:teuthology.orchestra.run.smithi188.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-12-19T05:39:50.488 INFO:teuthology.orchestra.run.smithi188.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-19T05:39:50.489 INFO:teuthology.orchestra.run.smithi188.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-12-19T05:39:50.490 INFO:teuthology.orchestra.run.smithi188.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-12-19T05:39:50.491 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsprogs-devel-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T05:39:50.492 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-12-19T05:39:50.495 INFO:teuthology.orchestra.run.smithi188.stdout:Package gettext-0.21-8.el9.x86_64 is already installed. 2023-12-19T05:39:50.502 INFO:teuthology.orchestra.run.smithi188.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-19T05:39:50.561 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2023-12-19T05:39:50.565 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-19T05:39:50.565 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2023-12-19T05:39:50.565 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-19T05:39:50.565 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2023-12-19T05:39:50.565 INFO:teuthology.orchestra.run.smithi188.stdout: device-mapper-devel x86_64 9:1.02.195-3.el9 crb 43 k 2023-12-19T05:39:50.565 INFO:teuthology.orchestra.run.smithi188.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-12-19T05:39:50.565 INFO:teuthology.orchestra.run.smithi188.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2023-12-19T05:39:50.565 INFO:teuthology.orchestra.run.smithi188.stdout: indent x86_64 2.2.13-4.el9 epel 179 k 2023-12-19T05:39:50.565 INFO:teuthology.orchestra.run.smithi188.stdout: inih-devel x86_64 49-6.el9 crb 11 k 2023-12-19T05:39:50.565 INFO:teuthology.orchestra.run.smithi188.stdout: libblkid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 17 k 2023-12-19T05:39:50.565 INFO:teuthology.orchestra.run.smithi188.stdout: libedit-devel x86_64 3.1-38.20210216cvs.el9 CentOS-AppStream 39 k 2023-12-19T05:39:50.565 INFO:teuthology.orchestra.run.smithi188.stdout: libicu-devel x86_64 67.1-9.el9 CentOS-AppStream 830 k 2023-12-19T05:39:50.566 INFO:teuthology.orchestra.run.smithi188.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-12-19T05:39:50.566 INFO:teuthology.orchestra.run.smithi188.stdout: userspace-rcu-devel x86_64 0.12.1-6.el9 crb 120 k 2023-12-19T05:39:50.566 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrading: 2023-12-19T05:39:50.566 INFO:teuthology.orchestra.run.smithi188.stdout: cpp x86_64 11.4.1-2.3.el9 CentOS-AppStream 11 M 2023-12-19T05:39:50.566 INFO:teuthology.orchestra.run.smithi188.stdout: e2fsprogs x86_64 1.46.5-4.el9 CentOS-BaseOS 1.0 M 2023-12-19T05:39:50.566 INFO:teuthology.orchestra.run.smithi188.stdout: e2fsprogs-libs x86_64 1.46.5-4.el9 CentOS-BaseOS 221 k 2023-12-19T05:39:50.566 INFO:teuthology.orchestra.run.smithi188.stdout: gcc x86_64 11.4.1-2.3.el9 CentOS-AppStream 32 M 2023-12-19T05:39:50.566 INFO:teuthology.orchestra.run.smithi188.stdout: gcc-c++ x86_64 11.4.1-2.3.el9 CentOS-AppStream 13 M 2023-12-19T05:39:50.566 INFO:teuthology.orchestra.run.smithi188.stdout: gcc-plugin-annobin x86_64 11.4.1-2.3.el9 CentOS-AppStream 47 k 2023-12-19T05:39:50.566 INFO:teuthology.orchestra.run.smithi188.stdout: libcom_err x86_64 1.46.5-4.el9 CentOS-BaseOS 25 k 2023-12-19T05:39:50.566 INFO:teuthology.orchestra.run.smithi188.stdout: libgcc x86_64 11.4.1-2.3.el9 CentOS-BaseOS 92 k 2023-12-19T05:39:50.566 INFO:teuthology.orchestra.run.smithi188.stdout: libgomp x86_64 11.4.1-2.3.el9 CentOS-BaseOS 268 k 2023-12-19T05:39:50.566 INFO:teuthology.orchestra.run.smithi188.stdout: libss x86_64 1.46.5-4.el9 CentOS-BaseOS 31 k 2023-12-19T05:39:50.566 INFO:teuthology.orchestra.run.smithi188.stdout: libstdc++ x86_64 11.4.1-2.3.el9 CentOS-BaseOS 735 k 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout: libstdc++-devel x86_64 11.4.1-2.3.el9 CentOS-AppStream 2.2 M 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout: python-unversioned-command 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout: noarch 3.9.18-1.el9 CentOS-AppStream 8.8 k 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout: python3 x86_64 3.9.18-1.el9 CentOS-BaseOS 26 k 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel x86_64 3.9.18-1.el9 CentOS-AppStream 204 k 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout: python3-libs x86_64 3.9.18-1.el9 CentOS-BaseOS 7.3 M 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout: libselinux-devel x86_64 3.5-1.el9 CentOS-AppStream 114 k 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout: libsepol-devel x86_64 3.5-1.el9 CentOS-AppStream 40 k 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-devel x86_64 10.40-2.el9 appstream 515 k 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-utf16 x86_64 10.40-2.el9 appstream 217 k 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-utf32 x86_64 10.40-2.el9 appstream 206 k 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-12-19T05:39:50.567 INFO:teuthology.orchestra.run.smithi188.stdout: systemd-devel x86_64 252-18.el9 CentOS-AppStream 482 k 2023-12-19T05:39:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:Installing weak dependencies: 2023-12-19T05:39:50.568 INFO:teuthology.orchestra.run.smithi188.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2023-12-19T05:39:50.568 INFO:teuthology.orchestra.run.smithi188.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2023-12-19T05:39:50.568 INFO:teuthology.orchestra.run.smithi188.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2023-12-19T05:39:50.568 INFO:teuthology.orchestra.run.smithi188.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-19T05:39:50.568 INFO:teuthology.orchestra.run.smithi188.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-19T05:39:50.568 INFO:teuthology.orchestra.run.smithi188.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2023-12-19T05:39:50.568 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:39:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2023-12-19T05:39:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2023-12-19T05:39:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:Install 24 Packages 2023-12-19T05:39:50.568 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrade 16 Packages 2023-12-19T05:39:50.568 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:39:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 78 M 2023-12-19T05:39:50.569 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2023-12-19T05:39:51.249 INFO:teuthology.orchestra.run.smithi188.stdout:(1/40): fio-engine-http-3.35-1.el9.x86_64.rpm 80 kB/s | 17 kB 00:00 2023-12-19T05:39:51.272 INFO:teuthology.orchestra.run.smithi188.stdout:(2/40): fio-engine-libaio-3.35-1.el9.x86_64.rpm 61 kB/s | 14 kB 00:00 2023-12-19T05:39:51.447 INFO:teuthology.orchestra.run.smithi188.stdout:(3/40): fio-engine-nbd-3.35-1.el9.x86_64.rpm 68 kB/s | 13 kB 00:00 2023-12-19T05:39:51.523 INFO:teuthology.orchestra.run.smithi188.stdout:(4/40): fio-engine-rados-3.35-1.el9.x86_64.rpm 59 kB/s | 15 kB 00:00 2023-12-19T05:39:51.665 INFO:teuthology.orchestra.run.smithi188.stdout:(5/40): fio-engine-rbd-3.35-1.el9.x86_64.rpm 71 kB/s | 15 kB 00:00 2023-12-19T05:39:51.690 INFO:teuthology.orchestra.run.smithi188.stdout:(6/40): fio-engine-rdma-3.35-1.el9.x86_64.rpm 121 kB/s | 20 kB 00:00 2023-12-19T05:39:51.847 INFO:teuthology.orchestra.run.smithi188.stdout:(7/40): fio-3.35-1.el9.x86_64.rpm 7.7 MB/s | 6.2 MB 00:00 2023-12-19T05:39:51.882 INFO:teuthology.orchestra.run.smithi188.stdout:(8/40): libedit-devel-3.1-38.20210216cvs.el9.x8 208 kB/s | 39 kB 00:00 2023-12-19T05:39:51.907 INFO:teuthology.orchestra.run.smithi188.stdout:(9/40): libblkid-devel-2.37.4-15.el9.x86_64.rpm 79 kB/s | 17 kB 00:00 2023-12-19T05:39:52.008 INFO:teuthology.orchestra.run.smithi188.stdout:(10/40): libicu-devel-67.1-9.el9.x86_64.rpm 5.1 MB/s | 830 kB 00:00 2023-12-19T05:39:52.033 INFO:teuthology.orchestra.run.smithi188.stdout:(11/40): libselinux-devel-3.5-1.el9.x86_64.rpm 762 kB/s | 114 kB 00:00 2023-12-19T05:39:52.058 INFO:teuthology.orchestra.run.smithi188.stdout:(12/40): libsepol-devel-3.5-1.el9.x86_64.rpm 264 kB/s | 40 kB 00:00 2023-12-19T05:39:52.100 INFO:teuthology.orchestra.run.smithi188.stdout:(13/40): sqlite-3.34.1-6.el9.x86_64.rpm 8.0 MB/s | 747 kB 00:00 2023-12-19T05:39:52.126 INFO:teuthology.orchestra.run.smithi188.stdout:(14/40): rmt-1.6-6.el9.x86_64.rpm 771 kB/s | 45 kB 00:00 2023-12-19T05:39:52.218 INFO:teuthology.orchestra.run.smithi188.stdout:(15/40): systemd-devel-252-18.el9.x86_64.rpm 3.1 MB/s | 482 kB 00:00 2023-12-19T05:39:52.269 INFO:teuthology.orchestra.run.smithi188.stdout:(16/40): libnbd-1.18.1-3.el9.x86_64.rpm 1.0 MB/s | 166 kB 00:00 2023-12-19T05:39:52.302 INFO:teuthology.orchestra.run.smithi188.stdout:(17/40): pcre2-devel-10.40-2.el9.x86_64.rpm 2.9 MB/s | 515 kB 00:00 2023-12-19T05:39:52.335 INFO:teuthology.orchestra.run.smithi188.stdout:(18/40): pcre2-utf32-10.40-2.el9.x86_64.rpm 3.0 MB/s | 206 kB 00:00 2023-12-19T05:39:52.369 INFO:teuthology.orchestra.run.smithi188.stdout:(19/40): pcre2-utf16-10.40-2.el9.x86_64.rpm 1.4 MB/s | 217 kB 00:00 2023-12-19T05:39:52.554 INFO:teuthology.orchestra.run.smithi188.stdout:(20/40): inih-devel-49-6.el9.x86_64.rpm 50 kB/s | 11 kB 00:00 2023-12-19T05:39:52.695 INFO:teuthology.orchestra.run.smithi188.stdout:(21/40): device-mapper-devel-1.02.195-3.el9.x86 111 kB/s | 43 kB 00:00 2023-12-19T05:39:52.837 INFO:teuthology.orchestra.run.smithi188.stdout:(22/40): dump-0.4-0.51.b47.el9.x86_64.rpm 312 kB/s | 88 kB 00:00 2023-12-19T05:39:52.899 INFO:teuthology.orchestra.run.smithi188.stdout:(23/40): userspace-rcu-devel-0.12.1-6.el9.x86_6 228 kB/s | 120 kB 00:00 2023-12-19T05:39:52.929 INFO:teuthology.orchestra.run.smithi188.stdout:(24/40): indent-2.2.13-4.el9.x86_64.rpm 779 kB/s | 179 kB 00:00 2023-12-19T05:39:53.446 INFO:teuthology.orchestra.run.smithi188.stdout:(25/40): gcc-c++-11.4.1-2.3.el9.x86_64.rpm 25 MB/s | 13 MB 00:00 2023-12-19T05:39:53.655 INFO:teuthology.orchestra.run.smithi188.stdout:(26/40): cpp-11.4.1-2.3.el9.x86_64.rpm 13 MB/s | 11 MB 00:00 2023-12-19T05:39:53.788 INFO:teuthology.orchestra.run.smithi188.stdout:(27/40): gcc-plugin-annobin-11.4.1-2.3.el9.x86_ 138 kB/s | 47 kB 00:00 2023-12-19T05:39:54.197 INFO:teuthology.orchestra.run.smithi188.stdout:(28/40): gcc-11.4.1-2.3.el9.x86_64.rpm 25 MB/s | 32 MB 00:01 2023-12-19T05:39:54.264 INFO:teuthology.orchestra.run.smithi188.stdout:(29/40): libstdc++-devel-11.4.1-2.3.el9.x86_64. 3.7 MB/s | 2.2 MB 00:00 2023-12-19T05:39:54.325 INFO:teuthology.orchestra.run.smithi188.stdout:(30/40): python-unversioned-command-3.9.18-1.el 17 kB/s | 8.8 kB 00:00 2023-12-19T05:39:54.355 INFO:teuthology.orchestra.run.smithi188.stdout:(31/40): python3-devel-3.9.18-1.el9.x86_64.rpm 1.3 MB/s | 204 kB 00:00 2023-12-19T05:39:54.406 INFO:teuthology.orchestra.run.smithi188.stdout:(32/40): e2fsprogs-1.46.5-4.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2023-12-19T05:39:54.431 INFO:teuthology.orchestra.run.smithi188.stdout:(33/40): libcom_err-1.46.5-4.el9.x86_64.rpm 337 kB/s | 25 kB 00:00 2023-12-19T05:39:54.465 INFO:teuthology.orchestra.run.smithi188.stdout:(34/40): e2fsprogs-libs-1.46.5-4.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2023-12-19T05:39:54.498 INFO:teuthology.orchestra.run.smithi188.stdout:(35/40): libgcc-11.4.1-2.3.el9.x86_64.rpm 1.4 MB/s | 92 kB 00:00 2023-12-19T05:39:54.524 INFO:teuthology.orchestra.run.smithi188.stdout:(36/40): libgomp-11.4.1-2.3.el9.x86_64.rpm 2.9 MB/s | 268 kB 00:00 2023-12-19T05:39:54.557 INFO:teuthology.orchestra.run.smithi188.stdout:(37/40): python3-3.9.18-1.el9.x86_64.rpm 797 kB/s | 26 kB 00:00 2023-12-19T05:39:54.607 INFO:teuthology.orchestra.run.smithi188.stdout:(38/40): libstdc++-11.4.1-2.3.el9.x86_64.rpm 8.7 MB/s | 735 kB 00:00 2023-12-19T05:39:54.683 INFO:teuthology.orchestra.run.smithi188.stdout:(39/40): libss-1.46.5-4.el9.x86_64.rpm 143 kB/s | 31 kB 00:00 2023-12-19T05:39:54.891 INFO:teuthology.orchestra.run.smithi188.stdout:(40/40): python3-libs-3.9.18-1.el9.x86_64.rpm 22 MB/s | 7.3 MB 00:00 2023-12-19T05:39:54.898 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2023-12-19T05:39:54.899 INFO:teuthology.orchestra.run.smithi188.stdout:Total 18 MB/s | 78 MB 00:04 2023-12-19T05:39:55.161 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2023-12-19T05:39:55.495 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2023-12-19T05:39:55.495 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2023-12-19T05:39:56.331 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2023-12-19T05:39:56.331 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2023-12-19T05:39:58.295 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:39:58.298 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:39:58.302 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:39:58.650 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2023-12-19T05:39:58.737 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libcom_err-1.46.5-4.el9.x86_64 1/56 2023-12-19T05:39:58.776 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libgcc-11.4.1-2.3.el9.x86_64 2/56 2023-12-19T05:39:58.903 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libgcc-11.4.1-2.3.el9.x86_64 2/56 2023-12-19T05:39:58.977 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libstdc++-11.4.1-2.3.el9.x86_64 3/56 2023-12-19T05:39:59.675 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : e2fsprogs-libs-1.46.5-4.el9.x86_64 4/56 2023-12-19T05:39:59.795 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libstdc++-devel-11.4.1-2.3.el9.x86_64 5/56 2023-12-19T05:40:01.364 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libss-1.46.5-4.el9.x86_64 6/56 2023-12-19T05:40:01.566 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : python3-libs-3.9.18-1.el9.x86_64 7/56 2023-12-19T05:40:01.627 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : python3-3.9.18-1.el9.x86_64 8/56 2023-12-19T05:40:01.672 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : python-unversioned-command-3.9.18-1.el9.noarch 9/56 2023-12-19T05:40:01.983 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : libgomp-11.4.1-2.3.el9.x86_64 10/56 2023-12-19T05:40:03.233 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : cpp-11.4.1-2.3.el9.x86_64 11/56 2023-12-19T05:40:03.505 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : gcc-11.4.1-2.3.el9.x86_64 12/56 2023-12-19T05:40:03.587 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: gcc-11.4.1-2.3.el9.x86_64 12/56 2023-12-19T05:40:03.625 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : pcre2-utf32-10.40-2.el9.x86_64 13/56 2023-12-19T05:40:03.805 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : pcre2-utf16-10.40-2.el9.x86_64 14/56 2023-12-19T05:40:03.871 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : pcre2-devel-10.40-2.el9.x86_64 15/56 2023-12-19T05:40:03.906 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 16/56 2023-12-19T05:40:03.939 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 17/56 2023-12-19T05:40:03.974 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 18/56 2023-12-19T05:40:04.009 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 19/56 2023-12-19T05:40:04.042 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 20/56 2023-12-19T05:40:04.076 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 21/56 2023-12-19T05:40:04.332 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 22/56 2023-12-19T05:40:04.381 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fio-3.35-1.el9.x86_64 23/56 2023-12-19T05:40:04.831 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rmt-2:1.6-6.el9.x86_64 24/56 2023-12-19T05:40:04.938 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : systemd-devel-252-18.el9.x86_64 25/56 2023-12-19T05:40:05.070 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libsepol-devel-3.5-1.el9.x86_64 26/56 2023-12-19T05:40:05.111 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libselinux-devel-3.5-1.el9.x86_64 27/56 2023-12-19T05:40:05.134 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : device-mapper-devel-9:1.02.195-3.el9.x86_64 28/56 2023-12-19T05:40:05.557 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 29/56 2023-12-19T05:40:06.082 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : gcc-c++-11.4.1-2.3.el9.x86_64 30/56 2023-12-19T05:40:06.120 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 31/56 2023-12-19T05:40:06.311 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 31/56 2023-12-19T05:40:06.439 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : python3-devel-3.9.18-1.el9.x86_64 32/56 2023-12-19T05:40:06.620 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : e2fsprogs-1.46.5-4.el9.x86_64 33/56 2023-12-19T05:40:06.751 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : indent-2.2.13-4.el9.x86_64 34/56 2023-12-19T05:40:06.787 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : userspace-rcu-devel-0.12.1-6.el9.x86_64 35/56 2023-12-19T05:40:06.824 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : inih-devel-49-6.el9.x86_64 36/56 2023-12-19T05:40:07.144 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 37/56 2023-12-19T05:40:07.202 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libicu-devel-67.1-9.el9.x86_64 38/56 2023-12-19T05:40:07.235 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libedit-devel-3.1-38.20210216cvs.el9.x86_64 39/56 2023-12-19T05:40:07.262 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libblkid-devel-2.37.4-15.el9.x86_64 40/56 2023-12-19T05:40:07.295 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 41/56 2023-12-19T05:40:07.333 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 42/56 2023-12-19T05:40:07.378 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 43/56 2023-12-19T05:40:07.402 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 44/56 2023-12-19T05:40:07.454 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 45/56 2023-12-19T05:40:07.455 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 46/56 2023-12-19T05:40:07.573 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 46/56 2023-12-19T05:40:07.622 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 47/56 2023-12-19T05:40:07.655 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 48/56 2023-12-19T05:40:07.729 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 49/56 2023-12-19T05:40:07.800 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 50/56 2023-12-19T05:40:07.840 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 51/56 2023-12-19T05:40:07.840 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 52/56 2023-12-19T05:40:07.967 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 52/56 2023-12-19T05:40:08.001 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 53/56 2023-12-19T05:40:08.041 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 54/56 2023-12-19T05:40:08.170 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 55/56 2023-12-19T05:40:08.290 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 56/56 2023-12-19T05:40:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: python3-libs-3.9.17-2.el9.x86_64 56/56 2023-12-19T05:40:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fio-3.35-1.el9.x86_64 1/56 2023-12-19T05:40:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/56 2023-12-19T05:40:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/56 2023-12-19T05:40:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/56 2023-12-19T05:40:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/56 2023-12-19T05:40:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/56 2023-12-19T05:40:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/56 2023-12-19T05:40:10.117 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libblkid-devel-2.37.4-15.el9.x86_64 8/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libedit-devel-3.1-38.20210216cvs.el9.x86_64 9/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libicu-devel-67.1-9.el9.x86_64 10/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libselinux-devel-3.5-1.el9.x86_64 11/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libsepol-devel-3.5-1.el9.x86_64 12/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 13/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : systemd-devel-252-18.el9.x86_64 14/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 15/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 16/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : pcre2-devel-10.40-2.el9.x86_64 17/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : pcre2-utf16-10.40-2.el9.x86_64 18/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : pcre2-utf32-10.40-2.el9.x86_64 19/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : device-mapper-devel-9:1.02.195-3.el9.x86_64 20/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : inih-devel-49-6.el9.x86_64 21/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : userspace-rcu-devel-0.12.1-6.el9.x86_64 22/56 2023-12-19T05:40:10.118 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 23/56 2023-12-19T05:40:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : indent-2.2.13-4.el9.x86_64 24/56 2023-12-19T05:40:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cpp-11.4.1-2.3.el9.x86_64 25/56 2023-12-19T05:40:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 26/56 2023-12-19T05:40:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gcc-11.4.1-2.3.el9.x86_64 27/56 2023-12-19T05:40:10.119 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 28/56 2023-12-19T05:40:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gcc-c++-11.4.1-2.3.el9.x86_64 29/56 2023-12-19T05:40:10.122 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 30/56 2023-12-19T05:40:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 31/56 2023-12-19T05:40:10.124 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 32/56 2023-12-19T05:40:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libstdc++-devel-11.4.1-2.3.el9.x86_64 33/56 2023-12-19T05:40:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 34/56 2023-12-19T05:40:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python-unversioned-command-3.9.18-1.el9.noarch 35/56 2023-12-19T05:40:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 36/56 2023-12-19T05:40:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-devel-3.9.18-1.el9.x86_64 37/56 2023-12-19T05:40:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 38/56 2023-12-19T05:40:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : e2fsprogs-1.46.5-4.el9.x86_64 39/56 2023-12-19T05:40:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 40/56 2023-12-19T05:40:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : e2fsprogs-libs-1.46.5-4.el9.x86_64 41/56 2023-12-19T05:40:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 42/56 2023-12-19T05:40:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcom_err-1.46.5-4.el9.x86_64 43/56 2023-12-19T05:40:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 44/56 2023-12-19T05:40:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgcc-11.4.1-2.3.el9.x86_64 45/56 2023-12-19T05:40:10.125 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 46/56 2023-12-19T05:40:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgomp-11.4.1-2.3.el9.x86_64 47/56 2023-12-19T05:40:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 48/56 2023-12-19T05:40:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libss-1.46.5-4.el9.x86_64 49/56 2023-12-19T05:40:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libss-1.46.5-3.el9.x86_64 50/56 2023-12-19T05:40:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libstdc++-11.4.1-2.3.el9.x86_64 51/56 2023-12-19T05:40:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 52/56 2023-12-19T05:40:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-3.9.18-1.el9.x86_64 53/56 2023-12-19T05:40:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-3.9.17-2.el9.x86_64 54/56 2023-12-19T05:40:10.126 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-libs-3.9.18-1.el9.x86_64 55/56 2023-12-19T05:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 56/56 2023-12-19T05:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout:Upgraded: 2023-12-19T05:40:11.012 INFO:teuthology.orchestra.run.smithi188.stdout: cpp-11.4.1-2.3.el9.x86_64 2023-12-19T05:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: e2fsprogs-1.46.5-4.el9.x86_64 2023-12-19T05:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: e2fsprogs-libs-1.46.5-4.el9.x86_64 2023-12-19T05:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: gcc-11.4.1-2.3.el9.x86_64 2023-12-19T05:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: gcc-c++-11.4.1-2.3.el9.x86_64 2023-12-19T05:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 2023-12-19T05:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: libcom_err-1.46.5-4.el9.x86_64 2023-12-19T05:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: libgcc-11.4.1-2.3.el9.x86_64 2023-12-19T05:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: libgomp-11.4.1-2.3.el9.x86_64 2023-12-19T05:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: libss-1.46.5-4.el9.x86_64 2023-12-19T05:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: libstdc++-11.4.1-2.3.el9.x86_64 2023-12-19T05:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: libstdc++-devel-11.4.1-2.3.el9.x86_64 2023-12-19T05:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: python-unversioned-command-3.9.18-1.el9.noarch 2023-12-19T05:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: python3-3.9.18-1.el9.x86_64 2023-12-19T05:40:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel-3.9.18-1.el9.x86_64 2023-12-19T05:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: python3-libs-3.9.18-1.el9.x86_64 2023-12-19T05:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2023-12-19T05:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: device-mapper-devel-9:1.02.195-3.el9.x86_64 2023-12-19T05:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: dump-1:0.4-0.51.b47.el9.x86_64 2023-12-19T05:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: fio-3.35-1.el9.x86_64 2023-12-19T05:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: fio-engine-http-3.35-1.el9.x86_64 2023-12-19T05:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: fio-engine-libaio-3.35-1.el9.x86_64 2023-12-19T05:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: fio-engine-nbd-3.35-1.el9.x86_64 2023-12-19T05:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: fio-engine-rados-3.35-1.el9.x86_64 2023-12-19T05:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: fio-engine-rbd-3.35-1.el9.x86_64 2023-12-19T05:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: fio-engine-rdma-3.35-1.el9.x86_64 2023-12-19T05:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: indent-2.2.13-4.el9.x86_64 2023-12-19T05:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: inih-devel-49-6.el9.x86_64 2023-12-19T05:40:11.014 INFO:teuthology.orchestra.run.smithi188.stdout: libblkid-devel-2.37.4-15.el9.x86_64 2023-12-19T05:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: libedit-devel-3.1-38.20210216cvs.el9.x86_64 2023-12-19T05:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: libicu-devel-67.1-9.el9.x86_64 2023-12-19T05:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: libnbd-1.18.1-3.el9.x86_64 2023-12-19T05:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: libselinux-devel-3.5-1.el9.x86_64 2023-12-19T05:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: libsepol-devel-3.5-1.el9.x86_64 2023-12-19T05:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-devel-10.40-2.el9.x86_64 2023-12-19T05:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-utf16-10.40-2.el9.x86_64 2023-12-19T05:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: pcre2-utf32-10.40-2.el9.x86_64 2023-12-19T05:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: rmt-2:1.6-6.el9.x86_64 2023-12-19T05:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: sqlite-3.34.1-6.el9.x86_64 2023-12-19T05:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: systemd-devel-252-18.el9.x86_64 2023-12-19T05:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: userspace-rcu-devel-0.12.1-6.el9.x86_64 2023-12-19T05:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:40:11.015 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2023-12-19T05:40:11.507 DEBUG:teuthology.orchestra.run.smithi188:> sudo useradd -m fsgqa 2023-12-19T05:40:11.584 INFO:teuthology.orchestra.run.smithi188.stderr:useradd: user 'fsgqa' already exists 2023-12-19T05:40:11.587 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-19T05:40:11.588 DEBUG:teuthology.orchestra.run.smithi188:> sudo groupadd fsgqa 2023-12-19T05:40:11.662 INFO:teuthology.orchestra.run.smithi188.stderr:groupadd: group 'fsgqa' already exists 2023-12-19T05:40:11.665 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-19T05:40:11.665 DEBUG:teuthology.orchestra.run.smithi188:> sudo useradd fsgqa2 2023-12-19T05:40:12.372 DEBUG:teuthology.orchestra.run.smithi188:> sudo useradd 123456-fsgqa 2023-12-19T05:40:13.046 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-12-19T05:40:13.159 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.158+0000 7f520e7ce640 1 Processor -- start 2023-12-19T05:40:13.159 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.158+0000 7f520e7ce640 1 -- start start 2023-12-19T05:40:13.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.158+0000 7f520e7ce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52080b79b0 0x7f52080b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.158+0000 7f520e7ce640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52080b96b0 con 0x7f520814b230 2023-12-19T05:40:13.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.158+0000 7f520e7ce640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52080b90f0 con 0x7f52080b8860 2023-12-19T05:40:13.162 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.158+0000 7f520e7ce640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520814ae10 con 0x7f52080b79b0 2023-12-19T05:40:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.158+0000 7f520cd6b640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7f520814b230 0x7f52081553c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:39482/0 (socket says 172.21.15.120:39482) 2023-12-19T05:40:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.158+0000 7f520cd6b640 1 -- 172.21.15.120:0/2229567994 learned_addr learned my addr 172.21.15.120:0/2229567994 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:40:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5207fff640 1 --2- 172.21.15.120:0/2229567994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52080b79b0 0x7f52080b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 -- 172.21.15.120:0/2229567994 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374430621 0 0) 0x7f52080b96b0 con 0x7f520814b230 2023-12-19T05:40:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 -- 172.21.15.120:0/2229567994 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f4003520 con 0x7f520814b230 2023-12-19T05:40:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 -- 172.21.15.120:0/2229567994 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1066871079 0 0) 0x7f51f4003520 con 0x7f520814b230 2023-12-19T05:40:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 -- 172.21.15.120:0/2229567994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52080b79b0 msgr2=0x7f52080b7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 --2- 172.21.15.120:0/2229567994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52080b79b0 0x7f52080b7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 -- 172.21.15.120:0/2229567994 >> v1:172.21.15.155:6789/0 conn(0x7f52080b8860 legacy=0x7f5208144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 -- 172.21.15.120:0/2229567994 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52080b93d0 con 0x7f520814b230 2023-12-19T05:40:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 -- 172.21.15.120:0/2229567994 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7f52000019f0 con 0x7f520814b230 2023-12-19T05:40:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 -- 172.21.15.120:0/2229567994 >> v1:172.21.15.120:6789/0 conn(0x7f520814b230 legacy=0x7f52081553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 --2- 172.21.15.120:0/2229567994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52080b79b0 0x7f51f40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.163 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 --2- 172.21.15.120:0/2229567994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51f4003ee0 0x7f51f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 --2- 172.21.15.120:0/2229567994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51f4004d00 0x7f51f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 -- 172.21.15.120:0/2229567994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520814ae10 con 0x7f51f4003ee0 2023-12-19T05:40:13.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 -- 172.21.15.120:0/2229567994 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f400b9e0 con 0x7f51f4004d00 2023-12-19T05:40:13.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5206ffd640 1 -- 172.21.15.120:0/2229567994 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f400bba0 con 0x7f52080b79b0 2023-12-19T05:40:13.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f52077fe640 1 --2- 172.21.15.120:0/2229567994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51f4003ee0 0x7f51f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.164 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f5207fff640 1 --2- 172.21.15.120:0/2229567994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52080b79b0 0x7f51f40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f520cd6b640 1 --2- 172.21.15.120:0/2229567994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51f4004d00 0x7f51f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f52077fe640 1 -- 172.21.15.120:0/2229567994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52080b79b0 msgr2=0x7f51f40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:13.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f52077fe640 1 --2- 172.21.15.120:0/2229567994 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f52080b79b0 0x7f51f40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f52077fe640 1 -- 172.21.15.120:0/2229567994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51f4004d00 msgr2=0x7f51f4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:13.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f52077fe640 1 --2- 172.21.15.120:0/2229567994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51f4004d00 0x7f51f4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.159+0000 7f52077fe640 1 -- 172.21.15.120:0/2229567994 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f4003520 con 0x7f51f4003ee0 2023-12-19T05:40:13.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.160+0000 7f52077fe640 1 --2- 172.21.15.120:0/2229567994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51f4003ee0 0x7f51f40047c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f51f8001860 tx=0x7f51f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ed94c7a1d06264 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:13.165 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.160+0000 7f5206ffd640 1 -- 172.21.15.120:0/2229567994 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8032600 con 0x7f51f4003ee0 2023-12-19T05:40:13.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.160+0000 7f5206ffd640 1 -- 172.21.15.120:0/2229567994 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f802e050 con 0x7f51f4003ee0 2023-12-19T05:40:13.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.160+0000 7f5206ffd640 1 -- 172.21.15.120:0/2229567994 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80329c0 con 0x7f51f4003ee0 2023-12-19T05:40:13.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.161+0000 7f520e7ce640 1 -- 172.21.15.120:0/2229567994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51f4003ee0 msgr2=0x7f51f40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.161+0000 7f520e7ce640 1 --2- 172.21.15.120:0/2229567994 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51f4003ee0 0x7f51f40047c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f51f8001860 tx=0x7f51f40057f0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.161+0000 7f520cd6b640 1 -- 172.21.15.120:0/2229567994 reap_dead start 2023-12-19T05:40:13.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.161+0000 7f520e7ce640 1 -- 172.21.15.120:0/2229567994 shutdown_connections 2023-12-19T05:40:13.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.161+0000 7f520e7ce640 1 -- 172.21.15.120:0/2229567994 >> 172.21.15.120:0/2229567994 conn(0x7f52080c0340 msgr2=0x7f52080c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:13.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.161+0000 7f520e7ce640 1 -- 172.21.15.120:0/2229567994 shutdown_connections 2023-12-19T05:40:13.166 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.161+0000 7f520e7ce640 1 -- 172.21.15.120:0/2229567994 wait complete. 2023-12-19T05:40:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.162+0000 7f520e7ce640 1 Processor -- start 2023-12-19T05:40:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.162+0000 7f520e7ce640 1 -- start start 2023-12-19T05:40:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f520e7ce640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51f4003ee0 0x7f52081d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f520e7ce640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5208146ad0 0x7f52081e2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f520e7ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52081435f0 0x7f5208143a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f520e7ce640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52081d3e00 con 0x7f51f4003ee0 2023-12-19T05:40:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f520e7ce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5208147930 con 0x7f52081435f0 2023-12-19T05:40:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f520e7ce640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5208145eb0 con 0x7f5208146ad0 2023-12-19T05:40:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f5207fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51f4003ee0 0x7f52081d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f5207fff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51f4003ee0 0x7f52081d38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43716/0 (socket says 172.21.15.120:43716) 2023-12-19T05:40:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f5207fff640 1 -- 172.21.15.120:0/2042027738 learned_addr learned my addr 172.21.15.120:0/2042027738 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:40:13.170 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f52077fe640 1 --2- 172.21.15.120:0/2042027738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5208146ad0 0x7f52081e2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f520cd6b640 1 --2- 172.21.15.120:0/2042027738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52081435f0 0x7f5208143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f5207fff640 1 -- 172.21.15.120:0/2042027738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5208146ad0 msgr2=0x7f52081e2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f5207fff640 1 --2- 172.21.15.120:0/2042027738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5208146ad0 0x7f52081e2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f5207fff640 1 -- 172.21.15.120:0/2042027738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52081435f0 msgr2=0x7f5208143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f5207fff640 1 --2- 172.21.15.120:0/2042027738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52081435f0 0x7f5208143a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f5207fff640 1 -- 172.21.15.120:0/2042027738 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5208145bd0 con 0x7f51f4003ee0 2023-12-19T05:40:13.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f5207fff640 1 --2- 172.21.15.120:0/2042027738 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51f4003ee0 0x7f52081d38c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f51f00119d0 tx=0x7f51f0011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:13.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f5204ff9640 1 -- 172.21.15.120:0/2042027738 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f000fa90 con 0x7f51f4003ee0 2023-12-19T05:40:13.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f5204ff9640 1 -- 172.21.15.120:0/2042027738 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f000fbf0 con 0x7f51f4003ee0 2023-12-19T05:40:13.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f520e7ce640 1 -- 172.21.15.120:0/2042027738 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52081475c0 con 0x7f51f4003ee0 2023-12-19T05:40:13.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f5204ff9640 1 -- 172.21.15.120:0/2042027738 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f0014440 con 0x7f51f4003ee0 2023-12-19T05:40:13.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.163+0000 7f520e7ce640 1 -- 172.21.15.120:0/2042027738 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5208148360 con 0x7f51f4003ee0 2023-12-19T05:40:13.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.164+0000 7f520e7ce640 1 -- 172.21.15.120:0/2042027738 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5208147420 con 0x7f51f4003ee0 2023-12-19T05:40:13.171 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.165+0000 7f5204ff9640 1 -- 172.21.15.120:0/2042027738 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f51f00145a0 con 0x7f51f4003ee0 2023-12-19T05:40:13.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.165+0000 7f5204ff9640 1 --2- 172.21.15.120:0/2042027738 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f51e806a430 0x7f51e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.165+0000 7f5204ff9640 1 -- 172.21.15.120:0/2042027738 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51f0089070 con 0x7f51f4003ee0 2023-12-19T05:40:13.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.165+0000 7f52077fe640 1 --2- 172.21.15.120:0/2042027738 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f51e806a430 0x7f51e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.166+0000 7f52077fe640 1 --2- 172.21.15.120:0/2042027738 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f51e806a430 0x7f51e806c8f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f51f8035000 tx=0x7f51f8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:13.172 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.170+0000 7f5204ff9640 1 -- 172.21.15.120:0/2042027738 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f5208147420 con 0x7f51f4003ee0 2023-12-19T05:40:13.402 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.400+0000 7f520e7ce640 1 -- 172.21.15.120:0/2042027738 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f5208147420 con 0x7f51f4003ee0 2023-12-19T05:40:13.403 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.401+0000 7f5204ff9640 1 -- 172.21.15.120:0/2042027738 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7f5208147420 con 0x7f51f4003ee0 2023-12-19T05:40:13.403 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:40:13.403 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","modified":"2023-12-19T05:37:59.727967Z","created":"2023-12-19T05:37:59.727967Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:3300","nonce":0},{"type":"v1","addr":"172.21.15.120:6789","nonce":0}]},"addr":"172.21.15.120:6789/0","public_addr":"172.21.15.120:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3301","nonce":0},{"type":"v1","addr":"172.21.15.155:6790","nonce":0}]},"addr":"172.21.15.155:6790/0","public_addr":"172.21.15.155:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-19T05:40:13.405 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2023-12-19T05:40:13.405 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.403+0000 7f520e7ce640 1 -- 172.21.15.120:0/2042027738 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f51e806a430 msgr2=0x7f51e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.405 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.403+0000 7f520e7ce640 1 --2- 172.21.15.120:0/2042027738 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f51e806a430 0x7f51e806c8f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f51f8035000 tx=0x7f51f8030000 comp rx=0 tx=0).stop 2023-12-19T05:40:13.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.403+0000 7f520e7ce640 1 -- 172.21.15.120:0/2042027738 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51f4003ee0 msgr2=0x7f52081d38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.403+0000 7f520e7ce640 1 --2- 172.21.15.120:0/2042027738 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51f4003ee0 0x7f52081d38c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f51f00119d0 tx=0x7f51f0011dd0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.403+0000 7f520e7ce640 1 -- 172.21.15.120:0/2042027738 shutdown_connections 2023-12-19T05:40:13.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.403+0000 7f520e7ce640 1 --2- 172.21.15.120:0/2042027738 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f51e806a430 0x7f51e806c8f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.403+0000 7f520e7ce640 1 --2- 172.21.15.120:0/2042027738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52081435f0 0x7f5208143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.403+0000 7f520e7ce640 1 --2- 172.21.15.120:0/2042027738 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f5208146ad0 0x7f52081e2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.406 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.403+0000 7f520e7ce640 1 --2- 172.21.15.120:0/2042027738 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f51f4003ee0 0x7f52081d38c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.407 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.403+0000 7f520e7ce640 1 -- 172.21.15.120:0/2042027738 >> 172.21.15.120:0/2042027738 conn(0x7f52080c0340 msgr2=0x7f52080be950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:13.407 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.403+0000 7f520e7ce640 1 -- 172.21.15.120:0/2042027738 shutdown_connections 2023-12-19T05:40:13.407 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.403+0000 7f520e7ce640 1 -- 172.21.15.120:0/2042027738 wait complete. 2023-12-19T05:40:13.416 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-12-19T05:40:13.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.515+0000 7fa4759f1640 1 Processor -- start 2023-12-19T05:40:13.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.515+0000 7fa4759f1640 1 -- start start 2023-12-19T05:40:13.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.516+0000 7fa4759f1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47006ae10 0x7fa47014b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.516+0000 7fa4759f1640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa47014b700 0x7fa470155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.516+0000 7fa4759f1640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4700bbb60 con 0x7fa470144d60 2023-12-19T05:40:13.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.516+0000 7fa4759f1640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47006b980 con 0x7fa47014b700 2023-12-19T05:40:13.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.516+0000 7fa4759f1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47014aa40 con 0x7fa47006ae10 2023-12-19T05:40:13.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.516+0000 7fa46f7fe640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fa47014b700 0x7fa470155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.516+0000 7fa46effd640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fa470144d60 0x7fa47006d800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:39484/0 (socket says 172.21.15.120:39484) 2023-12-19T05:40:13.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.516+0000 7fa46effd640 1 -- 172.21.15.120:0/1727986074 learned_addr learned my addr 172.21.15.120:0/1727986074 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T05:40:13.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.516+0000 7fa46f7fe640 1 -- 172.21.15.120:0/1727986074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47006ae10 msgr2=0x7fa47014b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:40:13.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.516+0000 7fa46f7fe640 1 --2- 172.21.15.120:0/1727986074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47006ae10 0x7fa47014b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.516+0000 7fa46f7fe640 1 -- 172.21.15.120:0/1727986074 >> v1:172.21.15.120:6789/0 conn(0x7fa470144d60 legacy=0x7fa47006d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.517+0000 7fa46f7fe640 1 -- 172.21.15.120:0/1727986074 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4700b8b10 con 0x7fa47014b700 2023-12-19T05:40:13.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.516+0000 7fa46e7fc640 1 -- 172.21.15.120:0/1727986074 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579829949 0 0) 0x7fa4700bbb60 con 0x7fa470144d60 2023-12-19T05:40:13.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.517+0000 7fa46f7fe640 1 --2- 172.21.15.120:0/1727986074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa47014b700 0x7fa470155300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa468009d90 tx=0x7fa46802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8a0cbf3a70295b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:13.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.517+0000 7fa46e7fc640 1 -- 172.21.15.120:0/1727986074 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46802cce0 con 0x7fa47014b700 2023-12-19T05:40:13.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.517+0000 7fa46e7fc640 1 -- 172.21.15.120:0/1727986074 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46802ce40 con 0x7fa47014b700 2023-12-19T05:40:13.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.517+0000 7fa46e7fc640 1 -- 172.21.15.120:0/1727986074 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468034660 con 0x7fa47014b700 2023-12-19T05:40:13.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.518+0000 7fa4759f1640 1 -- 172.21.15.120:0/1727986074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa47014b700 msgr2=0x7fa470155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.518+0000 7fa4759f1640 1 --2- 172.21.15.120:0/1727986074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa47014b700 0x7fa470155300 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa468009d90 tx=0x7fa46802bf30 comp rx=0 tx=0).stop 2023-12-19T05:40:13.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.518+0000 7fa4759f1640 1 -- 172.21.15.120:0/1727986074 shutdown_connections 2023-12-19T05:40:13.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.518+0000 7fa4759f1640 1 --2- 172.21.15.120:0/1727986074 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa47014b700 0x7fa470155300 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.518+0000 7fa4759f1640 1 --2- 172.21.15.120:0/1727986074 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47006ae10 0x7fa47014b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.518+0000 7fa4759f1640 1 -- 172.21.15.120:0/1727986074 >> 172.21.15.120:0/1727986074 conn(0x7fa4700bac10 msgr2=0x7fa4700bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:13.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.518+0000 7fa4759f1640 1 -- 172.21.15.120:0/1727986074 shutdown_connections 2023-12-19T05:40:13.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.518+0000 7fa4759f1640 1 -- 172.21.15.120:0/1727986074 wait complete. 2023-12-19T05:40:13.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.519+0000 7fa4759f1640 1 Processor -- start 2023-12-19T05:40:13.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.519+0000 7fa4759f1640 1 -- start start 2023-12-19T05:40:13.524 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa4759f1640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa47006ae10 0x7fa470143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.524 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa4759f1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa470144d60 0x7fa4700a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa4759f1640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47014b700 0x7fa470135ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa4759f1640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4701443d0 con 0x7fa47006ae10 2023-12-19T05:40:13.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa4759f1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700a2470 con 0x7fa470144d60 2023-12-19T05:40:13.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa4759f1640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4701e06d0 con 0x7fa47014b700 2023-12-19T05:40:13.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa46effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa47006ae10 0x7fa470143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa46effd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa47006ae10 0x7fa470143e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:43738/0 (socket says 172.21.15.120:43738) 2023-12-19T05:40:13.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa46effd640 1 -- 172.21.15.120:0/4040795407 learned_addr learned my addr 172.21.15.120:0/4040795407 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:40:13.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa46f7fe640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47014b700 0x7fa470135ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa46effd640 1 -- 172.21.15.120:0/4040795407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47014b700 msgr2=0x7fa470135ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa467fff640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa470144d60 0x7fa4700a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa46effd640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47014b700 0x7fa470135ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa46effd640 1 -- 172.21.15.120:0/4040795407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa470144d60 msgr2=0x7fa4700a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa46effd640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa470144d60 0x7fa4700a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa46effd640 1 -- 172.21.15.120:0/4040795407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468009a70 con 0x7fa47006ae10 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa467fff640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa470144d60 0x7fa4700a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa46f7fe640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47014b700 0x7fa470135ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa46effd640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa47006ae10 0x7fa470143e90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa46000c4d0 tx=0x7fa46000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa46cff9640 1 -- 172.21.15.120:0/4040795407 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600074e0 con 0x7fa47006ae10 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa46cff9640 1 -- 172.21.15.120:0/4040795407 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa460007660 con 0x7fa47006ae10 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa46cff9640 1 -- 172.21.15.120:0/4040795407 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa460004a20 con 0x7fa47006ae10 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa4759f1640 1 -- 172.21.15.120:0/4040795407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4701e09b0 con 0x7fa47006ae10 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.520+0000 7fa4759f1640 1 -- 172.21.15.120:0/4040795407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4701e0f70 con 0x7fa47006ae10 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.521+0000 7fa4759f1640 1 -- 172.21.15.120:0/4040795407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47006de90 con 0x7fa47006ae10 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.522+0000 7fa46cff9640 1 -- 172.21.15.120:0/4040795407 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa460004b80 con 0x7fa47006ae10 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.522+0000 7fa46cff9640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa45006a460 0x7fa45006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.522+0000 7fa46cff9640 1 -- 172.21.15.120:0/4040795407 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa460087af0 con 0x7fa47006ae10 2023-12-19T05:40:13.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.522+0000 7fa467fff640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa45006a460 0x7fa45006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:40:13.527 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.522+0000 7fa467fff640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa45006a460 0x7fa45006c920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa458006fd0 tx=0x7fa458008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:40:13.527 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.526+0000 7fa46cff9640 1 -- 172.21.15.120:0/4040795407 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fa4600530e0 con 0x7fa47006ae10 2023-12-19T05:40:13.759 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.757+0000 7fa4759f1640 1 -- 172.21.15.120:0/4040795407 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fa47004e080 con 0x7fa47006ae10 2023-12-19T05:40:13.759 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.758+0000 7fa46cff9640 1 -- 172.21.15.120:0/4040795407 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7fa460018020 con 0x7fa47006ae10 2023-12-19T05:40:13.759 INFO:teuthology.orchestra.run.smithi120.stdout:[client.admin] 2023-12-19T05:40:13.760 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA4LIFljwWIAxAAGU4DYcPLGx3//cKl4HJCQA== 2023-12-19T05:40:13.761 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.760+0000 7fa4759f1640 1 -- 172.21.15.120:0/4040795407 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa45006a460 msgr2=0x7fa45006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.761 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.760+0000 7fa4759f1640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa45006a460 0x7fa45006c920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa458006fd0 tx=0x7fa458008040 comp rx=0 tx=0).stop 2023-12-19T05:40:13.761 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.760+0000 7fa4759f1640 1 -- 172.21.15.120:0/4040795407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa47006ae10 msgr2=0x7fa470143e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:40:13.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.760+0000 7fa4759f1640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa47006ae10 0x7fa470143e90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa46000c4d0 tx=0x7fa46000c990 comp rx=0 tx=0).stop 2023-12-19T05:40:13.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.760+0000 7fa4759f1640 1 -- 172.21.15.120:0/4040795407 shutdown_connections 2023-12-19T05:40:13.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.760+0000 7fa4759f1640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fa45006a460 0x7fa45006c920 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.760+0000 7fa4759f1640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fa47014b700 0x7fa470135ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.760+0000 7fa4759f1640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa470144d60 0x7fa4700a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.760+0000 7fa4759f1640 1 --2- 172.21.15.120:0/4040795407 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fa47006ae10 0x7fa470143e90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:40:13.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.760+0000 7fa4759f1640 1 -- 172.21.15.120:0/4040795407 >> 172.21.15.120:0/4040795407 conn(0x7fa4700bac10 msgr2=0x7fa470148e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:40:13.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.760+0000 7fa4759f1640 1 -- 172.21.15.120:0/4040795407 shutdown_connections 2023-12-19T05:40:13.762 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:40:13.760+0000 7fa4759f1640 1 -- 172.21.15.120:0/4040795407 wait complete. 2023-12-19T05:40:13.772 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:40:13.772 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/tmp/tmp.3GYFeLTziIxfstests-dev/local.config 2023-12-19T05:40:13.851 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.120:6789:/test export TEST_DIR=/tmp/tmp.gKLPzIzpajtest export SCRATCH_DEV=172.21.15.120:6789:/scratch export SCRATCH_MNT=/tmp/tmp.5OkJwJdUnTscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQA4LIFljwWIAxAAGU4DYcPLGx3//cKl4HJCQA==" 2023-12-19T05:40:13.851 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:40:13.851 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/tmp/tmp.3GYFeLTziIxfstests-dev/ceph.exclude 2023-12-19T05:40:13.969 DEBUG:teuthology.orchestra.run.smithi188:> (cd /tmp/tmp.3GYFeLTziIxfstests-dev && exec sudo make) 2023-12-19T05:40:14.099 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize -cfi 2023-12-19T05:40:14.647 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: putting auxiliary files in '.'. 2023-12-19T05:40:14.647 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file './config.guess' 2023-12-19T05:40:14.658 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file './config.sub' 2023-12-19T05:40:14.669 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file './install-sh' 2023-12-19T05:40:14.681 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file './ltmain.sh' 2023-12-19T05:40:14.754 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-12-19T05:40:14.754 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-12-19T05:40:14.767 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-12-19T05:40:14.783 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-12-19T05:40:14.797 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-12-19T05:40:14.812 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-12-19T05:40:14.832 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-12-19T05:40:14.835 INFO:teuthology.orchestra.run.smithi188.stdout:cp include/install-sh . 2023-12-19T05:40:14.837 INFO:teuthology.orchestra.run.smithi188.stdout:aclocal -I m4 2023-12-19T05:40:16.110 INFO:teuthology.orchestra.run.smithi188.stdout:autoheader 2023-12-19T05:40:16.485 INFO:teuthology.orchestra.run.smithi188.stdout:autoconf 2023-12-19T05:40:16.708 INFO:teuthology.orchestra.run.smithi188.stdout:./configure \ 2023-12-19T05:40:16.708 INFO:teuthology.orchestra.run.smithi188.stdout: --libexecdir=/usr/lib \ 2023-12-19T05:40:16.708 INFO:teuthology.orchestra.run.smithi188.stdout: --exec_prefix=/var/lib 2023-12-19T05:40:17.083 INFO:teuthology.orchestra.run.smithi188.stdout:checking build system type... x86_64-pc-linux-gnu 2023-12-19T05:40:17.083 INFO:teuthology.orchestra.run.smithi188.stdout:checking host system type... x86_64-pc-linux-gnu 2023-12-19T05:40:17.087 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to print strings... printf 2023-12-19T05:40:17.087 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gcc... gcc 2023-12-19T05:40:17.264 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether the C compiler works... yes 2023-12-19T05:40:17.265 INFO:teuthology.orchestra.run.smithi188.stdout:checking for C compiler default output file name... a.out 2023-12-19T05:40:17.327 INFO:teuthology.orchestra.run.smithi188.stdout:checking for suffix of executables... 2023-12-19T05:40:17.418 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether we are cross compiling... no 2023-12-19T05:40:17.458 INFO:teuthology.orchestra.run.smithi188.stdout:checking for suffix of object files... o 2023-12-19T05:40:17.491 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether we are using the GNU C compiler... yes 2023-12-19T05:40:17.531 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether gcc accepts -g... yes 2023-12-19T05:40:17.582 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-19T05:40:17.591 INFO:teuthology.orchestra.run.smithi188.stdout:checking for a sed that does not truncate output... /bin/sed 2023-12-19T05:40:17.597 INFO:teuthology.orchestra.run.smithi188.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-12-19T05:40:17.600 INFO:teuthology.orchestra.run.smithi188.stdout:checking for egrep... /bin/grep -E 2023-12-19T05:40:17.604 INFO:teuthology.orchestra.run.smithi188.stdout:checking for fgrep... /bin/grep -F 2023-12-19T05:40:17.613 INFO:teuthology.orchestra.run.smithi188.stdout:checking for ld used by gcc... /bin/ld 2023-12-19T05:40:17.619 INFO:teuthology.orchestra.run.smithi188.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-12-19T05:40:17.624 INFO:teuthology.orchestra.run.smithi188.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-12-19T05:40:18.772 INFO:teuthology.orchestra.run.smithi188.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-12-19T05:40:18.772 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether ln -s works... yes 2023-12-19T05:40:18.789 INFO:teuthology.orchestra.run.smithi188.stdout:checking the maximum length of command line arguments... 1572864 2023-12-19T05:40:18.798 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-12-19T05:40:18.798 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-12-19T05:40:18.798 INFO:teuthology.orchestra.run.smithi188.stdout:checking for /bin/ld option to reload object files... -r 2023-12-19T05:40:18.799 INFO:teuthology.orchestra.run.smithi188.stdout:checking for objdump... objdump 2023-12-19T05:40:18.799 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to recognize dependent libraries... pass_all 2023-12-19T05:40:18.799 INFO:teuthology.orchestra.run.smithi188.stdout:checking for dlltool... no 2023-12-19T05:40:18.799 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-12-19T05:40:18.800 INFO:teuthology.orchestra.run.smithi188.stdout:checking for ar... ar 2023-12-19T05:40:18.920 INFO:teuthology.orchestra.run.smithi188.stdout:checking for archiver @FILE support... @ 2023-12-19T05:40:18.920 INFO:teuthology.orchestra.run.smithi188.stdout:checking for strip... strip 2023-12-19T05:40:18.921 INFO:teuthology.orchestra.run.smithi188.stdout:checking for ranlib... ranlib 2023-12-19T05:40:18.921 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gawk... gawk 2023-12-19T05:40:19.072 INFO:teuthology.orchestra.run.smithi188.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-12-19T05:40:19.075 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sysroot... no 2023-12-19T05:40:19.084 INFO:teuthology.orchestra.run.smithi188.stdout:checking for a working dd... /bin/dd 2023-12-19T05:40:19.093 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-12-19T05:40:19.124 INFO:teuthology.orchestra.run.smithi188.stdout:checking for mt... no 2023-12-19T05:40:19.131 INFO:teuthology.orchestra.run.smithi188.stdout:checking if : is a manifest tool... no 2023-12-19T05:40:19.220 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to run the C preprocessor... gcc -E 2023-12-19T05:40:19.569 INFO:teuthology.orchestra.run.smithi188.stdout:checking for ANSI C header files... yes 2023-12-19T05:40:19.616 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/types.h... yes 2023-12-19T05:40:19.686 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/stat.h... yes 2023-12-19T05:40:19.741 INFO:teuthology.orchestra.run.smithi188.stdout:checking for stdlib.h... yes 2023-12-19T05:40:19.799 INFO:teuthology.orchestra.run.smithi188.stdout:checking for string.h... yes 2023-12-19T05:40:19.872 INFO:teuthology.orchestra.run.smithi188.stdout:checking for memory.h... yes 2023-12-19T05:40:19.930 INFO:teuthology.orchestra.run.smithi188.stdout:checking for strings.h... yes 2023-12-19T05:40:19.997 INFO:teuthology.orchestra.run.smithi188.stdout:checking for inttypes.h... yes 2023-12-19T05:40:20.054 INFO:teuthology.orchestra.run.smithi188.stdout:checking for stdint.h... yes 2023-12-19T05:40:20.130 INFO:teuthology.orchestra.run.smithi188.stdout:checking for unistd.h... yes 2023-12-19T05:40:20.198 INFO:teuthology.orchestra.run.smithi188.stdout:checking for dlfcn.h... yes 2023-12-19T05:40:20.207 INFO:teuthology.orchestra.run.smithi188.stdout:checking for objdir... .libs 2023-12-19T05:40:20.376 INFO:teuthology.orchestra.run.smithi188.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-12-19T05:40:20.376 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-12-19T05:40:20.449 INFO:teuthology.orchestra.run.smithi188.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-12-19T05:40:20.500 INFO:teuthology.orchestra.run.smithi188.stdout:checking if gcc static flag -static works... no 2023-12-19T05:40:20.571 INFO:teuthology.orchestra.run.smithi188.stdout:checking if gcc supports -c -o file.o... yes 2023-12-19T05:40:20.572 INFO:teuthology.orchestra.run.smithi188.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-12-19T05:40:20.598 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-12-19T05:40:20.670 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether -lc should be explicitly linked in... no 2023-12-19T05:40:20.849 INFO:teuthology.orchestra.run.smithi188.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-12-19T05:40:20.849 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to hardcode library paths into programs... immediate 2023-12-19T05:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether stripping libraries is possible... yes 2023-12-19T05:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout:checking if libtool supports shared libraries... yes 2023-12-19T05:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether to build shared libraries... yes 2023-12-19T05:40:20.853 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether to build static libraries... yes 2023-12-19T05:40:20.874 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gcc... (cached) gcc 2023-12-19T05:40:20.935 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-19T05:40:20.936 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-19T05:40:20.937 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-19T05:40:20.938 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gmake... /usr/bin/gmake 2023-12-19T05:40:20.938 INFO:teuthology.orchestra.run.smithi188.stderr:./configure: line 12083: test: $(SHELL): binary operator expected 2023-12-19T05:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout:checking for tar... /bin/tar 2023-12-19T05:40:20.939 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gzip... /bin/gzip 2023-12-19T05:40:20.968 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether gcc -MM is supported... yes 2023-12-19T05:40:20.969 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sort... /bin/sort 2023-12-19T05:40:20.970 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether ln -s works... yes 2023-12-19T05:40:20.970 INFO:teuthology.orchestra.run.smithi188.stdout:checking for rpm... /bin/rpm 2023-12-19T05:40:20.982 INFO:teuthology.orchestra.run.smithi188.stdout:checking for rpmbuild... no 2023-12-19T05:40:21.062 INFO:teuthology.orchestra.run.smithi188.stdout:checking assert.h usability... yes 2023-12-19T05:40:21.088 INFO:teuthology.orchestra.run.smithi188.stdout:checking assert.h presence... yes 2023-12-19T05:40:21.088 INFO:teuthology.orchestra.run.smithi188.stdout:checking for assert.h... yes 2023-12-19T05:40:21.168 INFO:teuthology.orchestra.run.smithi188.stdout:checking bstring.h usability... no 2023-12-19T05:40:21.211 INFO:teuthology.orchestra.run.smithi188.stdout:checking bstring.h presence... no 2023-12-19T05:40:21.211 INFO:teuthology.orchestra.run.smithi188.stdout:checking for bstring.h... no 2023-12-19T05:40:21.287 INFO:teuthology.orchestra.run.smithi188.stdout:checking libgen.h usability... yes 2023-12-19T05:40:21.311 INFO:teuthology.orchestra.run.smithi188.stdout:checking libgen.h presence... yes 2023-12-19T05:40:21.311 INFO:teuthology.orchestra.run.smithi188.stdout:checking for libgen.h... yes 2023-12-19T05:40:21.409 INFO:teuthology.orchestra.run.smithi188.stdout:checking dirent.h usability... yes 2023-12-19T05:40:21.437 INFO:teuthology.orchestra.run.smithi188.stdout:checking dirent.h presence... yes 2023-12-19T05:40:21.437 INFO:teuthology.orchestra.run.smithi188.stdout:checking for dirent.h... yes 2023-12-19T05:40:21.540 INFO:teuthology.orchestra.run.smithi188.stdout:checking errno.h usability... yes 2023-12-19T05:40:21.568 INFO:teuthology.orchestra.run.smithi188.stdout:checking errno.h presence... yes 2023-12-19T05:40:21.568 INFO:teuthology.orchestra.run.smithi188.stdout:checking for errno.h... yes 2023-12-19T05:40:21.650 INFO:teuthology.orchestra.run.smithi188.stdout:checking malloc.h usability... yes 2023-12-19T05:40:21.680 INFO:teuthology.orchestra.run.smithi188.stdout:checking malloc.h presence... yes 2023-12-19T05:40:21.680 INFO:teuthology.orchestra.run.smithi188.stdout:checking for malloc.h... yes 2023-12-19T05:40:21.761 INFO:teuthology.orchestra.run.smithi188.stdout:checking uuid.h usability... no 2023-12-19T05:40:21.801 INFO:teuthology.orchestra.run.smithi188.stdout:checking uuid.h presence... no 2023-12-19T05:40:21.802 INFO:teuthology.orchestra.run.smithi188.stdout:checking for uuid.h... no 2023-12-19T05:40:21.889 INFO:teuthology.orchestra.run.smithi188.stdout:checking uuid/uuid.h usability... yes 2023-12-19T05:40:21.916 INFO:teuthology.orchestra.run.smithi188.stdout:checking uuid/uuid.h presence... yes 2023-12-19T05:40:21.916 INFO:teuthology.orchestra.run.smithi188.stdout:checking for uuid/uuid.h... yes 2023-12-19T05:40:21.993 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/uuid.h usability... no 2023-12-19T05:40:22.035 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/uuid.h presence... no 2023-12-19T05:40:22.036 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/uuid.h... no 2023-12-19T05:40:22.122 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/file.h usability... yes 2023-12-19T05:40:22.149 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/file.h presence... yes 2023-12-19T05:40:22.149 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/file.h... yes 2023-12-19T05:40:22.243 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/fcntl.h usability... yes 2023-12-19T05:40:22.271 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/fcntl.h presence... yes 2023-12-19T05:40:22.271 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/fcntl.h... yes 2023-12-19T05:40:22.349 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/syssgi.h usability... no 2023-12-19T05:40:22.390 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/syssgi.h presence... no 2023-12-19T05:40:22.390 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/syssgi.h... no 2023-12-19T05:40:22.491 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/param.h usability... yes 2023-12-19T05:40:22.522 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/param.h presence... yes 2023-12-19T05:40:22.522 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/param.h... yes 2023-12-19T05:40:22.542 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/stat.h... (cached) yes 2023-12-19T05:40:22.628 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/statvfs.h usability... yes 2023-12-19T05:40:22.654 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/statvfs.h presence... yes 2023-12-19T05:40:22.654 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/statvfs.h... yes 2023-12-19T05:40:22.729 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/time.h usability... yes 2023-12-19T05:40:22.758 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/time.h presence... yes 2023-12-19T05:40:22.758 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/time.h... yes 2023-12-19T05:40:22.854 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/ioctl.h usability... yes 2023-12-19T05:40:22.881 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/ioctl.h presence... yes 2023-12-19T05:40:22.881 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/ioctl.h... yes 2023-12-19T05:40:22.977 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/wait.h usability... yes 2023-12-19T05:40:23.007 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/wait.h presence... yes 2023-12-19T05:40:23.008 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/wait.h... yes 2023-12-19T05:40:23.026 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/types.h... (cached) yes 2023-12-19T05:40:23.043 INFO:teuthology.orchestra.run.smithi188.stdout:checking for strings.h... (cached) yes 2023-12-19T05:40:23.122 INFO:teuthology.orchestra.run.smithi188.stdout:checking err.h usability... yes 2023-12-19T05:40:23.150 INFO:teuthology.orchestra.run.smithi188.stdout:checking err.h presence... yes 2023-12-19T05:40:23.150 INFO:teuthology.orchestra.run.smithi188.stdout:checking for err.h... yes 2023-12-19T05:40:23.233 INFO:teuthology.orchestra.run.smithi188.stdout:checking linux/falloc.h usability... yes 2023-12-19T05:40:23.260 INFO:teuthology.orchestra.run.smithi188.stdout:checking linux/falloc.h presence... yes 2023-12-19T05:40:23.260 INFO:teuthology.orchestra.run.smithi188.stdout:checking for linux/falloc.h... yes 2023-12-19T05:40:23.343 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-12-19T05:40:23.383 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-12-19T05:40:23.383 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/fs/xfs_fsops.h... no 2023-12-19T05:40:23.454 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/fs/xfs_itable.h usability... no 2023-12-19T05:40:23.497 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/fs/xfs_itable.h presence... no 2023-12-19T05:40:23.497 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/fs/xfs_itable.h... no 2023-12-19T05:40:23.573 INFO:teuthology.orchestra.run.smithi188.stdout:checking xfs/platform_defs.h usability... no 2023-12-19T05:40:23.615 INFO:teuthology.orchestra.run.smithi188.stdout:checking xfs/platform_defs.h presence... no 2023-12-19T05:40:23.615 INFO:teuthology.orchestra.run.smithi188.stdout:checking for xfs/platform_defs.h... no 2023-12-19T05:40:23.687 INFO:teuthology.orchestra.run.smithi188.stdout:checking btrfs/ioctl.h usability... no 2023-12-19T05:40:23.727 INFO:teuthology.orchestra.run.smithi188.stdout:checking btrfs/ioctl.h presence... no 2023-12-19T05:40:23.728 INFO:teuthology.orchestra.run.smithi188.stdout:checking for btrfs/ioctl.h... no 2023-12-19T05:40:23.800 INFO:teuthology.orchestra.run.smithi188.stdout:checking cifs/ioctl.h usability... no 2023-12-19T05:40:23.843 INFO:teuthology.orchestra.run.smithi188.stdout:checking cifs/ioctl.h presence... no 2023-12-19T05:40:23.843 INFO:teuthology.orchestra.run.smithi188.stdout:checking for cifs/ioctl.h... no 2023-12-19T05:40:23.918 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/mman.h usability... yes 2023-12-19T05:40:23.946 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/mman.h presence... yes 2023-12-19T05:40:23.946 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/mman.h... yes 2023-12-19T05:40:24.003 INFO:teuthology.orchestra.run.smithi188.stdout:checking for xfs/xfs_log_format.h... no 2023-12-19T05:40:24.100 INFO:teuthology.orchestra.run.smithi188.stdout:checking for uuid_compare... no 2023-12-19T05:40:24.180 INFO:teuthology.orchestra.run.smithi188.stdout:checking for uuid_compare in -luuid... yes 2023-12-19T05:40:24.308 INFO:teuthology.orchestra.run.smithi188.stdout:checking for xfs/xfs.h... yes 2023-12-19T05:40:24.357 INFO:teuthology.orchestra.run.smithi188.stdout:checking for xfs/libxfs.h... no 2023-12-19T05:40:24.419 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether xlog_assign_lsn is declared... no 2023-12-19T05:40:24.494 INFO:teuthology.orchestra.run.smithi188.stdout:checking for xfs/xqm.h... yes 2023-12-19T05:40:24.600 INFO:teuthology.orchestra.run.smithi188.stdout:checking xfsctl from xfs/xfs.h... ok 2023-12-19T05:40:24.658 INFO:teuthology.orchestra.run.smithi188.stdout:checking xfs/handle.h usability... yes 2023-12-19T05:40:24.682 INFO:teuthology.orchestra.run.smithi188.stdout:checking xfs/handle.h presence... yes 2023-12-19T05:40:24.682 INFO:teuthology.orchestra.run.smithi188.stdout:checking for xfs/handle.h... yes 2023-12-19T05:40:24.777 INFO:teuthology.orchestra.run.smithi188.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-12-19T05:40:24.841 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/acl.h usability... yes 2023-12-19T05:40:24.868 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/acl.h presence... yes 2023-12-19T05:40:24.868 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/acl.h... yes 2023-12-19T05:40:24.933 INFO:teuthology.orchestra.run.smithi188.stdout:checking acl/libacl.h usability... yes 2023-12-19T05:40:24.967 INFO:teuthology.orchestra.run.smithi188.stdout:checking acl/libacl.h presence... yes 2023-12-19T05:40:24.967 INFO:teuthology.orchestra.run.smithi188.stdout:checking for acl/libacl.h... yes 2023-12-19T05:40:25.055 INFO:teuthology.orchestra.run.smithi188.stdout:checking for acl_init in -lacl... yes 2023-12-19T05:40:25.120 INFO:teuthology.orchestra.run.smithi188.stdout:checking gdbm-ndbm.h usability... no 2023-12-19T05:40:25.163 INFO:teuthology.orchestra.run.smithi188.stdout:checking gdbm-ndbm.h presence... no 2023-12-19T05:40:25.164 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gdbm-ndbm.h... no 2023-12-19T05:40:25.230 INFO:teuthology.orchestra.run.smithi188.stdout:checking gdbm/ndbm.h usability... no 2023-12-19T05:40:25.272 INFO:teuthology.orchestra.run.smithi188.stdout:checking gdbm/ndbm.h presence... no 2023-12-19T05:40:25.273 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gdbm/ndbm.h... no 2023-12-19T05:40:25.337 INFO:teuthology.orchestra.run.smithi188.stdout:checking ndbm.h usability... no 2023-12-19T05:40:25.378 INFO:teuthology.orchestra.run.smithi188.stdout:checking ndbm.h presence... no 2023-12-19T05:40:25.378 INFO:teuthology.orchestra.run.smithi188.stdout:checking for ndbm.h... no 2023-12-19T05:40:25.441 INFO:teuthology.orchestra.run.smithi188.stdout:checking libaio.h usability... yes 2023-12-19T05:40:25.470 INFO:teuthology.orchestra.run.smithi188.stdout:checking libaio.h presence... yes 2023-12-19T05:40:25.471 INFO:teuthology.orchestra.run.smithi188.stdout:checking for libaio.h... yes 2023-12-19T05:40:25.531 INFO:teuthology.orchestra.run.smithi188.stdout:checking liburing.h usability... no 2023-12-19T05:40:25.572 INFO:teuthology.orchestra.run.smithi188.stdout:checking liburing.h presence... no 2023-12-19T05:40:25.573 INFO:teuthology.orchestra.run.smithi188.stdout:checking for liburing.h... no 2023-12-19T05:40:25.636 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/capability.h usability... no 2023-12-19T05:40:25.677 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/capability.h presence... no 2023-12-19T05:40:25.677 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/capability.h... no 2023-12-19T05:40:25.741 INFO:teuthology.orchestra.run.smithi188.stdout:checking linux/fiemap.h usability... yes 2023-12-19T05:40:25.765 INFO:teuthology.orchestra.run.smithi188.stdout:checking linux/fiemap.h presence... yes 2023-12-19T05:40:25.765 INFO:teuthology.orchestra.run.smithi188.stdout:checking for linux/fiemap.h... yes 2023-12-19T05:40:25.854 INFO:teuthology.orchestra.run.smithi188.stdout:checking for fallocate... yes 2023-12-19T05:40:25.938 INFO:teuthology.orchestra.run.smithi188.stdout:checking for open_by_handle_at... yes 2023-12-19T05:40:26.015 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/prctl.h usability... yes 2023-12-19T05:40:26.043 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/prctl.h presence... yes 2023-12-19T05:40:26.043 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/prctl.h... yes 2023-12-19T05:40:26.109 INFO:teuthology.orchestra.run.smithi188.stdout:checking linux/fs.h usability... yes 2023-12-19T05:40:26.133 INFO:teuthology.orchestra.run.smithi188.stdout:checking linux/fs.h presence... yes 2023-12-19T05:40:26.134 INFO:teuthology.orchestra.run.smithi188.stdout:checking for linux/fs.h... yes 2023-12-19T05:40:26.193 INFO:teuthology.orchestra.run.smithi188.stdout:checking btrfsutil.h usability... no 2023-12-19T05:40:26.231 INFO:teuthology.orchestra.run.smithi188.stdout:checking btrfsutil.h presence... no 2023-12-19T05:40:26.231 INFO:teuthology.orchestra.run.smithi188.stdout:checking for btrfsutil.h... no 2023-12-19T05:40:26.321 INFO:teuthology.orchestra.run.smithi188.stdout:checking for copy_file_range... yes 2023-12-19T05:40:26.411 INFO:teuthology.orchestra.run.smithi188.stdout:checking for SEEK_DATA... yes 2023-12-19T05:40:26.521 INFO:teuthology.orchestra.run.smithi188.stdout:checking for BMV_OF_SHARED... yes 2023-12-19T05:40:26.611 INFO:teuthology.orchestra.run.smithi188.stdout:checking for nftw... yes 2023-12-19T05:40:26.713 INFO:teuthology.orchestra.run.smithi188.stdout:checking for RLIMIT_NOFILE... yes 2023-12-19T05:40:26.796 INFO:teuthology.orchestra.run.smithi188.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2023-12-19T05:40:26.886 INFO:teuthology.orchestra.run.smithi188.stdout:checking for FICLONE... yes 2023-12-19T05:40:26.968 INFO:teuthology.orchestra.run.smithi188.stdout:checking for renameat2... yes 2023-12-19T05:40:27.044 INFO:teuthology.orchestra.run.smithi188.stdout:checking for reallocarray... yes 2023-12-19T05:40:27.143 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct mount_attr... yes 2023-12-19T05:40:27.252 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct btrfs_qgroup_limit... yes 2023-12-19T05:40:27.361 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-12-19T05:40:27.465 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-12-19T05:40:27.567 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-12-19T05:40:27.670 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-12-19T05:40:27.773 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-12-19T05:40:27.878 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-12-19T05:40:27.955 INFO:teuthology.orchestra.run.smithi188.stdout:checking linux/btrfs.h usability... yes 2023-12-19T05:40:27.982 INFO:teuthology.orchestra.run.smithi188.stdout:checking linux/btrfs.h presence... yes 2023-12-19T05:40:27.982 INFO:teuthology.orchestra.run.smithi188.stdout:checking for linux/btrfs.h... yes 2023-12-19T05:40:28.079 INFO:teuthology.orchestra.run.smithi188.stdout:checking linux/btrfs_tree.h usability... yes 2023-12-19T05:40:28.107 INFO:teuthology.orchestra.run.smithi188.stdout:checking linux/btrfs_tree.h presence... yes 2023-12-19T05:40:28.107 INFO:teuthology.orchestra.run.smithi188.stdout:checking for linux/btrfs_tree.h... yes 2023-12-19T05:40:28.173 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-12-19T05:40:28.212 INFO:teuthology.orchestra.run.smithi188.stdout:configure: creating ./config.status 2023-12-19T05:40:28.521 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:40:28.524 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:40:28.527 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:40:29.451 INFO:teuthology.orchestra.run.smithi188.stdout:config.status: creating include/builddefs 2023-12-19T05:40:29.494 INFO:teuthology.orchestra.run.smithi188.stdout:config.status: creating include/config.h 2023-12-19T05:40:29.527 INFO:teuthology.orchestra.run.smithi188.stdout:config.status: executing libtool commands 2023-12-19T05:40:29.634 INFO:teuthology.orchestra.run.smithi188.stdout:Building include 2023-12-19T05:40:29.645 INFO:teuthology.orchestra.run.smithi188.stdout:Building lib 2023-12-19T05:40:29.654 INFO:teuthology.orchestra.run.smithi188.stdout: [LTDEP] 2023-12-19T05:40:29.950 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] dataascii.lo 2023-12-19T05:40:30.187 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] databin.lo 2023-12-19T05:40:30.456 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] datapid.lo 2023-12-19T05:40:30.662 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] file_lock.lo 2023-12-19T05:40:30.923 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] forker.lo 2023-12-19T05:40:31.176 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] pattern.lo 2023-12-19T05:40:31.409 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] open_flags.lo 2023-12-19T05:40:31.674 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] random_range.lo 2023-12-19T05:40:32.055 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] string_to_tokens.lo 2023-12-19T05:40:32.281 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] str_to_bytes.lo 2023-12-19T05:40:32.552 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] tlibio.lo 2023-12-19T05:40:32.964 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] write_log.lo 2023-12-19T05:40:33.373 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] random.lo 2023-12-19T05:40:33.666 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] 2023-12-19T05:40:33.912 INFO:teuthology.orchestra.run.smithi188.stdout:Building ltp 2023-12-19T05:40:33.921 INFO:teuthology.orchestra.run.smithi188.stdout: [DEP] 2023-12-19T05:40:34.249 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] doio 2023-12-19T05:40:35.156 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fsstress 2023-12-19T05:40:36.758 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fsx 2023-12-19T05:40:37.726 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] growfiles 2023-12-19T05:40:38.425 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] iogen 2023-12-19T05:40:39.019 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-stress 2023-12-19T05:40:39.618 INFO:teuthology.orchestra.run.smithi188.stdout:Building src 2023-12-19T05:40:39.631 INFO:teuthology.orchestra.run.smithi188.stdout: [DEP] 2023-12-19T05:40:43.366 INFO:teuthology.orchestra.run.smithi188.stdout: [DEP] 2023-12-19T05:40:43.441 INFO:teuthology.orchestra.run.smithi188.stdout: [DEP] 2023-12-19T05:40:43.464 INFO:teuthology.orchestra.run.smithi188.stdout: [DEP] 2023-12-19T05:40:43.947 INFO:teuthology.orchestra.run.smithi188.stdout: [DEP] 2023-12-19T05:40:44.002 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] dirstress 2023-12-19T05:40:44.447 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fill 2023-12-19T05:40:44.787 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fill2 2023-12-19T05:40:45.180 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] getpagesize 2023-12-19T05:40:45.513 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] holes 2023-12-19T05:40:45.897 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] lstat64 2023-12-19T05:40:46.238 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] nametest 2023-12-19T05:40:46.674 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] permname 2023-12-19T05:40:47.074 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] randholes 2023-12-19T05:40:47.549 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] runas 2023-12-19T05:40:47.894 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] truncfile 2023-12-19T05:40:48.299 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] usemem 2023-12-19T05:40:48.619 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] mmapcat 2023-12-19T05:40:48.981 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] append_reader 2023-12-19T05:40:49.329 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] append_writer 2023-12-19T05:40:49.649 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] dirperf 2023-12-19T05:40:50.064 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] metaperf 2023-12-19T05:40:50.527 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] devzero 2023-12-19T05:40:50.892 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] feature 2023-12-19T05:40:51.295 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] alloc 2023-12-19T05:40:51.657 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fault 2023-12-19T05:40:52.000 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fstest 2023-12-19T05:40:52.419 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_access_root 2023-12-19T05:40:52.747 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] godown 2023-12-19T05:40:53.120 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] resvtest 2023-12-19T05:40:53.468 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] writemod 2023-12-19T05:40:53.812 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] writev_on_pagefault 2023-12-19T05:40:54.173 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] makeextents 2023-12-19T05:40:54.535 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] itrash 2023-12-19T05:40:54.835 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] rename 2023-12-19T05:40:55.150 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] multi_open_unlink 2023-12-19T05:40:55.490 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] unwritten_sync 2023-12-19T05:40:55.834 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] genhashnames 2023-12-19T05:40:56.206 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_holes 2023-12-19T05:40:56.528 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_mmap_writev 2023-12-19T05:40:56.870 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_truncate_cmtime 2023-12-19T05:40:57.210 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] dirhash_collide 2023-12-19T05:40:57.571 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_rename_overwrite 2023-12-19T05:40:57.873 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] holetest 2023-12-19T05:40:58.275 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_truncate_self 2023-12-19T05:40:58.620 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] af_unix 2023-12-19T05:40:58.644 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:40:58.647 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:40:58.650 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:40:58.909 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_mmap_stale_pmd 2023-12-19T05:40:59.239 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_mmap_cow_race 2023-12-19T05:40:59.614 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_mmap_fallocate 2023-12-19T05:40:59.923 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fsync-err 2023-12-19T05:41:00.307 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_mmap_write_ro 2023-12-19T05:41:00.649 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_ext4_dax_journal_corruption 2023-12-19T05:41:00.989 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_ext4_dax_inline_corruption 2023-12-19T05:41:01.301 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_ofd_locks 2023-12-19T05:41:01.680 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_mmap_collision 2023-12-19T05:41:02.063 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] mmap-write-concurrent 2023-12-19T05:41:02.441 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_get_file_time 2023-12-19T05:41:02.773 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_create_short_dirs 2023-12-19T05:41:03.122 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_create_long_dirs 2023-12-19T05:41:03.474 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_enospc 2023-12-19T05:41:03.853 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_mmap_writev_overlap 2023-12-19T05:41:04.210 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] checkpoint_journal 2023-12-19T05:41:04.573 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] mmap-rw-fault 2023-12-19T05:41:04.945 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] allocstale 2023-12-19T05:41:05.283 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_mmap_cow_memory_failure 2023-12-19T05:41:05.634 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fake-dump-rootino 2023-12-19T05:41:05.940 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] dio-buf-fault 2023-12-19T05:41:06.286 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] rewinddir-test 2023-12-19T05:41:06.648 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfsctl 2023-12-19T05:41:07.025 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] bstat 2023-12-19T05:41:07.399 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_mtab 2023-12-19T05:41:07.762 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] getdevicesize 2023-12-19T05:41:08.079 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] preallo_rw_pattern_reader 2023-12-19T05:41:08.448 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] preallo_rw_pattern_writer 2023-12-19T05:41:08.817 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] ftrunc 2023-12-19T05:41:09.144 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] trunc 2023-12-19T05:41:09.454 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fs_perms 2023-12-19T05:41:09.803 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] testx 2023-12-19T05:41:10.109 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] looptest 2023-12-19T05:41:10.491 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] locktest 2023-12-19T05:41:11.013 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] unwritten_mmap 2023-12-19T05:41:11.358 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] bulkstat_unlink_test 2023-12-19T05:41:11.749 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] deduperace 2023-12-19T05:41:12.121 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] bulkstat_unlink_test_modified 2023-12-19T05:41:12.507 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_dir_offset 2023-12-19T05:41:12.837 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_futimens 2023-12-19T05:41:13.133 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_immutable 2023-12-19T05:41:13.982 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] stale_handle 2023-12-19T05:41:14.330 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] pwrite_mmap_blocked 2023-12-19T05:41:14.676 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_dir_offset2 2023-12-19T05:41:15.058 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] seek_sanity_test 2023-12-19T05:41:15.688 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] seek_copy_test 2023-12-19T05:41:16.051 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_readdir_1 2023-12-19T05:41:16.342 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_readdir_2 2023-12-19T05:41:16.707 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fsync-tester 2023-12-19T05:41:17.158 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] nsexec 2023-12-19T05:41:17.499 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] cloner 2023-12-19T05:41:17.848 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] renameat2 2023-12-19T05:41:18.213 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_getcwd 2023-12-19T05:41:18.540 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] e4compact 2023-12-19T05:41:18.955 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] test-nextquota 2023-12-19T05:41:19.305 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] punch-alternating 2023-12-19T05:41:19.634 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] attr-list-by-handle-cursor-test 2023-12-19T05:41:20.008 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] listxattr 2023-12-19T05:41:20.341 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] dio-interleaved 2023-12-19T05:41:20.686 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_dir_type 2023-12-19T05:41:21.013 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] dio-invalidate-cache 2023-12-19T05:41:21.377 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] stat_test 2023-12-19T05:41:21.835 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_encrypted_d_revalidate 2023-12-19T05:41:22.159 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] attr_replace_test 2023-12-19T05:41:22.494 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] swapon 2023-12-19T05:41:22.849 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] mkswap 2023-12-19T05:41:23.222 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_attr_corruption 2023-12-19T05:41:23.549 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_open_tmpfiles 2023-12-19T05:41:23.893 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fscrypt-crypt-util 2023-12-19T05:41:24.769 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] bulkstat_null_ocount 2023-12-19T05:41:25.138 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] splice-test 2023-12-19T05:41:25.510 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] chprojid_fail 2023-12-19T05:41:25.862 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] detached_mounts_propagation 2023-12-19T05:41:26.216 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] ext4_resize 2023-12-19T05:41:26.574 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_readdir_3 2023-12-19T05:41:26.947 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] splice2pipe 2023-12-19T05:41:27.298 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] uuid_ioctl 2023-12-19T05:41:27.623 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fiemap-tester 2023-12-19T05:41:28.107 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_stripealign 2023-12-19T05:41:28.439 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] open_by_handle 2023-12-19T05:41:28.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:41:28.765 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:41:28.767 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:41:28.880 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_mmap_dio 2023-12-19T05:41:29.184 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfsfind 2023-12-19T05:41:29.566 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] t_reflink_read_race 2023-12-19T05:41:29.944 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fssum 2023-12-19T05:41:30.580 INFO:teuthology.orchestra.run.smithi188.stdout:Building log-writes 2023-12-19T05:41:30.593 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] replay-log 2023-12-19T05:41:31.136 INFO:teuthology.orchestra.run.smithi188.stdout:Building perf 2023-12-19T05:41:31.146 INFO:teuthology.orchestra.run.smithi188.stdout:Building aio-dio-regress 2023-12-19T05:41:31.161 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aiocp 2023-12-19T05:41:31.563 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-dio-append-write-fallocate-race 2023-12-19T05:41:31.915 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-dio-append-write-read-race 2023-12-19T05:41:32.275 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-dio-cow-race 2023-12-19T05:41:32.600 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-dio-cycle-write 2023-12-19T05:41:32.974 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-dio-eof-race 2023-12-19T05:41:33.341 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-dio-extend-stat 2023-12-19T05:41:33.681 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-dio-fcntl-race 2023-12-19T05:41:34.032 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-dio-hole-filling-race 2023-12-19T05:41:34.385 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-dio-invalidate-failure 2023-12-19T05:41:34.737 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-dio-invalidate-readahead 2023-12-19T05:41:35.089 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aiodio_sparse2 2023-12-19T05:41:35.475 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-dio-subblock-eof-read 2023-12-19T05:41:35.773 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-dio-write-verify 2023-12-19T05:41:36.159 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-12-19T05:41:36.468 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-12-19T05:41:36.781 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] aio-last-ref-held-by-io 2023-12-19T05:41:37.162 INFO:teuthology.orchestra.run.smithi188.stdout:Building vfs 2023-12-19T05:41:37.178 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] vfstest 2023-12-19T05:41:39.532 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] mount-idmapped 2023-12-19T05:41:40.144 INFO:teuthology.orchestra.run.smithi188.stdout:Building m4 2023-12-19T05:41:40.153 INFO:teuthology.orchestra.run.smithi188.stdout:Building common 2023-12-19T05:41:40.163 INFO:teuthology.orchestra.run.smithi188.stdout:Building tests 2023-12-19T05:41:40.178 INFO:teuthology.orchestra.run.smithi188.stdout:Building btrfs 2023-12-19T05:41:40.192 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/btrfs/group.list 2023-12-19T05:41:40.417 INFO:teuthology.orchestra.run.smithi188.stdout:Building ceph 2023-12-19T05:41:40.433 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/ceph/group.list 2023-12-19T05:41:40.488 INFO:teuthology.orchestra.run.smithi188.stdout:Building cifs 2023-12-19T05:41:40.503 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/cifs/group.list 2023-12-19T05:41:40.551 INFO:teuthology.orchestra.run.smithi188.stdout:Building ext4 2023-12-19T05:41:40.564 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/ext4/group.list 2023-12-19T05:41:40.699 INFO:teuthology.orchestra.run.smithi188.stdout:Building f2fs 2023-12-19T05:41:40.714 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/f2fs/group.list 2023-12-19T05:41:40.781 INFO:teuthology.orchestra.run.smithi188.stdout:Building generic 2023-12-19T05:41:40.799 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/generic/group.list 2023-12-19T05:41:41.167 INFO:teuthology.orchestra.run.smithi188.stdout:Building nfs 2023-12-19T05:41:41.181 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/nfs/group.list 2023-12-19T05:41:41.233 INFO:teuthology.orchestra.run.smithi188.stdout:Building ocfs2 2023-12-19T05:41:41.246 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/ocfs2/group.list 2023-12-19T05:41:41.295 INFO:teuthology.orchestra.run.smithi188.stdout:Building overlay 2023-12-19T05:41:41.308 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/overlay/group.list 2023-12-19T05:41:41.462 INFO:teuthology.orchestra.run.smithi188.stdout:Building perf 2023-12-19T05:41:41.477 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/perf/group.list 2023-12-19T05:41:41.517 INFO:teuthology.orchestra.run.smithi188.stdout:Building selftest 2023-12-19T05:41:41.530 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/selftest/group.list 2023-12-19T05:41:41.573 INFO:teuthology.orchestra.run.smithi188.stdout:Building shared 2023-12-19T05:41:41.584 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/shared/group.list 2023-12-19T05:41:41.641 INFO:teuthology.orchestra.run.smithi188.stdout:Building tmpfs 2023-12-19T05:41:41.655 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/tmpfs/group.list 2023-12-19T05:41:41.701 INFO:teuthology.orchestra.run.smithi188.stdout:Building udf 2023-12-19T05:41:41.714 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/udf/group.list 2023-12-19T05:41:41.751 INFO:teuthology.orchestra.run.smithi188.stdout:Building xfs 2023-12-19T05:41:41.765 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/xfs/group.list 2023-12-19T05:41:42.103 DEBUG:teuthology.orchestra.run.smithi188:> (cd /tmp/tmp.3GYFeLTziIxfstests-dev && exec sudo make install) 2023-12-19T05:41:42.226 INFO:teuthology.orchestra.run.smithi188.stdout:Building include 2023-12-19T05:41:42.236 INFO:teuthology.orchestra.run.smithi188.stdout:Building lib 2023-12-19T05:41:42.247 INFO:teuthology.orchestra.run.smithi188.stdout:Building ltp 2023-12-19T05:41:42.258 INFO:teuthology.orchestra.run.smithi188.stdout:Building src 2023-12-19T05:41:42.341 INFO:teuthology.orchestra.run.smithi188.stdout:Building log-writes 2023-12-19T05:41:42.351 INFO:teuthology.orchestra.run.smithi188.stdout:Building perf 2023-12-19T05:41:42.361 INFO:teuthology.orchestra.run.smithi188.stdout:Building aio-dio-regress 2023-12-19T05:41:42.373 INFO:teuthology.orchestra.run.smithi188.stdout:Building vfs 2023-12-19T05:41:42.384 INFO:teuthology.orchestra.run.smithi188.stdout:Building m4 2023-12-19T05:41:42.395 INFO:teuthology.orchestra.run.smithi188.stdout:Building common 2023-12-19T05:41:42.406 INFO:teuthology.orchestra.run.smithi188.stdout:Building tests 2023-12-19T05:41:42.421 INFO:teuthology.orchestra.run.smithi188.stdout:Building btrfs 2023-12-19T05:41:42.437 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/btrfs/group.list 2023-12-19T05:41:42.653 INFO:teuthology.orchestra.run.smithi188.stdout:Building ceph 2023-12-19T05:41:42.668 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/ceph/group.list 2023-12-19T05:41:42.721 INFO:teuthology.orchestra.run.smithi188.stdout:Building cifs 2023-12-19T05:41:42.736 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/cifs/group.list 2023-12-19T05:41:42.781 INFO:teuthology.orchestra.run.smithi188.stdout:Building ext4 2023-12-19T05:41:42.794 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/ext4/group.list 2023-12-19T05:41:42.923 INFO:teuthology.orchestra.run.smithi188.stdout:Building f2fs 2023-12-19T05:41:42.937 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/f2fs/group.list 2023-12-19T05:41:42.995 INFO:teuthology.orchestra.run.smithi188.stdout:Building generic 2023-12-19T05:41:43.011 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/generic/group.list 2023-12-19T05:41:43.375 INFO:teuthology.orchestra.run.smithi188.stdout:Building nfs 2023-12-19T05:41:43.393 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/nfs/group.list 2023-12-19T05:41:43.447 INFO:teuthology.orchestra.run.smithi188.stdout:Building ocfs2 2023-12-19T05:41:43.460 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/ocfs2/group.list 2023-12-19T05:41:43.508 INFO:teuthology.orchestra.run.smithi188.stdout:Building overlay 2023-12-19T05:41:43.521 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/overlay/group.list 2023-12-19T05:41:43.670 INFO:teuthology.orchestra.run.smithi188.stdout:Building perf 2023-12-19T05:41:43.684 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/perf/group.list 2023-12-19T05:41:43.726 INFO:teuthology.orchestra.run.smithi188.stdout:Building selftest 2023-12-19T05:41:43.739 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/selftest/group.list 2023-12-19T05:41:43.785 INFO:teuthology.orchestra.run.smithi188.stdout:Building shared 2023-12-19T05:41:43.799 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/shared/group.list 2023-12-19T05:41:43.864 INFO:teuthology.orchestra.run.smithi188.stdout:Building tmpfs 2023-12-19T05:41:43.878 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/tmpfs/group.list 2023-12-19T05:41:43.928 INFO:teuthology.orchestra.run.smithi188.stdout:Building udf 2023-12-19T05:41:43.942 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/udf/group.list 2023-12-19T05:41:43.985 INFO:teuthology.orchestra.run.smithi188.stdout:Building xfs 2023-12-19T05:41:44.002 INFO:teuthology.orchestra.run.smithi188.stdout: [GROUP] /tmp/tmp.3GYFeLTziIxfstests-dev/tests/xfs/group.list 2023-12-19T05:41:44.354 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-12-19T05:41:44.357 INFO:teuthology.orchestra.run.smithi188.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T05:41:44.358 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-12-19T05:41:44.363 INFO:teuthology.orchestra.run.smithi188.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T05:41:44.363 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-12-19T05:41:44.368 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-12-19T05:41:44.402 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-12-19T05:41:44.643 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-12-19T05:41:44.677 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-12-19T05:41:44.721 INFO:teuthology.orchestra.run.smithi188.stdout:Building log-writes 2023-12-19T05:41:44.732 INFO:teuthology.orchestra.run.smithi188.stdout:Building perf 2023-12-19T05:41:44.743 INFO:teuthology.orchestra.run.smithi188.stdout:Building aio-dio-regress 2023-12-19T05:41:44.754 INFO:teuthology.orchestra.run.smithi188.stdout:Building vfs 2023-12-19T05:41:44.763 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake -C log-writes install 2023-12-19T05:41:44.766 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-12-19T05:41:44.799 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-12-19T05:41:44.832 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake -C perf install 2023-12-19T05:41:44.835 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-12-19T05:41:44.868 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-12-19T05:41:44.953 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-12-19T05:41:44.958 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-12-19T05:41:44.991 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-12-19T05:41:45.184 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake -C vfs install 2023-12-19T05:41:45.188 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-12-19T05:41:45.221 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-12-19T05:41:45.265 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-12-19T05:41:45.299 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2023-12-19T05:41:49.681 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-12-19T05:41:50.011 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-12-19T05:41:50.081 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-12-19T05:41:50.085 INFO:teuthology.orchestra.run.smithi188.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T05:41:50.085 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-12-19T05:41:50.089 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-12-19T05:41:50.123 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-12-19T05:41:50.605 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-12-19T05:41:50.609 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/btrfs/ install 2023-12-19T05:41:50.616 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-12-19T05:41:50.648 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 /var/lib/xfstests/tests/btrfs 2023-12-19T05:41:53.697 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-12-19T05:41:53.728 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out /var/lib/xfstests/tests/btrfs 2023-12-19T05:41:56.849 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/ceph/ install 2023-12-19T05:41:56.853 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-12-19T05:41:56.886 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-12-19T05:41:56.959 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-12-19T05:41:56.993 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-12-19T05:41:57.067 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/cifs/ install 2023-12-19T05:41:57.071 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-12-19T05:41:57.104 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-12-19T05:41:57.138 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-12-19T05:41:57.170 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-12-19T05:41:57.203 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/ext4/ install 2023-12-19T05:41:57.207 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-12-19T05:41:57.241 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-12-19T05:41:57.948 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-12-19T05:41:57.981 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-12-19T05:41:58.715 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/f2fs/ install 2023-12-19T05:41:58.720 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-12-19T05:41:58.753 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-12-19T05:41:58.796 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-12-19T05:41:58.827 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-12-19T05:41:58.867 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/generic/ install 2023-12-19T05:41:58.876 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-12-19T05:41:58.891 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:41:58.894 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:41:58.896 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:41:58.910 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 /var/lib/xfstests/tests/generic 2023-12-19T05:42:06.176 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-12-19T05:42:06.206 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out /var/lib/xfstests/tests/generic 2023-12-19T05:42:13.703 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/nfs/ install 2023-12-19T05:42:13.706 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-12-19T05:42:13.740 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-12-19T05:42:13.772 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-12-19T05:42:13.805 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-12-19T05:42:13.838 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/ocfs2/ install 2023-12-19T05:42:13.842 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-12-19T05:42:13.875 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-12-19T05:42:13.908 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-12-19T05:42:13.941 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-12-19T05:42:13.974 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/overlay/ install 2023-12-19T05:42:13.979 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-12-19T05:42:14.012 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-12-19T05:42:15.063 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-12-19T05:42:15.095 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-12-19T05:42:16.276 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/perf/ install 2023-12-19T05:42:16.280 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-12-19T05:42:16.315 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-12-19T05:42:16.348 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-12-19T05:42:16.381 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-12-19T05:42:16.415 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/selftest/ install 2023-12-19T05:42:16.419 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-12-19T05:42:16.452 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-12-19T05:42:16.534 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-12-19T05:42:16.567 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-12-19T05:42:16.651 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/shared/ install 2023-12-19T05:42:16.655 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-12-19T05:42:16.688 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-12-19T05:42:16.741 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-12-19T05:42:16.774 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-12-19T05:42:16.825 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/tmpfs/ install 2023-12-19T05:42:16.829 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-12-19T05:42:16.862 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-12-19T05:42:16.894 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-12-19T05:42:16.926 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-12-19T05:42:16.958 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/udf/ install 2023-12-19T05:42:16.961 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-12-19T05:42:16.993 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-12-19T05:42:17.026 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-12-19T05:42:17.057 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-12-19T05:42:17.089 INFO:teuthology.orchestra.run.smithi188.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.3GYFeLTziIxfstests-dev/tests/xfs/ install 2023-12-19T05:42:17.099 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-12-19T05:42:17.133 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-12-19T05:42:24.502 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-12-19T05:42:24.536 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-12-19T05:42:29.035 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:42:29.038 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:42:29.041 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:42:32.128 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-12-19T05:42:32.161 INFO:teuthology.orchestra.run.smithi188.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-12-19T05:42:32.194 INFO:teuthology.orchestra.run.smithi188.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-12-19T05:42:32.226 INFO:teuthology.orchestra.run.smithi188.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-12-19T05:42:32.265 DEBUG:teuthology.orchestra.run.smithi188:> (cd /tmp/tmp.3ZCPZZ6XHZxfsprogs-dev && exec sudo make) 2023-12-19T05:42:32.376 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize -c -i -f 2023-12-19T05:42:32.736 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-12-19T05:42:32.737 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file './config.guess' 2023-12-19T05:42:32.751 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file './config.sub' 2023-12-19T05:42:32.766 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file './install-sh' 2023-12-19T05:42:32.781 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file './ltmain.sh' 2023-12-19T05:42:32.871 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-12-19T05:42:32.871 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-12-19T05:42:32.889 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-12-19T05:42:32.907 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-12-19T05:42:32.925 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-12-19T05:42:32.943 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-12-19T05:42:32.967 INFO:teuthology.orchestra.run.smithi188.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-12-19T05:42:32.972 INFO:teuthology.orchestra.run.smithi188.stdout:cp include/install-sh . 2023-12-19T05:42:32.975 INFO:teuthology.orchestra.run.smithi188.stdout:aclocal -I m4 2023-12-19T05:42:34.381 INFO:teuthology.orchestra.run.smithi188.stdout:autoconf 2023-12-19T05:42:34.871 INFO:teuthology.orchestra.run.smithi188.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-12-19T05:42:35.046 INFO:teuthology.orchestra.run.smithi188.stdout:configure: loading site script /usr/share/config.site 2023-12-19T05:42:35.105 INFO:teuthology.orchestra.run.smithi188.stdout:checking for a BSD-compatible install... /bin/install -c 2023-12-19T05:42:35.243 INFO:teuthology.orchestra.run.smithi188.stdout:checking build system type... x86_64-pc-linux-gnu 2023-12-19T05:42:35.243 INFO:teuthology.orchestra.run.smithi188.stdout:checking host system type... x86_64-pc-linux-gnu 2023-12-19T05:42:35.248 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to print strings... printf 2023-12-19T05:42:35.248 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gcc... gcc 2023-12-19T05:42:35.380 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether the C compiler works... yes 2023-12-19T05:42:35.381 INFO:teuthology.orchestra.run.smithi188.stdout:checking for C compiler default output file name... a.out 2023-12-19T05:42:35.448 INFO:teuthology.orchestra.run.smithi188.stdout:checking for suffix of executables... 2023-12-19T05:42:35.529 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether we are cross compiling... no 2023-12-19T05:42:35.581 INFO:teuthology.orchestra.run.smithi188.stdout:checking for suffix of object files... o 2023-12-19T05:42:35.627 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether we are using the GNU C compiler... yes 2023-12-19T05:42:35.674 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether gcc accepts -g... yes 2023-12-19T05:42:35.737 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-19T05:42:35.747 INFO:teuthology.orchestra.run.smithi188.stdout:checking for a sed that does not truncate output... /bin/sed 2023-12-19T05:42:35.755 INFO:teuthology.orchestra.run.smithi188.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-12-19T05:42:35.760 INFO:teuthology.orchestra.run.smithi188.stdout:checking for egrep... /bin/grep -E 2023-12-19T05:42:35.764 INFO:teuthology.orchestra.run.smithi188.stdout:checking for fgrep... /bin/grep -F 2023-12-19T05:42:35.778 INFO:teuthology.orchestra.run.smithi188.stdout:checking for ld used by gcc... /bin/ld 2023-12-19T05:42:35.785 INFO:teuthology.orchestra.run.smithi188.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-12-19T05:42:35.792 INFO:teuthology.orchestra.run.smithi188.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-12-19T05:42:35.883 INFO:teuthology.orchestra.run.smithi188.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-12-19T05:42:35.883 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether ln -s works... yes 2023-12-19T05:42:35.897 INFO:teuthology.orchestra.run.smithi188.stdout:checking the maximum length of command line arguments... 1572864 2023-12-19T05:42:35.908 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-12-19T05:42:35.908 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-12-19T05:42:35.908 INFO:teuthology.orchestra.run.smithi188.stdout:checking for /bin/ld option to reload object files... -r 2023-12-19T05:42:35.909 INFO:teuthology.orchestra.run.smithi188.stdout:checking for objdump... objdump 2023-12-19T05:42:35.910 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to recognize dependent libraries... pass_all 2023-12-19T05:42:35.911 INFO:teuthology.orchestra.run.smithi188.stdout:checking for dlltool... no 2023-12-19T05:42:35.911 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-12-19T05:42:35.912 INFO:teuthology.orchestra.run.smithi188.stdout:checking for ar... ar 2023-12-19T05:42:36.006 INFO:teuthology.orchestra.run.smithi188.stdout:checking for archiver @FILE support... @ 2023-12-19T05:42:36.007 INFO:teuthology.orchestra.run.smithi188.stdout:checking for strip... strip 2023-12-19T05:42:36.007 INFO:teuthology.orchestra.run.smithi188.stdout:checking for ranlib... ranlib 2023-12-19T05:42:36.008 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gawk... gawk 2023-12-19T05:42:36.189 INFO:teuthology.orchestra.run.smithi188.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-12-19T05:42:36.193 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sysroot... no 2023-12-19T05:42:36.203 INFO:teuthology.orchestra.run.smithi188.stdout:checking for a working dd... /bin/dd 2023-12-19T05:42:36.214 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-12-19T05:42:36.256 INFO:teuthology.orchestra.run.smithi188.stdout:checking for mt... no 2023-12-19T05:42:36.264 INFO:teuthology.orchestra.run.smithi188.stdout:checking if : is a manifest tool... no 2023-12-19T05:42:36.328 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to run the C preprocessor... gcc -E 2023-12-19T05:42:36.599 INFO:teuthology.orchestra.run.smithi188.stdout:checking for ANSI C header files... yes 2023-12-19T05:42:36.658 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/types.h... yes 2023-12-19T05:42:36.731 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/stat.h... yes 2023-12-19T05:42:36.803 INFO:teuthology.orchestra.run.smithi188.stdout:checking for stdlib.h... yes 2023-12-19T05:42:36.870 INFO:teuthology.orchestra.run.smithi188.stdout:checking for string.h... yes 2023-12-19T05:42:36.937 INFO:teuthology.orchestra.run.smithi188.stdout:checking for memory.h... yes 2023-12-19T05:42:37.004 INFO:teuthology.orchestra.run.smithi188.stdout:checking for strings.h... yes 2023-12-19T05:42:37.075 INFO:teuthology.orchestra.run.smithi188.stdout:checking for inttypes.h... yes 2023-12-19T05:42:37.146 INFO:teuthology.orchestra.run.smithi188.stdout:checking for stdint.h... yes 2023-12-19T05:42:37.216 INFO:teuthology.orchestra.run.smithi188.stdout:checking for unistd.h... yes 2023-12-19T05:42:37.282 INFO:teuthology.orchestra.run.smithi188.stdout:checking for dlfcn.h... yes 2023-12-19T05:42:37.294 INFO:teuthology.orchestra.run.smithi188.stdout:checking for objdir... .libs 2023-12-19T05:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-12-19T05:42:37.466 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-12-19T05:42:37.517 INFO:teuthology.orchestra.run.smithi188.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-12-19T05:42:37.565 INFO:teuthology.orchestra.run.smithi188.stdout:checking if gcc static flag -static works... no 2023-12-19T05:42:37.636 INFO:teuthology.orchestra.run.smithi188.stdout:checking if gcc supports -c -o file.o... yes 2023-12-19T05:42:37.636 INFO:teuthology.orchestra.run.smithi188.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-12-19T05:42:37.658 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-12-19T05:42:37.727 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether -lc should be explicitly linked in... no 2023-12-19T05:42:37.861 INFO:teuthology.orchestra.run.smithi188.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-12-19T05:42:37.861 INFO:teuthology.orchestra.run.smithi188.stdout:checking how to hardcode library paths into programs... immediate 2023-12-19T05:42:37.865 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether stripping libraries is possible... yes 2023-12-19T05:42:37.865 INFO:teuthology.orchestra.run.smithi188.stdout:checking if libtool supports shared libraries... yes 2023-12-19T05:42:37.865 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether to build shared libraries... yes 2023-12-19T05:42:37.865 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether to build static libraries... yes 2023-12-19T05:42:37.866 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gcc... (cached) gcc 2023-12-19T05:42:37.914 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-19T05:42:37.914 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-19T05:42:37.915 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-19T05:42:37.934 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gcc... (cached) gcc 2023-12-19T05:42:37.989 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-19T05:42:37.990 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-19T05:42:37.990 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-19T05:42:38.000 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gcc... (cached) gcc 2023-12-19T05:42:38.058 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-19T05:42:38.058 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-19T05:42:38.059 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-19T05:42:38.059 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gmake... /bin/gmake 2023-12-19T05:42:38.060 INFO:teuthology.orchestra.run.smithi188.stdout:checking for tar... /bin/tar 2023-12-19T05:42:38.061 INFO:teuthology.orchestra.run.smithi188.stdout:checking for gzip... /bin/gzip 2023-12-19T05:42:38.088 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether gcc -MM is supported... yes 2023-12-19T05:42:38.089 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sort... /bin/sort 2023-12-19T05:42:38.090 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether ln -s works... yes 2023-12-19T05:42:38.091 INFO:teuthology.orchestra.run.smithi188.stdout:checking for msgfmt... /bin/msgfmt 2023-12-19T05:42:38.091 INFO:teuthology.orchestra.run.smithi188.stdout:checking for msgmerge... /bin/msgmerge 2023-12-19T05:42:38.092 INFO:teuthology.orchestra.run.smithi188.stdout:checking for xgettext... /bin/xgettext 2023-12-19T05:42:38.092 INFO:teuthology.orchestra.run.smithi188.stdout:checking for rpm... /bin/rpm 2023-12-19T05:42:38.104 INFO:teuthology.orchestra.run.smithi188.stdout:checking for rpmbuild... no 2023-12-19T05:42:38.171 INFO:teuthology.orchestra.run.smithi188.stdout:checking ini.h usability... yes 2023-12-19T05:42:38.202 INFO:teuthology.orchestra.run.smithi188.stdout:checking ini.h presence... yes 2023-12-19T05:42:38.202 INFO:teuthology.orchestra.run.smithi188.stdout:checking for ini.h... yes 2023-12-19T05:42:38.287 INFO:teuthology.orchestra.run.smithi188.stdout:checking for ini_parse in -linih... yes 2023-12-19T05:42:38.362 INFO:teuthology.orchestra.run.smithi188.stdout:checking uuid.h usability... no 2023-12-19T05:42:38.407 INFO:teuthology.orchestra.run.smithi188.stdout:checking uuid.h presence... no 2023-12-19T05:42:38.407 INFO:teuthology.orchestra.run.smithi188.stdout:checking for uuid.h... no 2023-12-19T05:42:38.478 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/uuid.h usability... no 2023-12-19T05:42:38.516 INFO:teuthology.orchestra.run.smithi188.stdout:checking sys/uuid.h presence... no 2023-12-19T05:42:38.516 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sys/uuid.h... no 2023-12-19T05:42:38.583 INFO:teuthology.orchestra.run.smithi188.stdout:checking uuid/uuid.h usability... yes 2023-12-19T05:42:38.611 INFO:teuthology.orchestra.run.smithi188.stdout:checking uuid/uuid.h presence... yes 2023-12-19T05:42:38.611 INFO:teuthology.orchestra.run.smithi188.stdout:checking for uuid/uuid.h... yes 2023-12-19T05:42:38.712 INFO:teuthology.orchestra.run.smithi188.stdout:checking for uuid_compare... no 2023-12-19T05:42:38.780 INFO:teuthology.orchestra.run.smithi188.stdout:checking for uuid_compare in -luuid... yes 2023-12-19T05:42:38.840 INFO:teuthology.orchestra.run.smithi188.stdout:checking pthread.h usability... yes 2023-12-19T05:42:38.867 INFO:teuthology.orchestra.run.smithi188.stdout:checking pthread.h presence... yes 2023-12-19T05:42:38.867 INFO:teuthology.orchestra.run.smithi188.stdout:checking for pthread.h... yes 2023-12-19T05:42:38.948 INFO:teuthology.orchestra.run.smithi188.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-12-19T05:42:39.019 INFO:teuthology.orchestra.run.smithi188.stdout:checking urcu.h usability... yes 2023-12-19T05:42:39.059 INFO:teuthology.orchestra.run.smithi188.stdout:checking urcu.h presence... yes 2023-12-19T05:42:39.059 INFO:teuthology.orchestra.run.smithi188.stdout:checking for urcu.h... yes 2023-12-19T05:42:39.121 INFO:teuthology.orchestra.run.smithi188.stdout:checking for liburcu... yes 2023-12-19T05:42:39.169 INFO:teuthology.orchestra.run.smithi188.stdout:checking for fadvise ... yes 2023-12-19T05:42:39.216 INFO:teuthology.orchestra.run.smithi188.stdout:checking for madvise ... yes 2023-12-19T05:42:39.268 INFO:teuthology.orchestra.run.smithi188.stdout:checking for mincore ... yes 2023-12-19T05:42:39.334 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sendfile ... yes 2023-12-19T05:42:39.389 INFO:teuthology.orchestra.run.smithi188.stdout:checking for getmntent ... yes 2023-12-19T05:42:39.468 INFO:teuthology.orchestra.run.smithi188.stdout:checking for fallocate... yes 2023-12-19T05:42:39.550 INFO:teuthology.orchestra.run.smithi188.stdout:checking for fiemap... yes 2023-12-19T05:42:39.635 INFO:teuthology.orchestra.run.smithi188.stdout:checking for pwritev2... yes 2023-12-19T05:42:39.717 INFO:teuthology.orchestra.run.smithi188.stdout:checking for preadv... yes 2023-12-19T05:42:39.800 INFO:teuthology.orchestra.run.smithi188.stdout:checking for copy_file_range... yes 2023-12-19T05:42:39.880 INFO:teuthology.orchestra.run.smithi188.stdout:checking for sync_file_range... yes 2023-12-19T05:42:39.962 INFO:teuthology.orchestra.run.smithi188.stdout:checking for syncfs... yes 2023-12-19T05:42:40.024 INFO:teuthology.orchestra.run.smithi188.stdout:checking mntent.h usability... yes 2023-12-19T05:42:40.047 INFO:teuthology.orchestra.run.smithi188.stdout:checking mntent.h presence... yes 2023-12-19T05:42:40.048 INFO:teuthology.orchestra.run.smithi188.stdout:checking for mntent.h... yes 2023-12-19T05:42:40.105 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether fls is declared... no 2023-12-19T05:42:40.180 INFO:teuthology.orchestra.run.smithi188.stdout:checking for readdir... yes 2023-12-19T05:42:40.247 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether fsetxattr is declared... yes 2023-12-19T05:42:40.316 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether mremap is declared... yes 2023-12-19T05:42:40.410 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct fsxattr... yes 2023-12-19T05:42:40.459 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-12-19T05:42:40.548 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct fscrypt_add_key_arg... yes 2023-12-19T05:42:40.594 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct fscrypt_add_key_arg.key_id... yes 2023-12-19T05:42:40.687 INFO:teuthology.orchestra.run.smithi188.stdout:checking for GETFSMAP... yes 2023-12-19T05:42:40.786 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct statfs... yes 2023-12-19T05:42:40.840 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct statfs.f_flags... yes 2023-12-19T05:42:40.885 INFO:teuthology.orchestra.run.smithi188.stdout:checking for MAP_SYNC... yes 2023-12-19T05:42:41.054 INFO:teuthology.orchestra.run.smithi188.stdout:checking for library containing dm_task_create... -ldevmapper 2023-12-19T05:42:41.115 INFO:teuthology.orchestra.run.smithi188.stdout:checking for mallinfo ... yes 2023-12-19T05:42:41.167 INFO:teuthology.orchestra.run.smithi188.stdout:checking for mallinfo2 ... yes 2023-12-19T05:42:41.232 INFO:teuthology.orchestra.run.smithi188.stdout:checking attr/attributes.h usability... yes 2023-12-19T05:42:41.259 INFO:teuthology.orchestra.run.smithi188.stdout:checking attr/attributes.h presence... yes 2023-12-19T05:42:41.260 INFO:teuthology.orchestra.run.smithi188.stdout:checking for attr/attributes.h... yes 2023-12-19T05:42:41.311 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct attrlist_cursor... yes 2023-12-19T05:42:41.316 INFO:teuthology.orchestra.run.smithi188.stdout:checking for pkg-config... /bin/pkg-config 2023-12-19T05:42:41.336 INFO:teuthology.orchestra.run.smithi188.stdout:checking pkg-config is at least version 0.9.0... yes 2023-12-19T05:42:41.419 INFO:teuthology.orchestra.run.smithi188.stdout:checking for libicu... yes 2023-12-19T05:42:41.489 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether openat is declared... yes 2023-12-19T05:42:41.562 INFO:teuthology.orchestra.run.smithi188.stdout:checking whether fstatat is declared... yes 2023-12-19T05:42:41.627 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct sg_io_hdr ... yes 2023-12-19T05:42:41.687 INFO:teuthology.orchestra.run.smithi188.stdout:checking for struct hd_geometry ... yes 2023-12-19T05:42:41.776 INFO:teuthology.orchestra.run.smithi188.stdout:checking for systemd... yes 2023-12-19T05:42:41.797 INFO:teuthology.orchestra.run.smithi188.stdout:checking for systemd system unit dir... /usr/lib/systemd/system 2023-12-19T05:42:41.797 INFO:teuthology.orchestra.run.smithi188.stdout:checking for system crontab dir... /etc/cron.d 2023-12-19T05:42:41.879 INFO:teuthology.orchestra.run.smithi188.stdout:checking for udev... yes 2023-12-19T05:42:41.897 INFO:teuthology.orchestra.run.smithi188.stdout:checking for udev rule dir... /usr/lib/udev/rules.d 2023-12-19T05:42:42.088 INFO:teuthology.orchestra.run.smithi188.stdout:checking for library containing blkid_probe_all... -lblkid 2023-12-19T05:42:42.177 INFO:teuthology.orchestra.run.smithi188.stdout:checking for blkid_probe_get_topology... yes 2023-12-19T05:42:42.295 INFO:teuthology.orchestra.run.smithi188.stdout:checking size of long... 8 2023-12-19T05:42:42.409 INFO:teuthology.orchestra.run.smithi188.stdout:checking size of char *... 8 2023-12-19T05:42:42.451 INFO:teuthology.orchestra.run.smithi188.stdout:checking for umode_t... no 2023-12-19T05:42:42.555 INFO:teuthology.orchestra.run.smithi188.stdout:checking for atomic64_t support in liburcu... yes 2023-12-19T05:42:42.593 INFO:teuthology.orchestra.run.smithi188.stdout:configure: creating ./config.status 2023-12-19T05:42:43.950 INFO:teuthology.orchestra.run.smithi188.stdout:config.status: creating include/builddefs 2023-12-19T05:42:43.989 INFO:teuthology.orchestra.run.smithi188.stdout:config.status: creating include/platform_defs.h 2023-12-19T05:42:44.017 INFO:teuthology.orchestra.run.smithi188.stdout:config.status: executing libtool commands 2023-12-19T05:42:44.142 INFO:teuthology.orchestra.run.smithi188.stdout: [HEADERS] include 2023-12-19T05:42:44.167 INFO:teuthology.orchestra.run.smithi188.stdout: [HEADERS] libxfs 2023-12-19T05:42:44.209 INFO:teuthology.orchestra.run.smithi188.stdout:Building include 2023-12-19T05:42:44.223 INFO:teuthology.orchestra.run.smithi188.stdout: [LN] disk 2023-12-19T05:42:44.229 INFO:teuthology.orchestra.run.smithi188.stdout:Building libfrog 2023-12-19T05:42:44.239 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] gen_crc32table 2023-12-19T05:42:44.328 INFO:teuthology.orchestra.run.smithi188.stdout: [GENERATE] crc32table.h 2023-12-19T05:42:45.058 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] avl64.lo 2023-12-19T05:42:45.807 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] bitmap.lo 2023-12-19T05:42:46.395 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] bulkstat.lo 2023-12-19T05:42:47.055 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] convert.lo 2023-12-19T05:42:47.691 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] crc32.lo 2023-12-19T05:42:48.172 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fsgeom.lo 2023-12-19T05:42:48.802 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] list_sort.lo 2023-12-19T05:42:49.247 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] linux.lo 2023-12-19T05:42:49.869 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] logging.lo 2023-12-19T05:42:50.282 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] paths.lo 2023-12-19T05:42:50.962 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] projects.lo 2023-12-19T05:42:51.534 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] ptvar.lo 2023-12-19T05:42:52.011 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] radix-tree.lo 2023-12-19T05:42:52.825 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] randbytes.lo 2023-12-19T05:42:53.334 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] scrub.lo 2023-12-19T05:42:53.756 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] util.lo 2023-12-19T05:42:54.278 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] workqueue.lo 2023-12-19T05:42:54.796 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] libfrog.la 2023-12-19T05:42:55.015 INFO:teuthology.orchestra.run.smithi188.stdout:Building libxfs 2023-12-19T05:42:57.387 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] cache.lo 2023-12-19T05:42:58.228 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] defer_item.lo 2023-12-19T05:42:58.913 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] init.lo 2023-12-19T05:42:59.171 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:42:59.174 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:42:59.177 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:42:59.884 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] kmem.lo 2023-12-19T05:43:00.389 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] logitem.lo 2023-12-19T05:43:00.962 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] rdwr.lo 2023-12-19T05:43:02.173 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] topology.lo 2023-12-19T05:43:02.868 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] trans.lo 2023-12-19T05:43:03.646 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] util.lo 2023-12-19T05:43:04.438 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_ag.lo 2023-12-19T05:43:05.550 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_ag_resv.lo 2023-12-19T05:43:06.218 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_alloc.lo 2023-12-19T05:43:08.022 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_alloc_btree.lo 2023-12-19T05:43:08.783 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_attr.lo 2023-12-19T05:43:09.692 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_attr_leaf.lo 2023-12-19T05:43:11.422 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_attr_remote.lo 2023-12-19T05:43:12.186 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_bit.lo 2023-12-19T05:43:12.736 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_bmap.lo 2023-12-19T05:43:15.829 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_bmap_btree.lo 2023-12-19T05:43:16.638 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_btree.lo 2023-12-19T05:43:19.187 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_btree_staging.lo 2023-12-19T05:43:19.936 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_da_btree.lo 2023-12-19T05:43:21.558 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_defer.lo 2023-12-19T05:43:22.335 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_dir2.lo 2023-12-19T05:43:23.140 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_dir2_block.lo 2023-12-19T05:43:24.296 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_dir2_data.lo 2023-12-19T05:43:25.362 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_dir2_leaf.lo 2023-12-19T05:43:26.571 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_dir2_node.lo 2023-12-19T05:43:27.976 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_dir2_sf.lo 2023-12-19T05:43:29.016 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_dquot_buf.lo 2023-12-19T05:43:29.311 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:43:29.314 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:43:29.317 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:43:29.675 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_ialloc.lo 2023-12-19T05:43:31.328 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_iext_tree.lo 2023-12-19T05:43:32.316 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_inode_buf.lo 2023-12-19T05:43:33.284 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_inode_fork.lo 2023-12-19T05:43:34.220 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_ialloc_btree.lo 2023-12-19T05:43:35.025 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_log_rlimit.lo 2023-12-19T05:43:35.576 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_refcount.lo 2023-12-19T05:43:36.731 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_refcount_btree.lo 2023-12-19T05:43:37.441 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_rmap.lo 2023-12-19T05:43:38.964 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_rmap_btree.lo 2023-12-19T05:43:39.762 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_rtbitmap.lo 2023-12-19T05:43:40.695 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_sb.lo 2023-12-19T05:43:41.850 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_symlink_remote.lo 2023-12-19T05:43:42.497 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_trans_inode.lo 2023-12-19T05:43:43.047 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_trans_resv.lo 2023-12-19T05:43:43.888 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_types.lo 2023-12-19T05:43:44.513 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] libxfs.la 2023-12-19T05:43:44.841 INFO:teuthology.orchestra.run.smithi188.stdout:Building libxlog 2023-12-19T05:43:44.978 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_log_recover.lo 2023-12-19T05:43:46.162 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] util.lo 2023-12-19T05:43:46.827 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] libxlog.la 2023-12-19T05:43:47.029 INFO:teuthology.orchestra.run.smithi188.stdout:Building libxcmd 2023-12-19T05:43:47.231 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] command.lo 2023-12-19T05:43:47.806 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] input.lo 2023-12-19T05:43:48.346 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] help.lo 2023-12-19T05:43:48.829 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] quit.lo 2023-12-19T05:43:49.308 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] libxcmd.la 2023-12-19T05:43:49.515 INFO:teuthology.orchestra.run.smithi188.stdout:Building libhandle 2023-12-19T05:43:49.633 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] handle.lo 2023-12-19T05:43:50.232 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] jdm.lo 2023-12-19T05:43:50.820 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] libhandle.la 2023-12-19T05:43:51.066 INFO:teuthology.orchestra.run.smithi188.stdout:Building copy 2023-12-19T05:43:51.151 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_copy.o 2023-12-19T05:43:51.661 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] xfs_copy 2023-12-19T05:43:51.910 INFO:teuthology.orchestra.run.smithi188.stdout:Building db 2023-12-19T05:43:54.853 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] addr.o 2023-12-19T05:43:55.005 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] agf.o 2023-12-19T05:43:55.144 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] agfl.o 2023-12-19T05:43:55.289 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] agi.o 2023-12-19T05:43:55.430 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] attr.o 2023-12-19T05:43:55.685 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] attrshort.o 2023-12-19T05:43:55.846 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] bit.o 2023-12-19T05:43:56.011 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] block.o 2023-12-19T05:43:56.202 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] bmap.o 2023-12-19T05:43:56.450 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] btblock.o 2023-12-19T05:43:56.614 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] bmroot.o 2023-12-19T05:43:56.807 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] check.o 2023-12-19T05:43:58.696 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] command.o 2023-12-19T05:43:58.841 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] crc.o 2023-12-19T05:43:58.992 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] debug.o 2023-12-19T05:43:59.110 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] dir2.o 2023-12-19T05:43:59.462 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] dir2sf.o 2023-12-19T05:43:59.609 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:43:59.612 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:43:59.615 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:43:59.650 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] dquot.o 2023-12-19T05:43:59.807 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] echo.o 2023-12-19T05:43:59.937 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] faddr.o 2023-12-19T05:44:00.167 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] field.o 2023-12-19T05:44:00.326 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] flist.o 2023-12-19T05:44:00.614 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fprint.o 2023-12-19T05:44:00.827 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] frag.o 2023-12-19T05:44:01.123 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] freesp.o 2023-12-19T05:44:01.373 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] hash.o 2023-12-19T05:44:01.475 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c: In function ‘hash_f’: 2023-12-19T05:44:01.475 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:76:58: warning: pointer targets in passing argument 1 of ‘libxfs_da_hashname’ differ in signedness [-Wpointer-sign] 2023-12-19T05:44:01.475 INFO:teuthology.orchestra.run.smithi188.stderr: 76 | hashval = libxfs_da_hashname(argv[c], strlen(argv[c])); 2023-12-19T05:44:01.475 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~^~~ 2023-12-19T05:44:01.475 INFO:teuthology.orchestra.run.smithi188.stderr: | | 2023-12-19T05:44:01.475 INFO:teuthology.orchestra.run.smithi188.stderr: | char * 2023-12-19T05:44:01.475 INFO:teuthology.orchestra.run.smithi188.stderr:In file included from ../include/libxfs.h:59, 2023-12-19T05:44:01.475 INFO:teuthology.orchestra.run.smithi188.stderr: from hash.c:7: 2023-12-19T05:44:01.476 INFO:teuthology.orchestra.run.smithi188.stderr:../libxfs/xfs_da_btree.h:223:37: note: expected ‘const uint8_t *’ {aka ‘const unsigned char *’} but argument is of type ‘char *’ 2023-12-19T05:44:01.476 INFO:teuthology.orchestra.run.smithi188.stderr: 223 | uint xfs_da_hashname(const uint8_t *name_string, int name_length); 2023-12-19T05:44:01.476 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~~~~~~~~~~~~^~~~~~~~~~~ 2023-12-19T05:44:01.478 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c: In function ‘collide_dirents’: 2023-12-19T05:44:01.478 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:258:36: warning: pointer targets in passing argument 2 of ‘openat’ differ in signedness [-Wpointer-sign] 2023-12-19T05:44:01.479 INFO:teuthology.orchestra.run.smithi188.stderr: 258 | newfd = openat(fd, name, O_CREAT, 0600); 2023-12-19T05:44:01.479 INFO:teuthology.orchestra.run.smithi188.stderr: | ^~~~ 2023-12-19T05:44:01.479 INFO:teuthology.orchestra.run.smithi188.stderr: | | 2023-12-19T05:44:01.479 INFO:teuthology.orchestra.run.smithi188.stderr: | const unsigned char * 2023-12-19T05:44:01.479 INFO:teuthology.orchestra.run.smithi188.stderr:In file included from /usr/include/features.h:490, 2023-12-19T05:44:01.479 INFO:teuthology.orchestra.run.smithi188.stderr: from /usr/include/bits/libc-header-start.h:33, 2023-12-19T05:44:01.479 INFO:teuthology.orchestra.run.smithi188.stderr: from /usr/include/stdio.h:27, 2023-12-19T05:44:01.479 INFO:teuthology.orchestra.run.smithi188.stderr: from ../include/platform_defs.h:10, 2023-12-19T05:44:01.479 INFO:teuthology.orchestra.run.smithi188.stderr: from ../include/libxfs.h:11, 2023-12-19T05:44:01.479 INFO:teuthology.orchestra.run.smithi188.stderr: from hash.c:7: 2023-12-19T05:44:01.479 INFO:teuthology.orchestra.run.smithi188.stderr:/usr/include/fcntl.h:237:12: note: expected ‘const char *’ but argument is of type ‘const unsigned char *’ 2023-12-19T05:44:01.479 INFO:teuthology.orchestra.run.smithi188.stderr: 237 | extern int __REDIRECT (openat, (int __fd, const char *__file, int __oflag, 2023-12-19T05:44:01.479 INFO:teuthology.orchestra.run.smithi188.stderr: | ^~~~~~~~~~ 2023-12-19T05:44:01.479 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:273:25: warning: pointer targets in passing argument 1 of ‘strncpy’ differ in signedness [-Wpointer-sign] 2023-12-19T05:44:01.480 INFO:teuthology.orchestra.run.smithi188.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-12-19T05:44:01.480 INFO:teuthology.orchestra.run.smithi188.stderr: | ^~~~~~~~~~ 2023-12-19T05:44:01.480 INFO:teuthology.orchestra.run.smithi188.stderr: | | 2023-12-19T05:44:01.480 INFO:teuthology.orchestra.run.smithi188.stderr: | unsigned char * 2023-12-19T05:44:01.480 INFO:teuthology.orchestra.run.smithi188.stderr:In file included from ../include/platform_defs.h:17, 2023-12-19T05:44:01.480 INFO:teuthology.orchestra.run.smithi188.stderr: from ../include/libxfs.h:11, 2023-12-19T05:44:01.480 INFO:teuthology.orchestra.run.smithi188.stderr: from hash.c:7: 2023-12-19T05:44:01.480 INFO:teuthology.orchestra.run.smithi188.stderr:/usr/include/string.h:128:40: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-12-19T05:44:01.480 INFO:teuthology.orchestra.run.smithi188.stderr: 128 | extern char *strncpy (char *__restrict __dest, 2023-12-19T05:44:01.480 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~~~~~~~~~~~~~~^~~~~~ 2023-12-19T05:44:01.480 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:273:37: warning: pointer targets in passing argument 2 of ‘strncpy’ differ in signedness [-Wpointer-sign] 2023-12-19T05:44:01.480 INFO:teuthology.orchestra.run.smithi188.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-12-19T05:44:01.480 INFO:teuthology.orchestra.run.smithi188.stderr: | ^~~~ 2023-12-19T05:44:01.480 INFO:teuthology.orchestra.run.smithi188.stderr: | | 2023-12-19T05:44:01.481 INFO:teuthology.orchestra.run.smithi188.stderr: | const unsigned char * 2023-12-19T05:44:01.481 INFO:teuthology.orchestra.run.smithi188.stderr:In file included from ../include/platform_defs.h:17, 2023-12-19T05:44:01.481 INFO:teuthology.orchestra.run.smithi188.stderr: from ../include/libxfs.h:11, 2023-12-19T05:44:01.481 INFO:teuthology.orchestra.run.smithi188.stderr: from hash.c:7: 2023-12-19T05:44:01.481 INFO:teuthology.orchestra.run.smithi188.stderr:/usr/include/string.h:129:46: note: expected ‘const char * restrict’ but argument is of type ‘const unsigned char *’ 2023-12-19T05:44:01.481 INFO:teuthology.orchestra.run.smithi188.stderr: 129 | const char *__restrict __src, size_t __n) 2023-12-19T05:44:01.481 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~^~~~~ 2023-12-19T05:44:01.481 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:278:44: warning: pointer targets in passing argument 2 of ‘linkat’ differ in signedness [-Wpointer-sign] 2023-12-19T05:44:01.481 INFO:teuthology.orchestra.run.smithi188.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-12-19T05:44:01.481 INFO:teuthology.orchestra.run.smithi188.stderr: | ^~~~ 2023-12-19T05:44:01.481 INFO:teuthology.orchestra.run.smithi188.stderr: | | 2023-12-19T05:44:01.481 INFO:teuthology.orchestra.run.smithi188.stderr: | const unsigned char * 2023-12-19T05:44:01.481 INFO:teuthology.orchestra.run.smithi188.stderr:In file included from ../include/platform_defs.h:19, 2023-12-19T05:44:01.481 INFO:teuthology.orchestra.run.smithi188.stderr: from ../include/libxfs.h:11, 2023-12-19T05:44:01.482 INFO:teuthology.orchestra.run.smithi188.stderr: from hash.c:7: 2023-12-19T05:44:01.482 INFO:teuthology.orchestra.run.smithi188.stderr:/usr/include/unistd.h:825:46: note: expected ‘const char *’ but argument is of type ‘const unsigned char *’ 2023-12-19T05:44:01.482 INFO:teuthology.orchestra.run.smithi188.stderr: 825 | extern int linkat (int __fromfd, const char *__from, int __tofd, 2023-12-19T05:44:01.482 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-12-19T05:44:01.482 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:278:54: warning: pointer targets in passing argument 4 of ‘linkat’ differ in signedness [-Wpointer-sign] 2023-12-19T05:44:01.482 INFO:teuthology.orchestra.run.smithi188.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-12-19T05:44:01.482 INFO:teuthology.orchestra.run.smithi188.stderr: | ^~~~~~~~~~ 2023-12-19T05:44:01.482 INFO:teuthology.orchestra.run.smithi188.stderr: | | 2023-12-19T05:44:01.482 INFO:teuthology.orchestra.run.smithi188.stderr: | unsigned char * 2023-12-19T05:44:01.482 INFO:teuthology.orchestra.run.smithi188.stderr:In file included from ../include/platform_defs.h:19, 2023-12-19T05:44:01.482 INFO:teuthology.orchestra.run.smithi188.stderr: from ../include/libxfs.h:11, 2023-12-19T05:44:01.482 INFO:teuthology.orchestra.run.smithi188.stderr: from hash.c:7: 2023-12-19T05:44:01.482 INFO:teuthology.orchestra.run.smithi188.stderr:/usr/include/unistd.h:826:32: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-12-19T05:44:01.482 INFO:teuthology.orchestra.run.smithi188.stderr: 826 | const char *__to, int __flags) 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~~~~~~~~~^~~~ 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c: In function ‘collide_xattrs’: 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:318:26: warning: pointer targets in passing argument 1 of ‘snprintf’ differ in signedness [-Wpointer-sign] 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr: 318 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr: | ^~~~~~~~~ 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr: | | 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr: | unsigned char * 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr:In file included from ../include/platform_defs.h:10, 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr: from ../include/libxfs.h:11, 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr: from hash.c:7: 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr:/usr/include/stdio.h:372:39: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr: 372 | extern int snprintf (char *__restrict __s, size_t __maxlen, 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~~~~~~~~~~~~~~^~~ 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:319:39: warning: pointer targets in passing argument 2 of ‘fsetxattr’ differ in signedness [-Wpointer-sign] 2023-12-19T05:44:01.483 INFO:teuthology.orchestra.run.smithi188.stderr: 319 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr: | ^~~~~~~~~ 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr: | | 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr: | unsigned char * 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr:In file included from hash.c:16: 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr:/usr/include/sys/xattr.h:54:45: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:332:26: warning: pointer targets in passing argument 1 of ‘snprintf’ differ in signedness [-Wpointer-sign] 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr: 332 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr: | ^~~~~~~~~ 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr: | | 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr: | unsigned char * 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr:In file included from ../include/platform_defs.h:10, 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr: from ../include/libxfs.h:11, 2023-12-19T05:44:01.484 INFO:teuthology.orchestra.run.smithi188.stderr: from hash.c:7: 2023-12-19T05:44:01.485 INFO:teuthology.orchestra.run.smithi188.stderr:/usr/include/stdio.h:372:39: note: expected ‘char * restrict’ but argument is of type ‘unsigned char *’ 2023-12-19T05:44:01.485 INFO:teuthology.orchestra.run.smithi188.stderr: 372 | extern int snprintf (char *__restrict __s, size_t __maxlen, 2023-12-19T05:44:01.485 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~~~~~~~~~~~~~~^~~ 2023-12-19T05:44:01.485 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:337:47: warning: pointer targets in passing argument 2 of ‘fsetxattr’ differ in signedness [-Wpointer-sign] 2023-12-19T05:44:01.485 INFO:teuthology.orchestra.run.smithi188.stderr: 337 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-12-19T05:44:01.485 INFO:teuthology.orchestra.run.smithi188.stderr: | ^~~~~~~~~ 2023-12-19T05:44:01.485 INFO:teuthology.orchestra.run.smithi188.stderr: | | 2023-12-19T05:44:01.485 INFO:teuthology.orchestra.run.smithi188.stderr: | unsigned char * 2023-12-19T05:44:01.485 INFO:teuthology.orchestra.run.smithi188.stderr:In file included from hash.c:16: 2023-12-19T05:44:01.485 INFO:teuthology.orchestra.run.smithi188.stderr:/usr/include/sys/xattr.h:54:45: note: expected ‘const char *’ but argument is of type ‘unsigned char *’ 2023-12-19T05:44:01.485 INFO:teuthology.orchestra.run.smithi188.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-12-19T05:44:01.485 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-12-19T05:44:01.485 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c: In function ‘hashcoll_f’: 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:417:52: warning: pointer targets in passing argument 2 of ‘collide_xattrs’ differ in signedness [-Wpointer-sign] 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr: 417 | error = collide_xattrs(nr, buf, len, fd); 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr: | ^~~ 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr: | | 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr: | char * 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:300:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr: 300 | const unsigned char *name, 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:419:53: warning: pointer targets in passing argument 2 of ‘collide_dirents’ differ in signedness [-Wpointer-sign] 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr: 419 | error = collide_dirents(nr, buf, len, fd); 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr: | ^~~ 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr: | | 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr: | char * 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:234:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-19T05:44:01.486 INFO:teuthology.orchestra.run.smithi188.stderr: 234 | const unsigned char *name, 2023-12-19T05:44:01.487 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-19T05:44:01.487 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:431:56: warning: pointer targets in passing argument 2 of ‘collide_xattrs’ differ in signedness [-Wpointer-sign] 2023-12-19T05:44:01.487 INFO:teuthology.orchestra.run.smithi188.stderr: 431 | error = collide_xattrs(nr, argv[c], len, fd); 2023-12-19T05:44:01.487 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~^~~ 2023-12-19T05:44:01.487 INFO:teuthology.orchestra.run.smithi188.stderr: | | 2023-12-19T05:44:01.487 INFO:teuthology.orchestra.run.smithi188.stderr: | char * 2023-12-19T05:44:01.487 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:300:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-19T05:44:01.487 INFO:teuthology.orchestra.run.smithi188.stderr: 300 | const unsigned char *name, 2023-12-19T05:44:01.487 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-19T05:44:01.487 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:433:57: warning: pointer targets in passing argument 2 of ‘collide_dirents’ differ in signedness [-Wpointer-sign] 2023-12-19T05:44:01.487 INFO:teuthology.orchestra.run.smithi188.stderr: 433 | error = collide_dirents(nr, argv[c], len, fd); 2023-12-19T05:44:01.487 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~^~~ 2023-12-19T05:44:01.487 INFO:teuthology.orchestra.run.smithi188.stderr: | | 2023-12-19T05:44:01.487 INFO:teuthology.orchestra.run.smithi188.stderr: | char * 2023-12-19T05:44:01.488 INFO:teuthology.orchestra.run.smithi188.stderr:hash.c:234:34: note: expected ‘const unsigned char *’ but argument is of type ‘char *’ 2023-12-19T05:44:01.488 INFO:teuthology.orchestra.run.smithi188.stderr: 234 | const unsigned char *name, 2023-12-19T05:44:01.488 INFO:teuthology.orchestra.run.smithi188.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-12-19T05:44:01.596 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] help.o 2023-12-19T05:44:01.736 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] init.o 2023-12-19T05:44:01.906 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] inode.o 2023-12-19T05:44:02.244 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] input.o 2023-12-19T05:44:02.424 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] io.o 2023-12-19T05:44:02.678 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] logformat.o 2023-12-19T05:44:02.840 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] malloc.o 2023-12-19T05:44:02.974 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] metadump.o 2023-12-19T05:44:03.846 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] output.o 2023-12-19T05:44:03.987 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] print.o 2023-12-19T05:44:04.187 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] quit.o 2023-12-19T05:44:04.315 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] sb.o 2023-12-19T05:44:04.624 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] sig.o 2023-12-19T05:44:04.757 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] strvec.o 2023-12-19T05:44:04.907 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] text.o 2023-12-19T05:44:05.054 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] type.o 2023-12-19T05:44:05.221 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] write.o 2023-12-19T05:44:05.508 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] attrset.o 2023-12-19T05:44:05.679 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] symlink.o 2023-12-19T05:44:05.819 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fsmap.o 2023-12-19T05:44:05.987 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fuzz.o 2023-12-19T05:44:06.202 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] obfuscate.o 2023-12-19T05:44:06.389 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] btdump.o 2023-12-19T05:44:06.602 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] btheight.o 2023-12-19T05:44:06.811 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] convert.o 2023-12-19T05:44:07.004 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] info.o 2023-12-19T05:44:07.167 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] iunlink.o 2023-12-19T05:44:07.390 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] namei.o 2023-12-19T05:44:07.653 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] timelimit.o 2023-12-19T05:44:07.804 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] xfs_db 2023-12-19T05:44:08.136 INFO:teuthology.orchestra.run.smithi188.stdout:Building estimate 2023-12-19T05:44:08.211 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_estimate.o 2023-12-19T05:44:08.389 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] xfs_estimate 2023-12-19T05:44:08.518 INFO:teuthology.orchestra.run.smithi188.stdout:Building fsck 2023-12-19T05:44:08.528 INFO:teuthology.orchestra.run.smithi188.stdout:Building fsr 2023-12-19T05:44:08.609 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_fsr.o 2023-12-19T05:44:09.081 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] xfs_fsr 2023-12-19T05:44:09.263 INFO:teuthology.orchestra.run.smithi188.stdout:Building growfs 2023-12-19T05:44:09.345 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_growfs.o 2023-12-19T05:44:09.567 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] xfs_growfs 2023-12-19T05:44:09.827 INFO:teuthology.orchestra.run.smithi188.stdout:Building io 2023-12-19T05:44:11.827 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] init.o 2023-12-19T05:44:11.964 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] attr.o 2023-12-19T05:44:12.139 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] bmap.o 2023-12-19T05:44:12.353 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] bulkstat.o 2023-12-19T05:44:12.546 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] crc32cselftest.o 2023-12-19T05:44:12.650 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] cowextsize.o 2023-12-19T05:44:12.786 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] encrypt.o 2023-12-19T05:44:13.034 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] file.o 2023-12-19T05:44:13.165 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] freeze.o 2023-12-19T05:44:13.277 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fsuuid.o 2023-12-19T05:44:13.407 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fsync.o 2023-12-19T05:44:13.507 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] getrusage.o 2023-12-19T05:44:13.619 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] imap.o 2023-12-19T05:44:13.729 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] inject.o 2023-12-19T05:44:13.847 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] label.o 2023-12-19T05:44:13.989 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] link.o 2023-12-19T05:44:14.095 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] mmap.o 2023-12-19T05:44:14.326 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] open.o 2023-12-19T05:44:14.648 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] parent.o 2023-12-19T05:44:14.838 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] pread.o 2023-12-19T05:44:15.044 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] prealloc.o 2023-12-19T05:44:15.214 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] pwrite.o 2023-12-19T05:44:15.403 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] reflink.o 2023-12-19T05:44:15.560 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] resblks.o 2023-12-19T05:44:15.667 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] scrub.o 2023-12-19T05:44:15.819 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] seek.o 2023-12-19T05:44:15.949 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] shutdown.o 2023-12-19T05:44:16.056 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] stat.o 2023-12-19T05:44:16.283 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] swapext.o 2023-12-19T05:44:16.394 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] sync.o 2023-12-19T05:44:16.497 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] truncate.o 2023-12-19T05:44:16.600 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] utimes.o 2023-12-19T05:44:16.705 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fadvise.o 2023-12-19T05:44:16.820 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] madvise.o 2023-12-19T05:44:16.932 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] mincore.o 2023-12-19T05:44:17.048 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] sendfile.o 2023-12-19T05:44:17.172 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fiemap.o 2023-12-19T05:44:17.354 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] copy_file_range.o 2023-12-19T05:44:17.480 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] sync_file_range.o 2023-12-19T05:44:17.592 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] readdir.o 2023-12-19T05:44:17.714 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] log_writes.o 2023-12-19T05:44:17.829 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fsmap.o 2023-12-19T05:44:18.089 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] xfs_io 2023-12-19T05:44:18.362 INFO:teuthology.orchestra.run.smithi188.stdout:Building logprint 2023-12-19T05:44:18.740 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] logprint.o 2023-12-19T05:44:18.916 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] log_copy.o 2023-12-19T05:44:19.058 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] log_dump.o 2023-12-19T05:44:19.206 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] log_misc.o 2023-12-19T05:44:19.755 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] log_print_all.o 2023-12-19T05:44:20.023 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] log_print_trans.o 2023-12-19T05:44:20.160 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] log_redo.o 2023-12-19T05:44:20.451 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] xfs_logprint 2023-12-19T05:44:20.678 INFO:teuthology.orchestra.run.smithi188.stdout:Building mkfs 2023-12-19T05:44:20.809 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] proto.o 2023-12-19T05:44:21.134 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_mkfs.o 2023-12-19T05:44:21.896 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] mkfs.xfs 2023-12-19T05:44:22.158 INFO:teuthology.orchestra.run.smithi188.stdout:Building quota 2023-12-19T05:44:22.696 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] init.o 2023-12-19T05:44:22.821 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] util.o 2023-12-19T05:44:23.021 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] edit.o 2023-12-19T05:44:23.249 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] free.o 2023-12-19T05:44:23.426 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] linux.o 2023-12-19T05:44:23.524 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] path.o 2023-12-19T05:44:23.659 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] project.o 2023-12-19T05:44:23.825 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] quot.o 2023-12-19T05:44:24.011 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] quota.o 2023-12-19T05:44:24.213 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] report.o 2023-12-19T05:44:24.480 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] state.o 2023-12-19T05:44:24.689 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] xfs_quota 2023-12-19T05:44:24.880 INFO:teuthology.orchestra.run.smithi188.stdout:Building mdrestore 2023-12-19T05:44:24.959 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_mdrestore.o 2023-12-19T05:44:25.157 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] xfs_mdrestore 2023-12-19T05:44:25.387 INFO:teuthology.orchestra.run.smithi188.stdout:Building repair 2023-12-19T05:44:27.271 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] agheader.o 2023-12-19T05:44:27.536 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] agbtree.o 2023-12-19T05:44:27.826 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] attr_repair.o 2023-12-19T05:44:28.237 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] avl.o 2023-12-19T05:44:28.498 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] bulkload.o 2023-12-19T05:44:28.653 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] bmap.o 2023-12-19T05:44:28.840 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] btree.o 2023-12-19T05:44:29.239 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] da_util.o 2023-12-19T05:44:29.500 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] dino_chunks.o 2023-12-19T05:44:29.747 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:44:29.750 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:44:29.753 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:44:29.913 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] dinode.o 2023-12-19T05:44:30.692 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] dir2.o 2023-12-19T05:44:31.133 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] globals.o 2023-12-19T05:44:31.253 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] incore_bmc.o 2023-12-19T05:44:31.384 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] incore.o 2023-12-19T05:44:31.558 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] incore_ext.o 2023-12-19T05:44:31.799 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] incore_ino.o 2023-12-19T05:44:32.089 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] init.o 2023-12-19T05:44:32.243 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] phase1.o 2023-12-19T05:44:32.400 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] phase2.o 2023-12-19T05:44:32.626 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] phase3.o 2023-12-19T05:44:32.790 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] phase4.o 2023-12-19T05:44:33.011 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] phase5.o 2023-12-19T05:44:33.317 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] phase6.o 2023-12-19T05:44:34.239 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] phase7.o 2023-12-19T05:44:34.404 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] prefetch.o 2023-12-19T05:44:34.780 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] progress.o 2023-12-19T05:44:35.013 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] quotacheck.o 2023-12-19T05:44:35.245 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] rmap.o 2023-12-19T05:44:35.668 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] rt.o 2023-12-19T05:44:35.868 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] sb.o 2023-12-19T05:44:36.125 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] scan.o 2023-12-19T05:44:36.927 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] slab.o 2023-12-19T05:44:37.120 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] threads.o 2023-12-19T05:44:37.255 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] versions.o 2023-12-19T05:44:37.398 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_repair.o 2023-12-19T05:44:37.719 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] xfs_repair 2023-12-19T05:44:38.042 INFO:teuthology.orchestra.run.smithi188.stdout:Building rtcp 2023-12-19T05:44:38.119 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_rtcp.o 2023-12-19T05:44:38.314 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] xfs_rtcp 2023-12-19T05:44:38.458 INFO:teuthology.orchestra.run.smithi188.stdout:Building m4 2023-12-19T05:44:38.469 INFO:teuthology.orchestra.run.smithi188.stdout:Building man 2023-12-19T05:44:38.483 INFO:teuthology.orchestra.run.smithi188.stdout:Building man2 2023-12-19T05:44:38.499 INFO:teuthology.orchestra.run.smithi188.stdout:Building man3 2023-12-19T05:44:38.513 INFO:teuthology.orchestra.run.smithi188.stdout:Building man5 2023-12-19T05:44:38.527 INFO:teuthology.orchestra.run.smithi188.stdout:Building man8 2023-12-19T05:44:38.555 INFO:teuthology.orchestra.run.smithi188.stdout: [SED] mkfs.xfs.8 2023-12-19T05:44:38.567 INFO:teuthology.orchestra.run.smithi188.stdout:Building doc 2023-12-19T05:44:38.581 INFO:teuthology.orchestra.run.smithi188.stdout: [ZIP] CHANGES.gz 2023-12-19T05:44:38.600 INFO:teuthology.orchestra.run.smithi188.stdout:Building debian 2023-12-19T05:44:38.611 INFO:teuthology.orchestra.run.smithi188.stdout:Building spaceman 2023-12-19T05:44:39.015 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] info.o 2023-12-19T05:44:39.149 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] init.o 2023-12-19T05:44:39.304 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] file.o 2023-12-19T05:44:39.455 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] health.o 2023-12-19T05:44:39.653 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] prealloc.o 2023-12-19T05:44:39.803 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] trim.o 2023-12-19T05:44:40.077 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] freesp.o 2023-12-19T05:44:40.299 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] xfs_spaceman 2023-12-19T05:44:40.489 INFO:teuthology.orchestra.run.smithi188.stdout:Building scrub 2023-12-19T05:44:41.525 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] common.o 2023-12-19T05:44:41.698 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] counter.o 2023-12-19T05:44:41.791 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] descr.o 2023-12-19T05:44:41.902 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] disk.o 2023-12-19T05:44:42.051 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] filemap.o 2023-12-19T05:44:42.159 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] fscounters.o 2023-12-19T05:44:42.276 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] inodes.o 2023-12-19T05:44:42.455 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] phase1.o 2023-12-19T05:44:42.590 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] phase2.o 2023-12-19T05:44:42.723 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] phase3.o 2023-12-19T05:44:42.866 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] phase4.o 2023-12-19T05:44:42.988 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] phase5.o 2023-12-19T05:44:43.158 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] phase6.o 2023-12-19T05:44:43.379 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] phase7.o 2023-12-19T05:44:43.522 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] progress.o 2023-12-19T05:44:43.655 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] read_verify.o 2023-12-19T05:44:43.813 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] repair.o 2023-12-19T05:44:43.970 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] scrub.o 2023-12-19T05:44:44.222 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] spacemap.o 2023-12-19T05:44:44.366 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] vfs.o 2023-12-19T05:44:44.516 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] xfs_scrub.o 2023-12-19T05:44:44.749 INFO:teuthology.orchestra.run.smithi188.stdout: [CC] unicrash.o 2023-12-19T05:44:44.971 INFO:teuthology.orchestra.run.smithi188.stdout: [LD] xfs_scrub 2023-12-19T05:44:45.353 INFO:teuthology.orchestra.run.smithi188.stdout: [SED] xfs_scrub_all 2023-12-19T05:44:45.366 INFO:teuthology.orchestra.run.smithi188.stdout: [SED] xfs_scrub@.service 2023-12-19T05:44:45.376 INFO:teuthology.orchestra.run.smithi188.stdout: [SED] xfs_scrub_all.service 2023-12-19T05:44:45.385 INFO:teuthology.orchestra.run.smithi188.stdout: [SED] xfs_scrub_fail@.service 2023-12-19T05:44:45.395 INFO:teuthology.orchestra.run.smithi188.stdout: [SED] xfs_scrub_all.cron 2023-12-19T05:44:45.404 INFO:teuthology.orchestra.run.smithi188.stdout:Building po 2023-12-19T05:44:45.443 INFO:teuthology.orchestra.run.smithi188.stdout: [GETTXT] xfsprogs.pot 2023-12-19T05:44:45.703 INFO:teuthology.orchestra.run.smithi188.stdout: [MSGFMT] de.mo 2023-12-19T05:44:45.749 INFO:teuthology.orchestra.run.smithi188.stderr:2345 translated messages. 2023-12-19T05:44:45.752 INFO:teuthology.orchestra.run.smithi188.stdout: [MSGFMT] pl.mo 2023-12-19T05:44:45.805 INFO:teuthology.orchestra.run.smithi188.stderr:3104 translated messages. 2023-12-19T05:44:45.806 INFO:teuthology.orchestra.run.smithi188.stdout:gmake[2]: Nothing to be done for 'include'. 2023-12-19T05:44:45.813 DEBUG:teuthology.orchestra.run.smithi188:> (cd /tmp/tmp.3ZCPZZ6XHZxfsprogs-dev && exec sudo make install) 2023-12-19T05:44:45.971 INFO:teuthology.orchestra.run.smithi188.stdout:Installing libfrog-install 2023-12-19T05:44:46.615 INFO:teuthology.orchestra.run.smithi188.stdout:Installing libxfs-install 2023-12-19T05:44:48.973 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-12-19T05:44:49.003 INFO:teuthology.orchestra.run.smithi188.stdout:Installing libxlog-install 2023-12-19T05:44:49.130 INFO:teuthology.orchestra.run.smithi188.stdout:Installing libxcmd-install 2023-12-19T05:44:49.314 INFO:teuthology.orchestra.run.smithi188.stdout:Installing libhandle-install 2023-12-19T05:44:49.419 INFO:teuthology.orchestra.run.smithi188.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib64; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib64; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib64 2023-12-19T05:44:49.546 INFO:teuthology.orchestra.run.smithi188.stdout:Installing copy-install 2023-12-19T05:44:49.621 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T05:44:49.653 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-12-19T05:44:49.734 INFO:teuthology.orchestra.run.smithi188.stdout:Installing db-install 2023-12-19T05:44:52.662 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T05:44:52.691 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-12-19T05:44:52.767 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-12-19T05:44:52.800 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-12-19T05:44:52.833 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-12-19T05:44:52.870 INFO:teuthology.orchestra.run.smithi188.stdout:Installing estimate-install 2023-12-19T05:44:52.944 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T05:44:52.977 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-12-19T05:44:53.053 INFO:teuthology.orchestra.run.smithi188.stdout:Installing fsck-install 2023-12-19T05:44:53.057 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-12-19T05:44:53.089 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-12-19T05:44:53.125 INFO:teuthology.orchestra.run.smithi188.stdout:Installing fsr-install 2023-12-19T05:44:53.193 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T05:44:53.226 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-12-19T05:44:53.301 INFO:teuthology.orchestra.run.smithi188.stdout:Installing growfs-install 2023-12-19T05:44:53.374 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T05:44:53.405 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-12-19T05:44:53.481 INFO:teuthology.orchestra.run.smithi188.stdout:Installing io-install 2023-12-19T05:44:55.485 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T05:44:55.517 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-12-19T05:44:55.590 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-12-19T05:44:55.661 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-12-19T05:44:55.733 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-12-19T05:44:55.807 INFO:teuthology.orchestra.run.smithi188.stdout:Installing logprint-install 2023-12-19T05:44:56.189 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T05:44:56.220 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-12-19T05:44:56.299 INFO:teuthology.orchestra.run.smithi188.stdout:Installing mkfs-install 2023-12-19T05:44:56.424 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-12-19T05:44:56.456 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-12-19T05:44:56.534 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-12-19T05:44:56.570 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf lts_6.6.conf /usr/share/xfsprogs/mkfs 2023-12-19T05:44:56.670 INFO:teuthology.orchestra.run.smithi188.stdout:Installing quota-install 2023-12-19T05:44:57.191 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T05:44:57.226 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-12-19T05:44:57.302 INFO:teuthology.orchestra.run.smithi188.stdout:Installing mdrestore-install 2023-12-19T05:44:57.375 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T05:44:57.405 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-12-19T05:44:57.481 INFO:teuthology.orchestra.run.smithi188.stdout:Installing repair-install 2023-12-19T05:44:59.358 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-12-19T05:44:59.392 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-12-19T05:44:59.478 INFO:teuthology.orchestra.run.smithi188.stdout:Installing rtcp-install 2023-12-19T05:44:59.551 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T05:44:59.581 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-12-19T05:44:59.655 INFO:teuthology.orchestra.run.smithi188.stdout:Installing m4-install 2023-12-19T05:44:59.659 INFO:teuthology.orchestra.run.smithi188.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T05:44:59.663 INFO:teuthology.orchestra.run.smithi188.stdout:Installing man-install 2023-12-19T05:44:59.674 INFO:teuthology.orchestra.run.smithi188.stdout:gmake[2]: Nothing to be done for 'install'. 2023-12-19T05:44:59.681 INFO:teuthology.orchestra.run.smithi188.stdout:gmake[2]: Nothing to be done for 'install'. 2023-12-19T05:44:59.692 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-12-19T05:44:59.733 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-12-19T05:44:59.773 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-12-19T05:44:59.814 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-12-19T05:44:59.862 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-12-19T05:44:59.879 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:44:59.882 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:44:59.884 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:44:59.907 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-12-19T05:44:59.939 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-12-19T05:44:59.971 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-12-19T05:45:00.001 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-12-19T05:45:00.035 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-12-19T05:45:00.072 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-12-19T05:45:00.110 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-12-19T05:45:00.152 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-12-19T05:45:00.192 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-12-19T05:45:00.232 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-12-19T05:45:00.272 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-12-19T05:45:00.312 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-12-19T05:45:00.355 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-12-19T05:45:00.397 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-12-19T05:45:00.437 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-12-19T05:45:00.478 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-12-19T05:45:00.519 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-12-19T05:45:00.561 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-12-19T05:45:00.602 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-12-19T05:45:00.644 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-12-19T05:45:00.684 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-12-19T05:45:00.725 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-12-19T05:45:00.764 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-12-19T05:45:00.806 INFO:teuthology.orchestra.run.smithi188.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-12-19T05:45:00.845 INFO:teuthology.orchestra.run.smithi188.stdout:Installing doc-install 2023-12-19T05:45:00.849 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-12-19T05:45:00.882 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-12-19T05:45:00.930 INFO:teuthology.orchestra.run.smithi188.stdout:Installing debian-install 2023-12-19T05:45:00.934 INFO:teuthology.orchestra.run.smithi188.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-19T05:45:00.937 INFO:teuthology.orchestra.run.smithi188.stdout:Installing spaceman-install 2023-12-19T05:45:01.337 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T05:45:01.369 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-12-19T05:45:01.442 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-12-19T05:45:01.478 INFO:teuthology.orchestra.run.smithi188.stdout:Installing scrub-install 2023-12-19T05:45:02.514 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-12-19T05:45:02.547 INFO:teuthology.orchestra.run.smithi188.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-12-19T05:45:02.621 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-12-19T05:45:02.654 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/systemd/system 2023-12-19T05:45:02.687 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /usr/lib/systemd/system 2023-12-19T05:45:02.752 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-12-19T05:45:02.785 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib64/xfsprogs 2023-12-19T05:45:02.819 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/lib64/xfsprogs 2023-12-19T05:45:02.851 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib64/xfsprogs 2023-12-19T05:45:02.883 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/udev/rules.d 2023-12-19T05:45:02.915 INFO:teuthology.orchestra.run.smithi188.stdout:for i in xfs.rules; do \ 2023-12-19T05:45:02.915 INFO:teuthology.orchestra.run.smithi188.stdout: ../install-sh -o root -g root -m 644 $i /usr/lib/udev/rules.d/64-$i; \ 2023-12-19T05:45:02.916 INFO:teuthology.orchestra.run.smithi188.stdout:done 2023-12-19T05:45:02.957 INFO:teuthology.orchestra.run.smithi188.stdout:Installing po-install 2023-12-19T05:45:03.116 INFO:teuthology.orchestra.run.smithi188.stdout:Installing include-install 2023-12-19T05:45:03.120 INFO:teuthology.orchestra.run.smithi188.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-12-19T05:45:03.153 INFO:teuthology.orchestra.run.smithi188.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-12-19T05:45:03.186 INFO:teuthology.orchestra.run.smithi188.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-12-19T05:45:03.225 INFO:tasks.cephfs.test_fscrypt:client is kernel mounted 2023-12-19T05:45:03.226 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-12-19T05:45:03.336 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.334+0000 7ff0a8d27640 1 Processor -- start 2023-12-19T05:45:03.336 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.334+0000 7ff0a8d27640 1 -- start start 2023-12-19T05:45:03.337 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.335+0000 7ff0a8d27640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0a406da70 0x7ff0a41429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.337 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.335+0000 7ff0a8d27640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0a4142ee0 0x7ff0a40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.337 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.335+0000 7ff0a8d27640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a406e690 con 0x7ff0a40b4e30 2023-12-19T05:45:03.337 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.335+0000 7ff0a8d27640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a406ebc0 con 0x7ff0a4142ee0 2023-12-19T05:45:03.338 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.335+0000 7ff0a8d27640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a40b3db0 con 0x7ff0a406da70 2023-12-19T05:45:03.338 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.335+0000 7ff0a1d9b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0a4142ee0 0x7ff0a40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.338 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.335+0000 7ff0a259c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0a406da70 0x7ff0a41429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.338 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.335+0000 7ff0a1d9b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7ff0a4142ee0 0x7ff0a40b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:44742/0 (socket says 172.21.15.120:44742) 2023-12-19T05:45:03.338 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.335+0000 7ff0a259c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0a406da70 0x7ff0a41429a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:58630/0 (socket says 172.21.15.120:58630) 2023-12-19T05:45:03.338 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.335+0000 7ff0a1d9b640 1 -- 172.21.15.120:0/3807622475 learned_addr learned my addr 172.21.15.120:0/3807622475 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:45:03.338 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.336+0000 7ff0a259c640 1 -- 172.21.15.120:0/3807622475 >> v2:172.21.15.155:3300/0 conn(0x7ff0a4142ee0 msgr2=0x7ff0a40b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:03.338 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.336+0000 7ff0a259c640 1 --2- 172.21.15.120:0/3807622475 >> v2:172.21.15.155:3300/0 conn(0x7ff0a4142ee0 0x7ff0a40b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.338 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.336+0000 7ff0a259c640 1 -- 172.21.15.120:0/3807622475 >> v1:172.21.15.155:6789/0 conn(0x7ff0a40b4e30 legacy=0x7ff0a414bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.338 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.336+0000 7ff0a259c640 1 -- 172.21.15.120:0/3807622475 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a40b9f60 con 0x7ff0a406da70 2023-12-19T05:45:03.338 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.336+0000 7ff0a1d9b640 1 --2- 172.21.15.120:0/3807622475 >> v2:172.21.15.155:3300/0 conn(0x7ff0a4142ee0 0x7ff0a40b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T05:45:03.340 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.336+0000 7ff0a259c640 1 --2- 172.21.15.120:0/3807622475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0a406da70 0x7ff0a41429a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff0940097a0 tx=0x7ff09402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbd5a0093ca83f2c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:03.340 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.337+0000 7ff0a159a640 1 -- 172.21.15.120:0/3807622475 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09402e070 con 0x7ff0a406da70 2023-12-19T05:45:03.340 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.337+0000 7ff0a159a640 1 -- 172.21.15.120:0/3807622475 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0940315a0 con 0x7ff0a406da70 2023-12-19T05:45:03.340 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.337+0000 7ff0a159a640 1 -- 172.21.15.120:0/3807622475 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff094031930 con 0x7ff0a406da70 2023-12-19T05:45:03.340 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.337+0000 7ff0a8d27640 1 -- 172.21.15.120:0/3807622475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0a406da70 msgr2=0x7ff0a41429a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.340 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.337+0000 7ff0a8d27640 1 --2- 172.21.15.120:0/3807622475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0a406da70 0x7ff0a41429a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff0940097a0 tx=0x7ff09402b840 comp rx=0 tx=0).stop 2023-12-19T05:45:03.340 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.337+0000 7ff0a8d27640 1 -- 172.21.15.120:0/3807622475 shutdown_connections 2023-12-19T05:45:03.340 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.337+0000 7ff0a8d27640 1 --2- 172.21.15.120:0/3807622475 >> v2:172.21.15.155:3300/0 conn(0x7ff0a4142ee0 0x7ff0a40b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.340 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.337+0000 7ff0a8d27640 1 --2- 172.21.15.120:0/3807622475 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0a406da70 0x7ff0a41429a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.340 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.337+0000 7ff0a8d27640 1 -- 172.21.15.120:0/3807622475 >> 172.21.15.120:0/3807622475 conn(0x7ff0a40bac10 msgr2=0x7ff0a40bb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:03.340 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.337+0000 7ff0a8d27640 1 -- 172.21.15.120:0/3807622475 shutdown_connections 2023-12-19T05:45:03.341 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.337+0000 7ff0a8d27640 1 -- 172.21.15.120:0/3807622475 wait complete. 2023-12-19T05:45:03.341 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.338+0000 7ff0a8d27640 1 Processor -- start 2023-12-19T05:45:03.341 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.339+0000 7ff0a8d27640 1 -- start start 2023-12-19T05:45:03.343 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.339+0000 7ff0a8d27640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0a406da70 0x7ff0a4145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.343 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.339+0000 7ff0a8d27640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0a40b4e30 0x7ff0a41de740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.343 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.339+0000 7ff0a8d27640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0a4142ee0 0x7ff0a41dec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.343 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.339+0000 7ff0a8d27640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a4145960 con 0x7ff0a406da70 2023-12-19T05:45:03.343 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.339+0000 7ff0a8d27640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a4144f90 con 0x7ff0a40b4e30 2023-12-19T05:45:03.343 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.339+0000 7ff0a8d27640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a4143890 con 0x7ff0a4142ee0 2023-12-19T05:45:03.343 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.339+0000 7ff0a259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0a406da70 0x7ff0a4145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.339+0000 7ff0a259c640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0a406da70 0x7ff0a4145420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33646/0 (socket says 172.21.15.120:33646) 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.339+0000 7ff0a259c640 1 -- 172.21.15.120:0/263555950 learned_addr learned my addr 172.21.15.120:0/263555950 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.339+0000 7ff0a1d9b640 1 --2- 172.21.15.120:0/263555950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0a40b4e30 0x7ff0a41de740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.339+0000 7ff0a2d9d640 1 --2- 172.21.15.120:0/263555950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0a4142ee0 0x7ff0a41dec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.340+0000 7ff0a259c640 1 -- 172.21.15.120:0/263555950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0a4142ee0 msgr2=0x7ff0a41dec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.340+0000 7ff0a259c640 1 --2- 172.21.15.120:0/263555950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0a4142ee0 0x7ff0a41dec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.340+0000 7ff0a259c640 1 -- 172.21.15.120:0/263555950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0a40b4e30 msgr2=0x7ff0a41de740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.340+0000 7ff0a259c640 1 --2- 172.21.15.120:0/263555950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0a40b4e30 0x7ff0a41de740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.340+0000 7ff0a259c640 1 -- 172.21.15.120:0/263555950 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0980094d0 con 0x7ff0a406da70 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.340+0000 7ff0a259c640 1 --2- 172.21.15.120:0/263555950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0a406da70 0x7ff0a4145420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff094034040 tx=0x7ff0940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.340+0000 7ff092ffd640 1 -- 172.21.15.120:0/263555950 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff094032840 con 0x7ff0a406da70 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.340+0000 7ff092ffd640 1 -- 172.21.15.120:0/263555950 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0940329c0 con 0x7ff0a406da70 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.340+0000 7ff0a8d27640 1 -- 172.21.15.120:0/263555950 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff094009400 con 0x7ff0a406da70 2023-12-19T05:45:03.344 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.340+0000 7ff092ffd640 1 -- 172.21.15.120:0/263555950 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff094032d70 con 0x7ff0a406da70 2023-12-19T05:45:03.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.340+0000 7ff0a8d27640 1 -- 172.21.15.120:0/263555950 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a40b8130 con 0x7ff0a406da70 2023-12-19T05:45:03.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.341+0000 7ff0a8d27640 1 -- 172.21.15.120:0/263555950 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a40ba620 con 0x7ff0a406da70 2023-12-19T05:45:03.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.341+0000 7ff092ffd640 1 -- 172.21.15.120:0/263555950 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff09404e430 con 0x7ff0a406da70 2023-12-19T05:45:03.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.342+0000 7ff092ffd640 1 --2- 172.21.15.120:0/263555950 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff08406a430 0x7ff08406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.342+0000 7ff092ffd640 1 -- 172.21.15.120:0/263555950 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0940aa8f0 con 0x7ff0a406da70 2023-12-19T05:45:03.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.342+0000 7ff0a1d9b640 1 --2- 172.21.15.120:0/263555950 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff08406a430 0x7ff08406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.345 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.342+0000 7ff0a1d9b640 1 --2- 172.21.15.120:0/263555950 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff08406a430 0x7ff08406c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff0a41391e0 tx=0x7ff098008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:03.348 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.346+0000 7ff092ffd640 1 -- 172.21.15.120:0/263555950 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7ff0a40ba620 con 0x7ff0a406da70 2023-12-19T05:45:03.581 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.580+0000 7ff0a8d27640 1 -- 172.21.15.120:0/263555950 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff0a40ba620 con 0x7ff0a406da70 2023-12-19T05:45:03.581 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.580+0000 7ff092ffd640 1 -- 172.21.15.120:0/263555950 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7ff0a40ba620 con 0x7ff0a406da70 2023-12-19T05:45:03.582 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T05:45:03.582 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":1,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","modified":"2023-12-19T05:37:59.727967Z","created":"2023-12-19T05:37:59.727967Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:3300","nonce":0},{"type":"v1","addr":"172.21.15.120:6789","nonce":0}]},"addr":"172.21.15.120:6789/0","public_addr":"172.21.15.120:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3301","nonce":0},{"type":"v1","addr":"172.21.15.155:6790","nonce":0}]},"addr":"172.21.15.155:6790/0","public_addr":"172.21.15.155:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-19T05:45:03.582 INFO:teuthology.orchestra.run.smithi120.stderr:dumped monmap epoch 1 2023-12-19T05:45:03.583 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.582+0000 7ff0a8d27640 1 -- 172.21.15.120:0/263555950 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff08406a430 msgr2=0x7ff08406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.583 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.582+0000 7ff0a8d27640 1 --2- 172.21.15.120:0/263555950 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff08406a430 0x7ff08406c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff0a41391e0 tx=0x7ff098008040 comp rx=0 tx=0).stop 2023-12-19T05:45:03.583 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.582+0000 7ff0a8d27640 1 -- 172.21.15.120:0/263555950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0a406da70 msgr2=0x7ff0a4145420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.583 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.582+0000 7ff0a8d27640 1 --2- 172.21.15.120:0/263555950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0a406da70 0x7ff0a4145420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff094034040 tx=0x7ff0940046c0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.584 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.582+0000 7ff0a8d27640 1 -- 172.21.15.120:0/263555950 shutdown_connections 2023-12-19T05:45:03.584 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.582+0000 7ff0a8d27640 1 --2- 172.21.15.120:0/263555950 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7ff08406a430 0x7ff08406c8f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.584 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.582+0000 7ff0a8d27640 1 --2- 172.21.15.120:0/263555950 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7ff0a4142ee0 0x7ff0a41dec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.584 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.582+0000 7ff0a8d27640 1 --2- 172.21.15.120:0/263555950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0a40b4e30 0x7ff0a41de740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.584 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.582+0000 7ff0a8d27640 1 --2- 172.21.15.120:0/263555950 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7ff0a406da70 0x7ff0a4145420 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.584 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.582+0000 7ff0a8d27640 1 -- 172.21.15.120:0/263555950 >> 172.21.15.120:0/263555950 conn(0x7ff0a40bac10 msgr2=0x7ff0a40b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:03.584 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.582+0000 7ff0a8d27640 1 -- 172.21.15.120:0/263555950 shutdown_connections 2023-12-19T05:45:03.584 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.582+0000 7ff0a8d27640 1 -- 172.21.15.120:0/263555950 wait complete. 2023-12-19T05:45:03.594 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-12-19T05:45:03.694 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.693+0000 7f0c4ffff640 1 Processor -- start 2023-12-19T05:45:03.695 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.693+0000 7f0c4ffff640 1 -- start start 2023-12-19T05:45:03.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.694+0000 7f0c4ffff640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0c500b65f0 0x7f0c5014aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.694+0000 7f0c4ffff640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7f0c500b5ef0 0x7f0c500b9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.694+0000 7f0c4ffff640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c500b50d0 con 0x7f0c500b9fc0 2023-12-19T05:45:03.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.694+0000 7f0c4ffff640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c50145130 con 0x7f0c500b65f0 2023-12-19T05:45:03.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.694+0000 7f0c4ffff640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c500b5560 con 0x7f0c500b5ef0 2023-12-19T05:45:03.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.694+0000 7f0c4effd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0c500b65f0 0x7f0c5014aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.696 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.694+0000 7f0c4effd640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7f0c500b65f0 0x7f0c5014aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33660/0 (socket says 172.21.15.120:33660) 2023-12-19T05:45:03.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.694+0000 7f0c4effd640 1 -- 172.21.15.120:0/2134116201 learned_addr learned my addr 172.21.15.120:0/2134116201 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:45:03.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.694+0000 7f0c4effd640 1 -- 172.21.15.120:0/2134116201 >> v2:172.21.15.155:3300/0 conn(0x7f0c500b5ef0 msgr2=0x7f0c500b9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:03.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.694+0000 7f0c4effd640 1 --2- 172.21.15.120:0/2134116201 >> v2:172.21.15.155:3300/0 conn(0x7f0c500b5ef0 0x7f0c500b9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.694+0000 7f0c4effd640 1 -- 172.21.15.120:0/2134116201 >> v1:172.21.15.155:6789/0 conn(0x7f0c500b9fc0 legacy=0x7f0c5014deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T05:45:03.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.694+0000 7f0c4effd640 1 -- 172.21.15.120:0/2134116201 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c500b6d50 con 0x7f0c500b65f0 2023-12-19T05:45:03.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.695+0000 7f0c4effd640 1 --2- 172.21.15.120:0/2134116201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c500b65f0 0x7f0c5014aa00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0c500b7d80 tx=0x7f0c4002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555a4af3e075e4ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:03.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.695+0000 7f0c4dffb640 1 -- 172.21.15.120:0/2134116201 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c40004230 con 0x7f0c500b65f0 2023-12-19T05:45:03.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.695+0000 7f0c4dffb640 1 -- 172.21.15.120:0/2134116201 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c40004390 con 0x7f0c500b65f0 2023-12-19T05:45:03.697 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.695+0000 7f0c4dffb640 1 -- 172.21.15.120:0/2134116201 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c40030840 con 0x7f0c500b65f0 2023-12-19T05:45:03.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.695+0000 7f0c4ffff640 1 -- 172.21.15.120:0/2134116201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c500b65f0 msgr2=0x7f0c5014aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.695+0000 7f0c4ffff640 1 --2- 172.21.15.120:0/2134116201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c500b65f0 0x7f0c5014aa00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0c500b7d80 tx=0x7f0c4002b980 comp rx=0 tx=0).stop 2023-12-19T05:45:03.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.695+0000 7f0c4ffff640 1 -- 172.21.15.120:0/2134116201 shutdown_connections 2023-12-19T05:45:03.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.695+0000 7f0c4ffff640 1 --2- 172.21.15.120:0/2134116201 >> v2:172.21.15.155:3300/0 conn(0x7f0c500b5ef0 0x7f0c500b9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.695+0000 7f0c4ffff640 1 --2- 172.21.15.120:0/2134116201 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c500b65f0 0x7f0c5014aa00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.695+0000 7f0c4ffff640 1 -- 172.21.15.120:0/2134116201 >> 172.21.15.120:0/2134116201 conn(0x7f0c500c0190 msgr2=0x7f0c500c05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:03.700 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.695+0000 7f0c4ffff640 1 -- 172.21.15.120:0/2134116201 shutdown_connections 2023-12-19T05:45:03.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.695+0000 7f0c4ffff640 1 -- 172.21.15.120:0/2134116201 wait complete. 2023-12-19T05:45:03.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.696+0000 7f0c4ffff640 1 Processor -- start 2023-12-19T05:45:03.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4ffff640 1 -- start start 2023-12-19T05:45:03.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500b5ef0 0x7f0c50147bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4ffff640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c500b65f0 0x7f0c501d1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4ffff640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c500b9fc0 0x7f0c501d67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4ffff640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c501e06f0 con 0x7f0c500b9fc0 2023-12-19T05:45:03.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4ffff640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c501df930 con 0x7f0c500b5ef0 2023-12-19T05:45:03.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4ffff640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c501dfc10 con 0x7f0c500b65f0 2023-12-19T05:45:03.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c500b9fc0 0x7f0c501d67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4f7fe640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c500b9fc0 0x7f0c501d67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:33664/0 (socket says 172.21.15.120:33664) 2023-12-19T05:45:03.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4f7fe640 1 -- 172.21.15.120:0/4000513013 learned_addr learned my addr 172.21.15.120:0/4000513013 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T05:45:03.701 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4f7fe640 1 -- 172.21.15.120:0/4000513013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c500b65f0 msgr2=0x7f0c501d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4e7fc640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c500b65f0 0x7f0c501d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4effd640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500b5ef0 0x7f0c50147bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4f7fe640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c500b65f0 0x7f0c501d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4f7fe640 1 -- 172.21.15.120:0/4000513013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500b5ef0 msgr2=0x7f0c50147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4f7fe640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500b5ef0 0x7f0c50147bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4f7fe640 1 -- 172.21.15.120:0/4000513013 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c40009460 con 0x7f0c500b9fc0 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.697+0000 7f0c4effd640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500b5ef0 0x7f0c50147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.698+0000 7f0c4e7fc640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c500b65f0 0x7f0c501d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.698+0000 7f0c4f7fe640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c500b9fc0 0x7f0c501d67a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800c780 tx=0x7f0c4800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.698+0000 7f0c377fe640 1 -- 172.21.15.120:0/4000513013 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c48003d80 con 0x7f0c500b9fc0 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.698+0000 7f0c377fe640 1 -- 172.21.15.120:0/4000513013 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4800ce30 con 0x7f0c500b9fc0 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.698+0000 7f0c4ffff640 1 -- 172.21.15.120:0/4000513013 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c501dfef0 con 0x7f0c500b9fc0 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.698+0000 7f0c377fe640 1 -- 172.21.15.120:0/4000513013 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c480052b0 con 0x7f0c500b9fc0 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.698+0000 7f0c4ffff640 1 -- 172.21.15.120:0/4000513013 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c50146ce0 con 0x7f0c500b9fc0 2023-12-19T05:45:03.702 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.699+0000 7f0c4ffff640 1 -- 172.21.15.120:0/4000513013 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c501e0410 con 0x7f0c500b9fc0 2023-12-19T05:45:03.703 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.699+0000 7f0c377fe640 1 -- 172.21.15.120:0/4000513013 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0c48005410 con 0x7f0c500b9fc0 2023-12-19T05:45:03.703 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.699+0000 7f0c377fe640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f0c3c06a430 0x7f0c3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T05:45:03.703 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.699+0000 7f0c377fe640 1 -- 172.21.15.120:0/4000513013 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c48088120 con 0x7f0c500b9fc0 2023-12-19T05:45:03.703 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.700+0000 7f0c4effd640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f0c3c06a430 0x7f0c3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T05:45:03.703 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.700+0000 7f0c4effd640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f0c3c06a430 0x7f0c3c06c8f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0c40035000 tx=0x7f0c40008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T05:45:03.705 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.704+0000 7f0c377fe640 1 -- 172.21.15.120:0/4000513013 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7f0c501e0410 con 0x7f0c500b9fc0 2023-12-19T05:45:03.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.932+0000 7f0c4ffff640 1 -- 172.21.15.120:0/4000513013 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f0c501e0410 con 0x7f0c500b9fc0 2023-12-19T05:45:03.933 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.932+0000 7f0c377fe640 1 -- 172.21.15.120:0/4000513013 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f0c48017050 con 0x7f0c500b9fc0 2023-12-19T05:45:03.934 INFO:teuthology.orchestra.run.smithi120.stdout:[client.admin] 2023-12-19T05:45:03.934 INFO:teuthology.orchestra.run.smithi120.stdout: key = AQA4LIFljwWIAxAAGU4DYcPLGx3//cKl4HJCQA== 2023-12-19T05:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.934+0000 7f0c4ffff640 1 -- 172.21.15.120:0/4000513013 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f0c3c06a430 msgr2=0x7f0c3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.934+0000 7f0c4ffff640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f0c3c06a430 0x7f0c3c06c8f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0c40035000 tx=0x7f0c40008030 comp rx=0 tx=0).stop 2023-12-19T05:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.934+0000 7f0c4ffff640 1 -- 172.21.15.120:0/4000513013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c500b9fc0 msgr2=0x7f0c501d67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T05:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.934+0000 7f0c4ffff640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c500b9fc0 0x7f0c501d67a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800c780 tx=0x7f0c4800cc40 comp rx=0 tx=0).stop 2023-12-19T05:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.934+0000 7f0c4ffff640 1 -- 172.21.15.120:0/4000513013 shutdown_connections 2023-12-19T05:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.934+0000 7f0c4ffff640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7f0c3c06a430 0x7f0c3c06c8f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.934+0000 7f0c4ffff640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7f0c500b9fc0 0x7f0c501d67a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.934+0000 7f0c4ffff640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7f0c500b65f0 0x7f0c501d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.934+0000 7f0c4ffff640 1 --2- 172.21.15.120:0/4000513013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0c500b5ef0 0x7f0c50147bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T05:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.934+0000 7f0c4ffff640 1 -- 172.21.15.120:0/4000513013 >> 172.21.15.120:0/4000513013 conn(0x7f0c500c0190 msgr2=0x7f0c500be090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T05:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.934+0000 7f0c4ffff640 1 -- 172.21.15.120:0/4000513013 shutdown_connections 2023-12-19T05:45:03.936 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T05:45:03.934+0000 7f0c4ffff640 1 -- 172.21.15.120:0/4000513013 wait complete. 2023-12-19T05:45:03.946 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T05:45:03.946 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/tmp/tmp.3GYFeLTziIxfstests-dev/local.config 2023-12-19T05:45:04.047 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.120:6789:/test export TEST_DIR=/tmp/tmp.gKLPzIzpajtest export SCRATCH_DEV=172.21.15.120:6789:/scratch export SCRATCH_MNT=/tmp/tmp.5OkJwJdUnTscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQA4LIFljwWIAxAAGU4DYcPLGx3//cKl4HJCQA==,test_dummy_encryption" 2023-12-19T05:45:04.047 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-12-19T05:45:04.047 DEBUG:teuthology.orchestra.run.smithi188:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.3GYFeLTziIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-12-19T05:45:06.740 INFO:teuthology.orchestra.run.smithi188.stdout:FSTYP -- ceph 2023-12-19T05:45:06.755 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM -- Linux/x86_64 smithi188 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-19T05:45:06.758 INFO:teuthology.orchestra.run.smithi188.stdout:MKFS_OPTIONS -- 172.21.15.120:6789:/scratch 2023-12-19T05:45:06.762 INFO:teuthology.orchestra.run.smithi188.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQA4LIFljwWIAxAAGU4DYcPLGx3//cKl4HJCQA==,test_dummy_encryption -o context=system_u:object_r:root_t:s0 172.21.15.120:6789:/scratch /tmp/tmp.5OkJwJdUnTscratch 2023-12-19T05:45:06.762 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T05:45:06.972 INFO:teuthology.orchestra.run.smithi188.stdout:ceph/001 [expunged] 2023-12-19T05:45:07.468 INFO:teuthology.orchestra.run.smithi188.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T05:45:07.997 INFO:teuthology.orchestra.run.smithi188.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T05:45:08.631 INFO:teuthology.orchestra.run.smithi188.stdout:ceph/004 0s 2023-12-19T05:45:09.072 INFO:teuthology.orchestra.run.smithi188.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T05:45:19.310 INFO:teuthology.orchestra.run.smithi188.stdout:generic/001 10s 2023-12-19T05:45:20.210 INFO:teuthology.orchestra.run.smithi188.stdout:generic/002 1s 2023-12-19T05:45:20.669 INFO:teuthology.orchestra.run.smithi188.stdout:generic/003 [not run] atime not maintained by ceph 2023-12-19T05:45:21.133 INFO:teuthology.orchestra.run.smithi188.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-12-19T05:45:21.975 INFO:teuthology.orchestra.run.smithi188.stdout:generic/005 0s 2023-12-19T05:45:30.010 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:45:30.012 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:45:30.015 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:45:43.766 INFO:teuthology.orchestra.run.smithi188.stdout:generic/006 21s 2023-12-19T05:46:00.339 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:46:00.342 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:46:00.344 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:46:30.652 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:46:30.655 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:46:30.658 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:46:30.743 INFO:teuthology.orchestra.run.smithi188.stdout:generic/007 47s 2023-12-19T05:46:32.797 INFO:teuthology.orchestra.run.smithi188.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T05:46:34.869 INFO:teuthology.orchestra.run.smithi188.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T05:47:00.975 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:47:00.978 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:47:00.981 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:47:02.291 INFO:teuthology.orchestra.run.smithi188.stdout:generic/011 28s 2023-12-19T05:47:04.349 INFO:teuthology.orchestra.run.smithi188.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T05:47:31.273 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:47:31.276 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:47:31.279 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:47:45.147 INFO:teuthology.orchestra.run.smithi188.stdout:generic/013 41s 2023-12-19T05:48:01.412 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:48:01.416 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:48:01.418 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:48:01.487 INFO:tasks.ceph.mds.c.smithi120.stderr:2023-12-19T05:48:01.486+0000 7fdc88b93640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 101708) UID: 0 2023-12-19T05:48:01.487 INFO:tasks.ceph.mds.a.smithi120.stderr:2023-12-19T05:48:01.486+0000 7f9ce0a8b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 101708) UID: 0 2023-12-19T05:50:08.513 INFO:teuthology.orchestra.run.smithi188.stdout:generic/014 143s 2023-12-19T05:50:08.943 INFO:teuthology.orchestra.run.smithi188.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-19T05:50:15.801 INFO:teuthology.orchestra.run.smithi188.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T05:50:16.430 INFO:teuthology.orchestra.run.smithi188.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-12-19T05:50:27.976 INFO:teuthology.orchestra.run.smithi188.stdout:generic/020 11s 2023-12-19T05:50:33.328 INFO:teuthology.orchestra.run.smithi188.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T05:50:37.306 INFO:teuthology.orchestra.run.smithi188.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T05:50:39.141 INFO:teuthology.orchestra.run.smithi188.stdout:generic/023 2s 2023-12-19T05:50:39.632 INFO:teuthology.orchestra.run.smithi188.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-12-19T05:50:40.115 INFO:teuthology.orchestra.run.smithi188.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-12-19T05:50:40.612 INFO:teuthology.orchestra.run.smithi188.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-12-19T05:50:46.106 INFO:teuthology.orchestra.run.smithi188.stdout:generic/028 6s 2023-12-19T05:50:47.388 INFO:teuthology.orchestra.run.smithi188.stdout:generic/029 1s 2023-12-19T05:50:52.258 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:50:52.261 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:50:52.264 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:50:54.879 INFO:teuthology.orchestra.run.smithi188.stdout:generic/030 7s 2023-12-19T05:51:00.901 INFO:teuthology.orchestra.run.smithi188.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-19T05:51:01.376 INFO:teuthology.orchestra.run.smithi188.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T05:51:05.314 INFO:teuthology.orchestra.run.smithi188.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T05:51:05.845 INFO:teuthology.orchestra.run.smithi188.stdout:generic/034 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:51:06.427 INFO:teuthology.orchestra.run.smithi188.stdout:generic/035 1s 2023-12-19T05:51:13.731 INFO:teuthology.orchestra.run.smithi188.stdout:generic/037 7s 2023-12-19T05:51:14.264 INFO:teuthology.orchestra.run.smithi188.stdout:generic/039 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:51:14.774 INFO:teuthology.orchestra.run.smithi188.stdout:generic/040 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:51:15.279 INFO:teuthology.orchestra.run.smithi188.stdout:generic/041 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:51:15.911 INFO:teuthology.orchestra.run.smithi188.stdout:generic/042 [not run] ceph does not support shutdown 2023-12-19T05:51:16.557 INFO:teuthology.orchestra.run.smithi188.stdout:generic/050 [not run] ceph does not support shutdown 2023-12-19T05:51:17.186 INFO:teuthology.orchestra.run.smithi188.stdout:generic/052 [not run] ceph does not support shutdown 2023-12-19T05:51:18.298 INFO:teuthology.orchestra.run.smithi188.stdout:generic/053 1s 2023-12-19T05:51:18.861 INFO:teuthology.orchestra.run.smithi188.stdout:generic/056 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:51:19.355 INFO:teuthology.orchestra.run.smithi188.stdout:generic/057 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:51:22.371 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:51:22.373 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:51:22.376 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:51:23.584 INFO:teuthology.orchestra.run.smithi188.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T05:51:24.069 INFO:teuthology.orchestra.run.smithi188.stdout:generic/059 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:51:29.350 INFO:teuthology.orchestra.run.smithi188.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T05:51:34.991 INFO:teuthology.orchestra.run.smithi188.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T05:51:37.575 INFO:teuthology.orchestra.run.smithi188.stdout:generic/062 2s 2023-12-19T05:51:42.337 INFO:teuthology.orchestra.run.smithi188.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T05:51:42.834 INFO:teuthology.orchestra.run.smithi188.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-19T05:51:43.359 INFO:teuthology.orchestra.run.smithi188.stdout:generic/065 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:51:43.858 INFO:teuthology.orchestra.run.smithi188.stdout:generic/066 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:51:44.386 INFO:teuthology.orchestra.run.smithi188.stdout:generic/067 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:51:52.511 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:51:52.514 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:51:52.517 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:52:04.491 INFO:teuthology.orchestra.run.smithi188.stdout:generic/069 20s 2023-12-19T05:52:22.732 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:52:22.735 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:52:22.737 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:52:30.039 INFO:teuthology.orchestra.run.smithi188.stdout:generic/070 26s 2023-12-19T05:52:30.500 INFO:teuthology.orchestra.run.smithi188.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T05:52:30.996 INFO:teuthology.orchestra.run.smithi188.stdout:generic/073 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:52:52.904 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:52:52.907 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:52:52.909 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:52:55.285 INFO:teuthology.orchestra.run.smithi188.stdout:generic/075 24s 2023-12-19T05:52:55.675 INFO:teuthology.orchestra.run.smithi188.stdout:generic/076 [not run] require 172.21.15.120:6789:/scratch to be local device 2023-12-19T05:52:56.149 INFO:teuthology.orchestra.run.smithi188.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-12-19T05:52:56.590 INFO:teuthology.orchestra.run.smithi188.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-12-19T05:52:59.104 INFO:teuthology.orchestra.run.smithi188.stdout:generic/080 3s 2023-12-19T05:52:59.591 INFO:teuthology.orchestra.run.smithi188.stdout:generic/081 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:53:00.058 INFO:teuthology.orchestra.run.smithi188.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T05:53:06.015 INFO:teuthology.orchestra.run.smithi188.stdout:generic/084 6s 2023-12-19T05:53:06.555 INFO:teuthology.orchestra.run.smithi188.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T05:53:07.164 INFO:teuthology.orchestra.run.smithi188.stdout:generic/087 1s 2023-12-19T05:53:07.666 INFO:teuthology.orchestra.run.smithi188.stdout:generic/088 0s 2023-12-19T05:53:08.180 INFO:teuthology.orchestra.run.smithi188.stdout:generic/090 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:53:23.068 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:53:23.071 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:53:23.074 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:53:53.218 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:53:53.221 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:53:53.224 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:54:13.043 INFO:teuthology.orchestra.run.smithi188.stdout:generic/091 65s 2023-12-19T05:54:13.516 INFO:teuthology.orchestra.run.smithi188.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T05:54:14.048 INFO:teuthology.orchestra.run.smithi188.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-19T05:54:18.517 INFO:teuthology.orchestra.run.smithi188.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-19T05:54:19.351 INFO:teuthology.orchestra.run.smithi188.stdout:generic/097 1s 2023-12-19T05:54:20.580 INFO:teuthology.orchestra.run.smithi188.stdout:generic/098 1s 2023-12-19T05:54:22.206 INFO:teuthology.orchestra.run.smithi188.stdout:generic/099 2s 2023-12-19T05:54:22.659 INFO:teuthology.orchestra.run.smithi188.stdout:generic/101 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:54:23.193 INFO:teuthology.orchestra.run.smithi188.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T05:54:23.363 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:54:23.366 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:54:23.369 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:54:23.655 INFO:teuthology.orchestra.run.smithi188.stdout:generic/104 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:54:24.606 INFO:teuthology.orchestra.run.smithi188.stdout:generic/105 1s 2023-12-19T05:54:25.194 INFO:teuthology.orchestra.run.smithi188.stdout:generic/106 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:54:25.707 INFO:teuthology.orchestra.run.smithi188.stdout:generic/107 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:54:26.308 INFO:teuthology.orchestra.run.smithi188.stdout:generic/108 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T05:54:26.809 INFO:teuthology.orchestra.run.smithi188.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T05:54:27.320 INFO:teuthology.orchestra.run.smithi188.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T05:54:53.702 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:54:53.705 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:54:53.707 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:55:00.692 INFO:teuthology.orchestra.run.smithi188.stdout:generic/112 33s 2023-12-19T05:55:23.845 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:55:23.848 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:55:23.850 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:55:54.164 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:55:54.168 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:55:54.170 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:56:24.308 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:56:24.310 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:56:24.313 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:56:54.485 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:56:54.488 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:56:54.490 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:57:12.175 INFO:teuthology.orchestra.run.smithi188.stdout:generic/113 132s 2023-12-19T05:57:12.662 INFO:teuthology.orchestra.run.smithi188.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-12-19T05:57:13.180 INFO:teuthology.orchestra.run.smithi188.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T05:57:13.715 INFO:teuthology.orchestra.run.smithi188.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T05:57:21.277 INFO:teuthology.orchestra.run.smithi188.stdout:generic/117 8s 2023-12-19T05:57:21.847 INFO:teuthology.orchestra.run.smithi188.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T05:57:22.347 INFO:teuthology.orchestra.run.smithi188.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T05:57:22.802 INFO:teuthology.orchestra.run.smithi188.stdout:generic/120 [not run] atime not maintained by ceph 2023-12-19T05:57:23.360 INFO:teuthology.orchestra.run.smithi188.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T05:57:23.890 INFO:teuthology.orchestra.run.smithi188.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T05:57:24.640 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:57:24.643 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:57:24.646 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:57:25.016 INFO:teuthology.orchestra.run.smithi188.stdout:generic/123 2s 2023-12-19T05:57:53.433 INFO:teuthology.orchestra.run.smithi188.stdout:generic/124 28s 2023-12-19T05:57:54.232 INFO:teuthology.orchestra.run.smithi188.stdout:generic/126 1s 2023-12-19T05:57:54.778 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:57:54.781 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:57:54.783 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:58:06.861 INFO:teuthology.orchestra.run.smithi188.stdout:generic/128 12s 2023-12-19T05:58:24.896 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:58:24.899 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:58:24.903 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:58:55.075 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:58:55.079 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:58:55.083 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:59:25.219 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:59:25.223 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:59:25.225 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:59:55.389 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:59:55.392 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T05:59:55.394 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:00:25.534 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:00:25.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:00:25.540 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:00:55.730 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:00:55.733 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:00:55.736 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:01:26.012 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:01:26.016 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:01:26.021 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:01:56.361 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:01:56.364 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:01:56.366 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:02:26.509 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:02:26.517 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:02:26.523 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:02:56.727 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:02:56.730 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:02:56.733 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:03:27.149 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:03:27.154 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:03:27.157 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:03:57.309 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:03:57.312 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:03:57.314 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:04:27.452 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:04:27.455 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:04:27.457 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:04:57.596 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:04:57.600 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:04:57.607 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:05:27.749 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:05:27.753 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:05:27.756 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:05:57.901 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:05:57.904 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:05:57.906 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:06:28.095 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:06:28.098 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:06:28.100 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:06:58.456 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:06:58.459 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:06:58.461 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:07:28.789 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:07:28.792 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:07:28.794 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:07:58.926 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:07:58.929 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:07:58.937 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:08:29.137 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:08:29.140 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:08:29.143 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:08:59.366 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:08:59.369 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:08:59.377 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:09:29.608 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:09:29.612 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:09:29.614 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:09:59.827 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:09:59.830 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:09:59.832 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:10:30.046 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:10:30.050 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:10:30.052 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:11:00.256 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:11:00.261 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:11:00.263 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:11:30.458 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:11:30.462 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:11:30.530 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:12:00.743 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:12:00.800 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:12:00.802 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:12:31.147 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:12:31.152 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:12:31.155 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:13:01.356 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:13:01.361 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:13:01.363 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:13:31.583 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:13:31.586 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:13:31.588 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:14:01.784 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:14:01.787 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:14:01.794 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:14:31.978 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:14:31.981 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:14:31.984 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:15:02.189 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:15:02.192 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:15:02.195 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:15:32.399 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:15:32.402 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:15:32.405 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:16:02.601 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:16:02.604 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:16:02.606 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:16:32.812 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:16:32.819 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:16:32.822 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:17:03.039 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:17:03.042 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:17:03.045 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:17:33.310 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:17:33.313 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:17:33.315 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:18:03.518 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:18:03.521 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:18:03.531 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:18:27.298 INFO:teuthology.orchestra.run.smithi188.stdout:generic/129 1221s 2023-12-19T06:18:33.728 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:18:33.730 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:18:33.733 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:18:43.126 INFO:teuthology.orchestra.run.smithi188.stdout:generic/130 16s 2023-12-19T06:18:44.892 INFO:teuthology.orchestra.run.smithi188.stdout:generic/131 1s 2023-12-19T06:18:45.384 INFO:teuthology.orchestra.run.smithi188.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:47.183 INFO:teuthology.orchestra.run.smithi188.stdout:generic/135 2s 2023-12-19T06:18:47.764 INFO:teuthology.orchestra.run.smithi188.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T06:18:48.289 INFO:teuthology.orchestra.run.smithi188.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:48.788 INFO:teuthology.orchestra.run.smithi188.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:49.281 INFO:teuthology.orchestra.run.smithi188.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:51.387 INFO:teuthology.orchestra.run.smithi188.stdout:generic/141 2s 2023-12-19T06:18:51.983 INFO:teuthology.orchestra.run.smithi188.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:52.503 INFO:teuthology.orchestra.run.smithi188.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:53.022 INFO:teuthology.orchestra.run.smithi188.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:53.546 INFO:teuthology.orchestra.run.smithi188.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:54.020 INFO:teuthology.orchestra.run.smithi188.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:54.530 INFO:teuthology.orchestra.run.smithi188.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:55.040 INFO:teuthology.orchestra.run.smithi188.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:55.541 INFO:teuthology.orchestra.run.smithi188.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:56.083 INFO:teuthology.orchestra.run.smithi188.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:56.586 INFO:teuthology.orchestra.run.smithi188.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:57.091 INFO:teuthology.orchestra.run.smithi188.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:57.608 INFO:teuthology.orchestra.run.smithi188.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:58.139 INFO:teuthology.orchestra.run.smithi188.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:58.649 INFO:teuthology.orchestra.run.smithi188.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:59.187 INFO:teuthology.orchestra.run.smithi188.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:18:59.715 INFO:teuthology.orchestra.run.smithi188.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:19:00.240 INFO:teuthology.orchestra.run.smithi188.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T06:19:00.711 INFO:teuthology.orchestra.run.smithi188.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-12-19T06:19:01.209 INFO:teuthology.orchestra.run.smithi188.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-12-19T06:19:01.977 INFO:teuthology.orchestra.run.smithi188.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:02.681 INFO:teuthology.orchestra.run.smithi188.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T06:19:03.478 INFO:teuthology.orchestra.run.smithi188.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T06:19:03.856 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:19:03.859 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:19:03.867 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:19:04.928 INFO:teuthology.orchestra.run.smithi188.stdout:generic/169 1s 2023-12-19T06:19:05.768 INFO:teuthology.orchestra.run.smithi188.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:06.560 INFO:teuthology.orchestra.run.smithi188.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:07.370 INFO:teuthology.orchestra.run.smithi188.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:08.139 INFO:teuthology.orchestra.run.smithi188.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:17.181 INFO:teuthology.orchestra.run.smithi188.stdout:generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T06:19:17.698 INFO:teuthology.orchestra.run.smithi188.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:19:18.208 INFO:teuthology.orchestra.run.smithi188.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:19:18.726 INFO:teuthology.orchestra.run.smithi188.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:19:19.219 INFO:teuthology.orchestra.run.smithi188.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:19:19.729 INFO:teuthology.orchestra.run.smithi188.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T06:19:20.536 INFO:teuthology.orchestra.run.smithi188.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:21.052 INFO:teuthology.orchestra.run.smithi188.stdout:generic/184 1s 2023-12-19T06:19:21.823 INFO:teuthology.orchestra.run.smithi188.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:22.592 INFO:teuthology.orchestra.run.smithi188.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:23.323 INFO:teuthology.orchestra.run.smithi188.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:24.110 INFO:teuthology.orchestra.run.smithi188.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:24.905 INFO:teuthology.orchestra.run.smithi188.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:26.975 INFO:teuthology.orchestra.run.smithi188.stdout:generic/193 2s 2023-12-19T06:19:27.793 INFO:teuthology.orchestra.run.smithi188.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:28.587 INFO:teuthology.orchestra.run.smithi188.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:29.404 INFO:teuthology.orchestra.run.smithi188.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:30.192 INFO:teuthology.orchestra.run.smithi188.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:19:33.991 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:19:33.993 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:19:33.996 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:19:34.063 INFO:tasks.ceph.osd.2.smithi120.stderr:2023-12-19T06:19:34.061+0000 7fe01984b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102803) UID: 0 2023-12-19T06:19:34.063 INFO:tasks.ceph.osd.1.smithi120.stderr:2023-12-19T06:19:34.061+0000 7ff81c5bd640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102803) UID: 0 2023-12-19T06:19:34.064 INFO:tasks.ceph.osd.0.smithi120.stderr:2023-12-19T06:19:34.061+0000 7f4d2d9a2640 -1 Fail to open '/proc/102803/cmdline' error = (2) No such file or directory 2023-12-19T06:19:34.064 INFO:tasks.ceph.osd.0.smithi120.stderr:2023-12-19T06:19:34.061+0000 7f4d2d9a2640 -1 received signal: Hangup from (PID: 102803) UID: 0 2023-12-19T06:19:34.074 INFO:tasks.ceph.osd.3.smithi120.stderr:2023-12-19T06:19:34.061+0000 7f0f9bda4640 -1 Fail to open '/proc/102803/cmdline' error = (2) No such file or directory 2023-12-19T06:19:34.074 INFO:tasks.ceph.osd.3.smithi120.stderr:2023-12-19T06:19:34.061+0000 7f0f9bda4640 -1 received signal: Hangup from (PID: 102803) UID: 0 2023-12-19T06:20:05.779 INFO:teuthology.orchestra.run.smithi188.stdout:generic/198 35s 2023-12-19T06:20:06.533 INFO:teuthology.orchestra.run.smithi188.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:20:07.343 INFO:teuthology.orchestra.run.smithi188.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:20:08.135 INFO:teuthology.orchestra.run.smithi188.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:20:08.904 INFO:teuthology.orchestra.run.smithi188.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:20:09.681 INFO:teuthology.orchestra.run.smithi188.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:20:10.459 INFO:teuthology.orchestra.run.smithi188.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:20:11.223 INFO:teuthology.orchestra.run.smithi188.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:20:28.931 INFO:teuthology.orchestra.run.smithi188.stdout:generic/207 17s 2023-12-19T06:20:29.552 INFO:teuthology.orchestra.run.smithi188.stdout:generic/210 1s 2023-12-19T06:20:30.545 INFO:teuthology.orchestra.run.smithi188.stdout:generic/211 1s 2023-12-19T06:20:31.111 INFO:teuthology.orchestra.run.smithi188.stdout:generic/212 1s 2023-12-19T06:20:31.586 INFO:teuthology.orchestra.run.smithi188.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T06:20:32.087 INFO:teuthology.orchestra.run.smithi188.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T06:20:34.658 INFO:teuthology.orchestra.run.smithi188.stdout:generic/215 2s 2023-12-19T06:20:35.425 INFO:teuthology.orchestra.run.smithi188.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:20:36.190 INFO:teuthology.orchestra.run.smithi188.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:20:36.993 INFO:teuthology.orchestra.run.smithi188.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:20:37.463 INFO:teuthology.orchestra.run.smithi188.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T06:20:38.268 INFO:teuthology.orchestra.run.smithi188.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:20:39.801 INFO:teuthology.orchestra.run.smithi188.stdout:generic/221 1s 2023-12-19T06:20:40.580 INFO:teuthology.orchestra.run.smithi188.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:20:41.060 INFO:teuthology.orchestra.run.smithi188.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T06:20:41.603 INFO:teuthology.orchestra.run.smithi188.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-19T06:20:42.391 INFO:teuthology.orchestra.run.smithi188.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:20:42.878 INFO:teuthology.orchestra.run.smithi188.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T06:20:43.669 INFO:teuthology.orchestra.run.smithi188.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:20:44.121 INFO:teuthology.orchestra.run.smithi188.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T06:20:44.564 INFO:teuthology.orchestra.run.smithi188.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T06:20:46.159 INFO:teuthology.orchestra.run.smithi188.stdout:generic/236 2s 2023-12-19T06:20:46.746 INFO:teuthology.orchestra.run.smithi188.stdout:generic/237 0s 2023-12-19T06:20:47.525 INFO:teuthology.orchestra.run.smithi188.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:21:00.830 INFO:teuthology.orchestra.run.smithi188.stdout:generic/240 13s 2023-12-19T06:21:01.269 INFO:teuthology.orchestra.run.smithi188.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T06:21:01.826 INFO:teuthology.orchestra.run.smithi188.stdout:generic/245 0s 2023-12-19T06:21:02.325 INFO:teuthology.orchestra.run.smithi188.stdout:generic/246 1s 2023-12-19T06:22:20.067 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:22:20.071 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:22:20.073 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:22:20.121 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-12-19T06:22:20.118+0000 7f756fd05640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96742) UID: 0 2023-12-19T06:22:20.131 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-12-19T06:22:20.118+0000 7f8533f79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96742) UID: 0 2023-12-19T06:22:20.132 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-12-19T06:22:20.118+0000 7f14f63ce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96742) UID: 0 2023-12-19T06:22:20.132 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-12-19T06:22:20.118+0000 7f3534827640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96742) UID: 0 2023-12-19T06:25:11.432 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:25:11.436 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:25:11.438 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:25:41.637 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:25:41.641 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:25:41.643 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:26:11.845 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:26:11.848 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:26:11.850 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:26:11.879 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-12-19T06:26:11.876+0000 7f8533f79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96805) UID: 0 2023-12-19T06:26:11.879 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-12-19T06:26:11.876+0000 7f14f63ce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96805) UID: 0 2023-12-19T06:26:11.880 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-12-19T06:26:11.876+0000 7f756fd05640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96805) UID: 0 2023-12-19T06:26:11.880 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-12-19T06:26:11.876+0000 7f3534827640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96805) UID: 0 2023-12-19T06:26:34.834 INFO:teuthology.orchestra.run.smithi188.stdout:generic/247 332s 2023-12-19T06:26:35.397 INFO:teuthology.orchestra.run.smithi188.stdout:generic/248 1s 2023-12-19T06:27:02.910 INFO:teuthology.orchestra.run.smithi188.stdout:generic/249 27s 2023-12-19T06:27:03.395 INFO:teuthology.orchestra.run.smithi188.stdout:generic/250 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:27:03.865 INFO:teuthology.orchestra.run.smithi188.stdout:generic/252 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:27:04.649 INFO:teuthology.orchestra.run.smithi188.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:27:05.435 INFO:teuthology.orchestra.run.smithi188.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:27:17.004 INFO:teuthology.orchestra.run.smithi188.stdout:generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T06:27:25.529 INFO:teuthology.orchestra.run.smithi188.stdout:generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T06:27:26.868 INFO:teuthology.orchestra.run.smithi188.stdout:generic/257 1s 2023-12-19T06:27:27.321 INFO:teuthology.orchestra.run.smithi188.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-12-19T06:27:28.149 INFO:teuthology.orchestra.run.smithi188.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:27:28.827 INFO:teuthology.orchestra.run.smithi188.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.5OkJwJdUnTscratch 2023-12-19T06:27:29.629 INFO:teuthology.orchestra.run.smithi188.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:27:30.393 INFO:teuthology.orchestra.run.smithi188.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:32.910 INFO:teuthology.orchestra.run.smithi188.stdout:generic/263 62s 2023-12-19T06:28:33.699 INFO:teuthology.orchestra.run.smithi188.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:34.524 INFO:teuthology.orchestra.run.smithi188.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:35.341 INFO:teuthology.orchestra.run.smithi188.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:36.189 INFO:teuthology.orchestra.run.smithi188.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:37.047 INFO:teuthology.orchestra.run.smithi188.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:37.855 INFO:teuthology.orchestra.run.smithi188.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:38.685 INFO:teuthology.orchestra.run.smithi188.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:39.487 INFO:teuthology.orchestra.run.smithi188.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:39.944 INFO:teuthology.orchestra.run.smithi188.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-12-19T06:28:40.770 INFO:teuthology.orchestra.run.smithi188.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:41.588 INFO:teuthology.orchestra.run.smithi188.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:42.461 INFO:teuthology.orchestra.run.smithi188.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:43.302 INFO:teuthology.orchestra.run.smithi188.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:44.118 INFO:teuthology.orchestra.run.smithi188.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:44.915 INFO:teuthology.orchestra.run.smithi188.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:45.395 INFO:teuthology.orchestra.run.smithi188.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T06:28:46.161 INFO:teuthology.orchestra.run.smithi188.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:46.805 INFO:teuthology.orchestra.run.smithi188.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.5OkJwJdUnTscratch 2023-12-19T06:28:47.587 INFO:teuthology.orchestra.run.smithi188.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:48.369 INFO:teuthology.orchestra.run.smithi188.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:49.042 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:28:49.045 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:28:49.047 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:28:49.197 INFO:teuthology.orchestra.run.smithi188.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:49.967 INFO:teuthology.orchestra.run.smithi188.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:50.767 INFO:teuthology.orchestra.run.smithi188.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:51.852 INFO:teuthology.orchestra.run.smithi188.stdout:generic/294 1s 2023-12-19T06:28:52.731 INFO:teuthology.orchestra.run.smithi188.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:53.496 INFO:teuthology.orchestra.run.smithi188.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:54.333 INFO:teuthology.orchestra.run.smithi188.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:55.126 INFO:teuthology.orchestra.run.smithi188.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:55.686 INFO:teuthology.orchestra.run.smithi188.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:28:56.193 INFO:teuthology.orchestra.run.smithi188.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T06:28:56.997 INFO:teuthology.orchestra.run.smithi188.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:28:57.939 INFO:teuthology.orchestra.run.smithi188.stdout:generic/306 0s 2023-12-19T06:29:00.356 INFO:teuthology.orchestra.run.smithi188.stdout:generic/307 3s 2023-12-19T06:29:00.926 INFO:teuthology.orchestra.run.smithi188.stdout:generic/308 0s 2023-12-19T06:29:02.466 INFO:teuthology.orchestra.run.smithi188.stdout:generic/309 2s 2023-12-19T06:29:02.911 INFO:teuthology.orchestra.run.smithi188.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T06:29:07.475 INFO:teuthology.orchestra.run.smithi188.stdout:generic/313 5s 2023-12-19T06:29:08.433 INFO:teuthology.orchestra.run.smithi188.stdout:generic/314 1s 2023-12-19T06:29:08.917 INFO:teuthology.orchestra.run.smithi188.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T06:29:19.474 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:29:19.477 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:29:19.480 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:29:19.510 INFO:tasks.ceph.osd.1.smithi120.stderr:2023-12-19T06:29:19.507+0000 7ff81c5bd640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102922) UID: 0 2023-12-19T06:29:19.510 INFO:tasks.ceph.osd.0.smithi120.stderr:2023-12-19T06:29:19.507+0000 7f4d2d9a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102922) UID: 0 2023-12-19T06:29:19.510 INFO:tasks.ceph.osd.2.smithi120.stderr:2023-12-19T06:29:19.507+0000 7fe01984b640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102922) UID: 0 2023-12-19T06:29:19.511 INFO:tasks.ceph.osd.3.smithi120.stderr:2023-12-19T06:29:19.507+0000 7f0f9bda4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102922) UID: 0 2023-12-19T06:29:20.159 INFO:teuthology.orchestra.run.smithi188.stdout:generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T06:29:21.468 INFO:teuthology.orchestra.run.smithi188.stdout:generic/317 - output mismatch (see /tmp/tmp.3GYFeLTziIxfstests-dev/results//generic/317.out.bad) 2023-12-19T06:29:21.475 INFO:teuthology.orchestra.run.smithi188.stdout: --- tests/generic/317.out 2023-12-19 05:39:48.313615481 +0000 2023-12-19T06:29:21.476 INFO:teuthology.orchestra.run.smithi188.stdout: +++ /tmp/tmp.3GYFeLTziIxfstests-dev/results//generic/317.out.bad 2023-12-19 06:29:21.462655564 +0000 2023-12-19T06:29:21.476 INFO:teuthology.orchestra.run.smithi188.stdout: @@ -4,9 +4,7 @@ 2023-12-19T06:29:21.476 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 0 Filetype: Regular File 2023-12-19T06:29:21.476 INFO:teuthology.orchestra.run.smithi188.stdout: Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) 2023-12-19T06:29:21.476 INFO:teuthology.orchestra.run.smithi188.stdout: From user_ns 2023-12-19T06:29:21.476 INFO:teuthology.orchestra.run.smithi188.stdout: - File: "$SCRATCH_MNT/file1" 2023-12-19T06:29:21.476 INFO:teuthology.orchestra.run.smithi188.stdout: - Size: 0 Filetype: Regular File 2023-12-19T06:29:21.476 INFO:teuthology.orchestra.run.smithi188.stdout: - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) 2023-12-19T06:29:21.476 INFO:teuthology.orchestra.run.smithi188.stdout: +execvp: Permission denied 2023-12-19T06:29:21.476 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T06:29:21.476 INFO:teuthology.orchestra.run.smithi188.stdout: *** Remounting *** 2023-12-19T06:29:21.476 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-12-19T06:29:21.477 INFO:teuthology.orchestra.run.smithi188.stdout: @@ -15,6 +13,4 @@ 2023-12-19T06:29:21.477 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 0 Filetype: Regular File 2023-12-19T06:29:21.477 INFO:teuthology.orchestra.run.smithi188.stdout: Mode: (0644/-rw-r--r--) Uid: (qa_user) Gid: (qa_user) 2023-12-19T06:29:21.477 INFO:teuthology.orchestra.run.smithi188.stdout: From user_ns 2023-12-19T06:29:21.477 INFO:teuthology.orchestra.run.smithi188.stdout: - File: "$SCRATCH_MNT/file1" 2023-12-19T06:29:21.477 INFO:teuthology.orchestra.run.smithi188.stdout: - Size: 0 Filetype: Regular File 2023-12-19T06:29:21.477 INFO:teuthology.orchestra.run.smithi188.stdout: - Mode: (0644/-rw-r--r--) Uid: (0) Gid: (0) 2023-12-19T06:29:21.477 INFO:teuthology.orchestra.run.smithi188.stdout: +execvp: Permission denied 2023-12-19T06:29:22.484 INFO:teuthology.orchestra.run.smithi188.stdout:generic/318 1s 2023-12-19T06:29:23.288 INFO:teuthology.orchestra.run.smithi188.stdout:generic/319 1s 2023-12-19T06:29:23.790 INFO:teuthology.orchestra.run.smithi188.stdout:generic/321 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:29:24.231 INFO:teuthology.orchestra.run.smithi188.stdout:generic/322 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:29:24.689 INFO:teuthology.orchestra.run.smithi188.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-12-19T06:29:25.155 INFO:teuthology.orchestra.run.smithi188.stdout:generic/325 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:29:25.967 INFO:teuthology.orchestra.run.smithi188.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:29:26.768 INFO:teuthology.orchestra.run.smithi188.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:29:27.542 INFO:teuthology.orchestra.run.smithi188.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:29:28.356 INFO:teuthology.orchestra.run.smithi188.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:29:29.122 INFO:teuthology.orchestra.run.smithi188.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:29:29.979 INFO:teuthology.orchestra.run.smithi188.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:29:30.754 INFO:teuthology.orchestra.run.smithi188.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:29:31.266 INFO:teuthology.orchestra.run.smithi188.stdout:generic/335 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:29:31.740 INFO:teuthology.orchestra.run.smithi188.stdout:generic/336 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:29:32.786 INFO:teuthology.orchestra.run.smithi188.stdout:generic/337 1s 2023-12-19T06:29:33.247 INFO:teuthology.orchestra.run.smithi188.stdout:generic/338 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:29:33.719 INFO:teuthology.orchestra.run.smithi188.stdout:generic/341 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:29:34.212 INFO:teuthology.orchestra.run.smithi188.stdout:generic/342 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:29:34.722 INFO:teuthology.orchestra.run.smithi188.stdout:generic/343 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:32:10.107 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:32:10.114 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:32:10.116 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:32:10.153 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-12-19T06:32:10.150+0000 7f8533f79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96873) UID: 0 2023-12-19T06:32:10.154 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-12-19T06:32:10.150+0000 7f14f63ce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96873) UID: 0 2023-12-19T06:32:10.154 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-12-19T06:32:10.150+0000 7f756fd05640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96873) UID: 0 2023-12-19T06:32:10.154 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-12-19T06:32:10.150+0000 7f3534827640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96873) UID: 0 2023-12-19T06:33:46.523 INFO:teuthology.orchestra.run.smithi188.stdout:generic/346 252s 2023-12-19T06:33:47.135 INFO:teuthology.orchestra.run.smithi188.stdout:generic/347 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:33:47.654 INFO:teuthology.orchestra.run.smithi188.stdout:generic/348 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:33:48.441 INFO:teuthology.orchestra.run.smithi188.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:33:49.531 INFO:teuthology.orchestra.run.smithi188.stdout:generic/355 1s 2023-12-19T06:33:50.200 INFO:teuthology.orchestra.run.smithi188.stdout:generic/356 [not run] swapfiles are not supported 2023-12-19T06:33:50.952 INFO:teuthology.orchestra.run.smithi188.stdout:generic/357 [not run] swapfiles are not supported 2023-12-19T06:33:51.735 INFO:teuthology.orchestra.run.smithi188.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:33:52.507 INFO:teuthology.orchestra.run.smithi188.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:33:53.064 INFO:teuthology.orchestra.run.smithi188.stdout:generic/360 1s 2023-12-19T06:33:53.513 INFO:teuthology.orchestra.run.smithi188.stdout:generic/361 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:33:53.969 INFO:teuthology.orchestra.run.smithi188.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T06:33:54.421 INFO:teuthology.orchestra.run.smithi188.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T06:33:54.904 INFO:teuthology.orchestra.run.smithi188.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T06:33:55.346 INFO:teuthology.orchestra.run.smithi188.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T06:33:55.774 INFO:teuthology.orchestra.run.smithi188.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T06:33:56.233 INFO:teuthology.orchestra.run.smithi188.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T06:33:56.693 INFO:teuthology.orchestra.run.smithi188.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T06:33:57.195 INFO:teuthology.orchestra.run.smithi188.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T06:33:57.629 INFO:teuthology.orchestra.run.smithi188.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-19T06:33:58.101 INFO:teuthology.orchestra.run.smithi188.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T06:33:58.878 INFO:teuthology.orchestra.run.smithi188.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:33:59.687 INFO:teuthology.orchestra.run.smithi188.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:34:00.383 INFO:teuthology.orchestra.run.smithi188.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-19T06:34:00.773 INFO:tasks.ceph.osd.1.smithi120.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.2.0-1377-g24e2e32a/rpm/el9/BUILD/ceph-18.2.0-1377-g24e2e32a/src/osd/PGLog.cc: In function 'void PGLog::check()' thread 7ff7ff37e640 time 2023-12-19T06:34:00.771061+0000 2023-12-19T06:34:00.773 INFO:tasks.ceph.osd.1.smithi120.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.2.0-1377-g24e2e32a/rpm/el9/BUILD/ceph-18.2.0-1377-g24e2e32a/src/osd/PGLog.cc: 628: FAILED ceph_assert(log_keys_debug.count(i->get_key_name())) 2023-12-19T06:34:00.792 INFO:tasks.ceph.osd.1.smithi120.stderr: ceph version 18.2.0-1377-g24e2e32a (24e2e32ab893c11f7e31ee84381b2f961d1b317c) reef (stable) 2023-12-19T06:34:00.792 INFO:tasks.ceph.osd.1.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x55f89f6981c9] 2023-12-19T06:34:00.792 INFO:tasks.ceph.osd.1.smithi120.stderr: 2: ceph-osd(+0x459385) [0x55f89f698385] 2023-12-19T06:34:00.792 INFO:tasks.ceph.osd.1.smithi120.stderr: 3: ceph-osd(+0x3fca76) [0x55f89f63ba76] 2023-12-19T06:34:00.792 INFO:tasks.ceph.osd.1.smithi120.stderr: 4: (PGLog::write_log_and_missing(ceph::os::Transaction&, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >*, coll_t const&, ghobject_t const&, bool)+0x1e5) [0x55f89f8a4595] 2023-12-19T06:34:00.792 INFO:tasks.ceph.osd.1.smithi120.stderr: 5: (PG::prepare_write(pg_info_t&, pg_info_t&, PastIntervals&, PGLog&, bool, bool, bool, ceph::os::Transaction&)+0x1ae) [0x55f89f86c8ee] 2023-12-19T06:34:00.792 INFO:tasks.ceph.osd.1.smithi120.stderr: 6: (PeeringState::write_if_dirty(ceph::os::Transaction&)+0x85) [0x55f89fa31315] 2023-12-19T06:34:00.792 INFO:tasks.ceph.osd.1.smithi120.stderr: 7: (PeeringState::append_log_entries_update_missing(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x2a8) [0x55f89fa3bc28] 2023-12-19T06:34:00.792 INFO:tasks.ceph.osd.1.smithi120.stderr: 8: (PeeringState::merge_new_log_entries(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x90) [0x55f89fa3c090] 2023-12-19T06:34:00.792 INFO:tasks.ceph.osd.1.smithi120.stderr: 9: ceph-osd(+0x6d6781) [0x55f89f915781] 2023-12-19T06:34:00.793 INFO:tasks.ceph.osd.1.smithi120.stderr: 10: (PrimaryLogPG::submit_log_entries(std::__cxx11::list > const&, ObcLockManager&&, std::optional >&&, boost::intrusive_ptr, int)+0x443) [0x55f89f916563] 2023-12-19T06:34:00.793 INFO:tasks.ceph.osd.1.smithi120.stderr: 11: (PrimaryLogPG::record_write_error(boost::intrusive_ptr, hobject_t const&, MOSDOpReply*, int, PrimaryLogPG::OpContext*)+0x6e5) [0x55f89f8c6175] 2023-12-19T06:34:00.793 INFO:tasks.ceph.osd.1.smithi120.stderr: 12: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x70e) [0x55f89f8db99e] 2023-12-19T06:34:00.793 INFO:tasks.ceph.osd.1.smithi120.stderr: 13: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x30ce) [0x55f89f8c961e] 2023-12-19T06:34:00.793 INFO:tasks.ceph.osd.1.smithi120.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55f89f81a3c7] 2023-12-19T06:34:00.793 INFO:tasks.ceph.osd.1.smithi120.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55f89fa0fa39] 2023-12-19T06:34:00.793 INFO:tasks.ceph.osd.1.smithi120.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xbf7) [0x55f89f830787] 2023-12-19T06:34:00.793 INFO:tasks.ceph.osd.1.smithi120.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x25b) [0x55f89fce1c2b] 2023-12-19T06:34:00.793 INFO:tasks.ceph.osd.1.smithi120.stderr: 18: ceph-osd(+0xaa3194) [0x55f89fce2194] 2023-12-19T06:34:00.793 INFO:tasks.ceph.osd.1.smithi120.stderr: 19: /lib64/libc.so.6(+0x9f802) [0x7ff82029f802] 2023-12-19T06:34:00.793 INFO:tasks.ceph.osd.1.smithi120.stderr: 20: /lib64/libc.so.6(+0x3f450) [0x7ff82023f450] 2023-12-19T06:34:00.793 INFO:tasks.ceph.osd.1.smithi120.stderr:*** Caught signal (Aborted) ** 2023-12-19T06:34:00.794 INFO:tasks.ceph.osd.1.smithi120.stderr: in thread 7ff7ff37e640 thread_name:tp_osd_tp 2023-12-19T06:34:00.794 INFO:tasks.ceph.osd.1.smithi120.stderr:2023-12-19T06:34:00.789+0000 7ff7ff37e640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.2.0-1377-g24e2e32a/rpm/el9/BUILD/ceph-18.2.0-1377-g24e2e32a/src/osd/PGLog.cc: In function 'void PGLog::check()' thread 7ff7ff37e640 time 2023-12-19T06:34:00.771061+0000 2023-12-19T06:34:00.794 INFO:tasks.ceph.osd.1.smithi120.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.2.0-1377-g24e2e32a/rpm/el9/BUILD/ceph-18.2.0-1377-g24e2e32a/src/osd/PGLog.cc: 628: FAILED ceph_assert(log_keys_debug.count(i->get_key_name())) 2023-12-19T06:34:00.794 INFO:tasks.ceph.osd.1.smithi120.stderr: 2023-12-19T06:34:00.794 INFO:tasks.ceph.osd.1.smithi120.stderr: ceph version 18.2.0-1377-g24e2e32a (24e2e32ab893c11f7e31ee84381b2f961d1b317c) reef (stable) 2023-12-19T06:34:00.794 INFO:tasks.ceph.osd.1.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x55f89f6981c9] 2023-12-19T06:34:00.794 INFO:tasks.ceph.osd.1.smithi120.stderr: 2: ceph-osd(+0x459385) [0x55f89f698385] 2023-12-19T06:34:00.794 INFO:tasks.ceph.osd.1.smithi120.stderr: 3: ceph-osd(+0x3fca76) [0x55f89f63ba76] 2023-12-19T06:34:00.794 INFO:tasks.ceph.osd.1.smithi120.stderr: 4: (PGLog::write_log_and_missing(ceph::os::Transaction&, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >*, coll_t const&, ghobject_t const&, bool)+0x1e5) [0x55f89f8a4595] 2023-12-19T06:34:00.795 INFO:tasks.ceph.osd.1.smithi120.stderr: 5: (PG::prepare_write(pg_info_t&, pg_info_t&, PastIntervals&, PGLog&, bool, bool, bool, ceph::os::Transaction&)+0x1ae) [0x55f89f86c8ee] 2023-12-19T06:34:00.795 INFO:tasks.ceph.osd.1.smithi120.stderr: 6: (PeeringState::write_if_dirty(ceph::os::Transaction&)+0x85) [0x55f89fa31315] 2023-12-19T06:34:00.795 INFO:tasks.ceph.osd.1.smithi120.stderr: 7: (PeeringState::append_log_entries_update_missing(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x2a8) [0x55f89fa3bc28] 2023-12-19T06:34:00.795 INFO:tasks.ceph.osd.1.smithi120.stderr: 8: (PeeringState::merge_new_log_entries(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x90) [0x55f89fa3c090] 2023-12-19T06:34:00.795 INFO:tasks.ceph.osd.1.smithi120.stderr: 9: ceph-osd(+0x6d6781) [0x55f89f915781] 2023-12-19T06:34:00.795 INFO:tasks.ceph.osd.1.smithi120.stderr: 10: (PrimaryLogPG::submit_log_entries(std::__cxx11::list > const&, ObcLockManager&&, std::optional >&&, boost::intrusive_ptr, int)+0x443) [0x55f89f916563] 2023-12-19T06:34:00.795 INFO:tasks.ceph.osd.1.smithi120.stderr: 11: (PrimaryLogPG::record_write_error(boost::intrusive_ptr, hobject_t const&, MOSDOpReply*, int, PrimaryLogPG::OpContext*)+0x6e5) [0x55f89f8c6175] 2023-12-19T06:34:00.795 INFO:tasks.ceph.osd.1.smithi120.stderr: 12: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x70e) [0x55f89f8db99e] 2023-12-19T06:34:00.795 INFO:tasks.ceph.osd.1.smithi120.stderr: 13: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x30ce) [0x55f89f8c961e] 2023-12-19T06:34:00.795 INFO:tasks.ceph.osd.1.smithi120.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55f89f81a3c7] 2023-12-19T06:34:00.795 INFO:tasks.ceph.osd.1.smithi120.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55f89fa0fa39] 2023-12-19T06:34:00.795 INFO:tasks.ceph.osd.1.smithi120.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xbf7) [0x55f89f830787] 2023-12-19T06:34:00.795 INFO:tasks.ceph.osd.1.smithi120.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x25b) [0x55f89fce1c2b] 2023-12-19T06:34:00.795 INFO:tasks.ceph.osd.1.smithi120.stderr: 18: ceph-osd(+0xaa3194) [0x55f89fce2194] 2023-12-19T06:34:00.796 INFO:tasks.ceph.osd.1.smithi120.stderr: 19: /lib64/libc.so.6(+0x9f802) [0x7ff82029f802] 2023-12-19T06:34:00.796 INFO:tasks.ceph.osd.1.smithi120.stderr: 20: /lib64/libc.so.6(+0x3f450) [0x7ff82023f450] 2023-12-19T06:34:00.796 INFO:tasks.ceph.osd.1.smithi120.stderr: 2023-12-19T06:34:00.796 INFO:tasks.ceph.osd.1.smithi120.stderr: ceph version 18.2.0-1377-g24e2e32a (24e2e32ab893c11f7e31ee84381b2f961d1b317c) reef (stable) 2023-12-19T06:34:00.796 INFO:tasks.ceph.osd.1.smithi120.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff820254db0] 2023-12-19T06:34:00.796 INFO:tasks.ceph.osd.1.smithi120.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff8202a154c] 2023-12-19T06:34:00.796 INFO:tasks.ceph.osd.1.smithi120.stderr: 3: raise() 2023-12-19T06:34:00.797 INFO:tasks.ceph.osd.1.smithi120.stderr: 4: abort() 2023-12-19T06:34:00.797 INFO:tasks.ceph.osd.1.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x179) [0x55f89f698224] 2023-12-19T06:34:00.797 INFO:tasks.ceph.osd.1.smithi120.stderr: 6: ceph-osd(+0x459385) [0x55f89f698385] 2023-12-19T06:34:00.797 INFO:tasks.ceph.osd.1.smithi120.stderr: 7: ceph-osd(+0x3fca76) [0x55f89f63ba76] 2023-12-19T06:34:00.797 INFO:tasks.ceph.osd.1.smithi120.stderr: 8: (PGLog::write_log_and_missing(ceph::os::Transaction&, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >*, coll_t const&, ghobject_t const&, bool)+0x1e5) [0x55f89f8a4595] 2023-12-19T06:34:00.797 INFO:tasks.ceph.osd.1.smithi120.stderr: 9: (PG::prepare_write(pg_info_t&, pg_info_t&, PastIntervals&, PGLog&, bool, bool, bool, ceph::os::Transaction&)+0x1ae) [0x55f89f86c8ee] 2023-12-19T06:34:00.797 INFO:tasks.ceph.osd.1.smithi120.stderr: 10: (PeeringState::write_if_dirty(ceph::os::Transaction&)+0x85) [0x55f89fa31315] 2023-12-19T06:34:00.797 INFO:tasks.ceph.osd.1.smithi120.stderr: 11: (PeeringState::append_log_entries_update_missing(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x2a8) [0x55f89fa3bc28] 2023-12-19T06:34:00.797 INFO:tasks.ceph.osd.1.smithi120.stderr: 12: (PeeringState::merge_new_log_entries(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x90) [0x55f89fa3c090] 2023-12-19T06:34:00.797 INFO:tasks.ceph.osd.1.smithi120.stderr: 13: ceph-osd(+0x6d6781) [0x55f89f915781] 2023-12-19T06:34:00.797 INFO:tasks.ceph.osd.1.smithi120.stderr: 14: (PrimaryLogPG::submit_log_entries(std::__cxx11::list > const&, ObcLockManager&&, std::optional >&&, boost::intrusive_ptr, int)+0x443) [0x55f89f916563] 2023-12-19T06:34:00.797 INFO:tasks.ceph.osd.1.smithi120.stderr: 15: (PrimaryLogPG::record_write_error(boost::intrusive_ptr, hobject_t const&, MOSDOpReply*, int, PrimaryLogPG::OpContext*)+0x6e5) [0x55f89f8c6175] 2023-12-19T06:34:00.797 INFO:tasks.ceph.osd.1.smithi120.stderr: 16: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x70e) [0x55f89f8db99e] 2023-12-19T06:34:00.797 INFO:tasks.ceph.osd.1.smithi120.stderr: 17: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x30ce) [0x55f89f8c961e] 2023-12-19T06:34:00.798 INFO:tasks.ceph.osd.1.smithi120.stderr: 18: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55f89f81a3c7] 2023-12-19T06:34:00.798 INFO:tasks.ceph.osd.1.smithi120.stderr: 19: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55f89fa0fa39] 2023-12-19T06:34:00.798 INFO:tasks.ceph.osd.1.smithi120.stderr: 20: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xbf7) [0x55f89f830787] 2023-12-19T06:34:00.798 INFO:tasks.ceph.osd.1.smithi120.stderr: 21: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x25b) [0x55f89fce1c2b] 2023-12-19T06:34:00.798 INFO:tasks.ceph.osd.1.smithi120.stderr: 22: ceph-osd(+0xaa3194) [0x55f89fce2194] 2023-12-19T06:34:00.798 INFO:tasks.ceph.osd.1.smithi120.stderr: 23: /lib64/libc.so.6(+0x9f802) [0x7ff82029f802] 2023-12-19T06:34:00.798 INFO:tasks.ceph.osd.1.smithi120.stderr: 24: /lib64/libc.so.6(+0x3f450) [0x7ff82023f450] 2023-12-19T06:34:00.798 INFO:tasks.ceph.osd.1.smithi120.stderr:2023-12-19T06:34:00.793+0000 7ff7ff37e640 -1 *** Caught signal (Aborted) ** 2023-12-19T06:34:00.798 INFO:tasks.ceph.osd.1.smithi120.stderr: in thread 7ff7ff37e640 thread_name:tp_osd_tp 2023-12-19T06:34:00.798 INFO:tasks.ceph.osd.1.smithi120.stderr: 2023-12-19T06:34:00.798 INFO:tasks.ceph.osd.1.smithi120.stderr: ceph version 18.2.0-1377-g24e2e32a (24e2e32ab893c11f7e31ee84381b2f961d1b317c) reef (stable) 2023-12-19T06:34:00.798 INFO:tasks.ceph.osd.1.smithi120.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff820254db0] 2023-12-19T06:34:00.798 INFO:tasks.ceph.osd.1.smithi120.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff8202a154c] 2023-12-19T06:34:00.798 INFO:tasks.ceph.osd.1.smithi120.stderr: 3: raise() 2023-12-19T06:34:00.799 INFO:tasks.ceph.osd.1.smithi120.stderr: 4: abort() 2023-12-19T06:34:00.799 INFO:tasks.ceph.osd.1.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x179) [0x55f89f698224] 2023-12-19T06:34:00.799 INFO:tasks.ceph.osd.1.smithi120.stderr: 6: ceph-osd(+0x459385) [0x55f89f698385] 2023-12-19T06:34:00.799 INFO:tasks.ceph.osd.1.smithi120.stderr: 7: ceph-osd(+0x3fca76) [0x55f89f63ba76] 2023-12-19T06:34:00.799 INFO:tasks.ceph.osd.1.smithi120.stderr: 8: (PGLog::write_log_and_missing(ceph::os::Transaction&, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >*, coll_t const&, ghobject_t const&, bool)+0x1e5) [0x55f89f8a4595] 2023-12-19T06:34:00.799 INFO:tasks.ceph.osd.1.smithi120.stderr: 9: (PG::prepare_write(pg_info_t&, pg_info_t&, PastIntervals&, PGLog&, bool, bool, bool, ceph::os::Transaction&)+0x1ae) [0x55f89f86c8ee] 2023-12-19T06:34:00.799 INFO:tasks.ceph.osd.1.smithi120.stderr: 10: (PeeringState::write_if_dirty(ceph::os::Transaction&)+0x85) [0x55f89fa31315] 2023-12-19T06:34:00.799 INFO:tasks.ceph.osd.1.smithi120.stderr: 11: (PeeringState::append_log_entries_update_missing(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x2a8) [0x55f89fa3bc28] 2023-12-19T06:34:00.799 INFO:tasks.ceph.osd.1.smithi120.stderr: 12: (PeeringState::merge_new_log_entries(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x90) [0x55f89fa3c090] 2023-12-19T06:34:00.799 INFO:tasks.ceph.osd.1.smithi120.stderr: 13: ceph-osd(+0x6d6781) [0x55f89f915781] 2023-12-19T06:34:00.799 INFO:tasks.ceph.osd.1.smithi120.stderr: 14: (PrimaryLogPG::submit_log_entries(std::__cxx11::list > const&, ObcLockManager&&, std::optional >&&, boost::intrusive_ptr, int)+0x443) [0x55f89f916563] 2023-12-19T06:34:00.799 INFO:tasks.ceph.osd.1.smithi120.stderr: 15: (PrimaryLogPG::record_write_error(boost::intrusive_ptr, hobject_t const&, MOSDOpReply*, int, PrimaryLogPG::OpContext*)+0x6e5) [0x55f89f8c6175] 2023-12-19T06:34:00.799 INFO:tasks.ceph.osd.1.smithi120.stderr: 16: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x70e) [0x55f89f8db99e] 2023-12-19T06:34:00.799 INFO:tasks.ceph.osd.1.smithi120.stderr: 17: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x30ce) [0x55f89f8c961e] 2023-12-19T06:34:00.800 INFO:tasks.ceph.osd.1.smithi120.stderr: 18: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55f89f81a3c7] 2023-12-19T06:34:00.800 INFO:tasks.ceph.osd.1.smithi120.stderr: 19: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55f89fa0fa39] 2023-12-19T06:34:00.800 INFO:tasks.ceph.osd.1.smithi120.stderr: 20: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xbf7) [0x55f89f830787] 2023-12-19T06:34:00.800 INFO:tasks.ceph.osd.1.smithi120.stderr: 21: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x25b) [0x55f89fce1c2b] 2023-12-19T06:34:00.800 INFO:tasks.ceph.osd.1.smithi120.stderr: 22: ceph-osd(+0xaa3194) [0x55f89fce2194] 2023-12-19T06:34:00.800 INFO:tasks.ceph.osd.1.smithi120.stderr: 23: /lib64/libc.so.6(+0x9f802) [0x7ff82029f802] 2023-12-19T06:34:00.800 INFO:tasks.ceph.osd.1.smithi120.stderr: 24: /lib64/libc.so.6(+0x3f450) [0x7ff82023f450] 2023-12-19T06:34:00.800 INFO:tasks.ceph.osd.1.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-19T06:34:00.800 INFO:tasks.ceph.osd.1.smithi120.stderr: 2023-12-19T06:34:00.812 INFO:tasks.ceph.osd.1.smithi120.stderr: -250> 2023-12-19T06:34:00.789+0000 7ff7ff37e640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.2.0-1377-g24e2e32a/rpm/el9/BUILD/ceph-18.2.0-1377-g24e2e32a/src/osd/PGLog.cc: In function 'void PGLog::check()' thread 7ff7ff37e640 time 2023-12-19T06:34:00.771061+0000 2023-12-19T06:34:00.813 INFO:tasks.ceph.osd.1.smithi120.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.2.0-1377-g24e2e32a/rpm/el9/BUILD/ceph-18.2.0-1377-g24e2e32a/src/osd/PGLog.cc: 628: FAILED ceph_assert(log_keys_debug.count(i->get_key_name())) 2023-12-19T06:34:00.813 INFO:tasks.ceph.osd.1.smithi120.stderr: 2023-12-19T06:34:00.813 INFO:tasks.ceph.osd.1.smithi120.stderr: ceph version 18.2.0-1377-g24e2e32a (24e2e32ab893c11f7e31ee84381b2f961d1b317c) reef (stable) 2023-12-19T06:34:00.813 INFO:tasks.ceph.osd.1.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x55f89f6981c9] 2023-12-19T06:34:00.813 INFO:tasks.ceph.osd.1.smithi120.stderr: 2: ceph-osd(+0x459385) [0x55f89f698385] 2023-12-19T06:34:00.813 INFO:tasks.ceph.osd.1.smithi120.stderr: 3: ceph-osd(+0x3fca76) [0x55f89f63ba76] 2023-12-19T06:34:00.813 INFO:tasks.ceph.osd.1.smithi120.stderr: 4: (PGLog::write_log_and_missing(ceph::os::Transaction&, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >*, coll_t const&, ghobject_t const&, bool)+0x1e5) [0x55f89f8a4595] 2023-12-19T06:34:00.813 INFO:tasks.ceph.osd.1.smithi120.stderr: 5: (PG::prepare_write(pg_info_t&, pg_info_t&, PastIntervals&, PGLog&, bool, bool, bool, ceph::os::Transaction&)+0x1ae) [0x55f89f86c8ee] 2023-12-19T06:34:00.813 INFO:tasks.ceph.osd.1.smithi120.stderr: 6: (PeeringState::write_if_dirty(ceph::os::Transaction&)+0x85) [0x55f89fa31315] 2023-12-19T06:34:00.813 INFO:tasks.ceph.osd.1.smithi120.stderr: 7: (PeeringState::append_log_entries_update_missing(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x2a8) [0x55f89fa3bc28] 2023-12-19T06:34:00.813 INFO:tasks.ceph.osd.1.smithi120.stderr: 8: (PeeringState::merge_new_log_entries(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x90) [0x55f89fa3c090] 2023-12-19T06:34:00.813 INFO:tasks.ceph.osd.1.smithi120.stderr: 9: ceph-osd(+0x6d6781) [0x55f89f915781] 2023-12-19T06:34:00.814 INFO:tasks.ceph.osd.1.smithi120.stderr: 10: (PrimaryLogPG::submit_log_entries(std::__cxx11::list > const&, ObcLockManager&&, std::optional >&&, boost::intrusive_ptr, int)+0x443) [0x55f89f916563] 2023-12-19T06:34:00.814 INFO:tasks.ceph.osd.1.smithi120.stderr: 11: (PrimaryLogPG::record_write_error(boost::intrusive_ptr, hobject_t const&, MOSDOpReply*, int, PrimaryLogPG::OpContext*)+0x6e5) [0x55f89f8c6175] 2023-12-19T06:34:00.814 INFO:tasks.ceph.osd.1.smithi120.stderr: 12: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x70e) [0x55f89f8db99e] 2023-12-19T06:34:00.814 INFO:tasks.ceph.osd.1.smithi120.stderr: 13: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x30ce) [0x55f89f8c961e] 2023-12-19T06:34:00.814 INFO:tasks.ceph.osd.1.smithi120.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55f89f81a3c7] 2023-12-19T06:34:00.814 INFO:tasks.ceph.osd.1.smithi120.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55f89fa0fa39] 2023-12-19T06:34:00.814 INFO:tasks.ceph.osd.1.smithi120.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xbf7) [0x55f89f830787] 2023-12-19T06:34:00.814 INFO:tasks.ceph.osd.1.smithi120.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x25b) [0x55f89fce1c2b] 2023-12-19T06:34:00.814 INFO:tasks.ceph.osd.1.smithi120.stderr: 18: ceph-osd(+0xaa3194) [0x55f89fce2194] 2023-12-19T06:34:00.814 INFO:tasks.ceph.osd.1.smithi120.stderr: 19: /lib64/libc.so.6(+0x9f802) [0x7ff82029f802] 2023-12-19T06:34:00.814 INFO:tasks.ceph.osd.1.smithi120.stderr: 20: /lib64/libc.so.6(+0x3f450) [0x7ff82023f450] 2023-12-19T06:34:00.814 INFO:tasks.ceph.osd.1.smithi120.stderr: 2023-12-19T06:34:00.814 INFO:tasks.ceph.osd.1.smithi120.stderr: 0> 2023-12-19T06:34:00.793+0000 7ff7ff37e640 -1 *** Caught signal (Aborted) ** 2023-12-19T06:34:00.814 INFO:tasks.ceph.osd.1.smithi120.stderr: in thread 7ff7ff37e640 thread_name:tp_osd_tp 2023-12-19T06:34:00.815 INFO:tasks.ceph.osd.1.smithi120.stderr: 2023-12-19T06:34:00.815 INFO:tasks.ceph.osd.1.smithi120.stderr: ceph version 18.2.0-1377-g24e2e32a (24e2e32ab893c11f7e31ee84381b2f961d1b317c) reef (stable) 2023-12-19T06:34:00.815 INFO:tasks.ceph.osd.1.smithi120.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff820254db0] 2023-12-19T06:34:00.815 INFO:tasks.ceph.osd.1.smithi120.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff8202a154c] 2023-12-19T06:34:00.815 INFO:tasks.ceph.osd.1.smithi120.stderr: 3: raise() 2023-12-19T06:34:00.815 INFO:tasks.ceph.osd.1.smithi120.stderr: 4: abort() 2023-12-19T06:34:00.815 INFO:tasks.ceph.osd.1.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x179) [0x55f89f698224] 2023-12-19T06:34:00.815 INFO:tasks.ceph.osd.1.smithi120.stderr: 6: ceph-osd(+0x459385) [0x55f89f698385] 2023-12-19T06:34:00.815 INFO:tasks.ceph.osd.1.smithi120.stderr: 7: ceph-osd(+0x3fca76) [0x55f89f63ba76] 2023-12-19T06:34:00.815 INFO:tasks.ceph.osd.1.smithi120.stderr: 8: (PGLog::write_log_and_missing(ceph::os::Transaction&, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >*, coll_t const&, ghobject_t const&, bool)+0x1e5) [0x55f89f8a4595] 2023-12-19T06:34:00.815 INFO:tasks.ceph.osd.1.smithi120.stderr: 9: (PG::prepare_write(pg_info_t&, pg_info_t&, PastIntervals&, PGLog&, bool, bool, bool, ceph::os::Transaction&)+0x1ae) [0x55f89f86c8ee] 2023-12-19T06:34:00.815 INFO:tasks.ceph.osd.1.smithi120.stderr: 10: (PeeringState::write_if_dirty(ceph::os::Transaction&)+0x85) [0x55f89fa31315] 2023-12-19T06:34:00.815 INFO:tasks.ceph.osd.1.smithi120.stderr: 11: (PeeringState::append_log_entries_update_missing(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x2a8) [0x55f89fa3bc28] 2023-12-19T06:34:00.815 INFO:tasks.ceph.osd.1.smithi120.stderr: 12: (PeeringState::merge_new_log_entries(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x90) [0x55f89fa3c090] 2023-12-19T06:34:00.816 INFO:tasks.ceph.osd.1.smithi120.stderr: 13: ceph-osd(+0x6d6781) [0x55f89f915781] 2023-12-19T06:34:00.816 INFO:tasks.ceph.osd.1.smithi120.stderr: 14: (PrimaryLogPG::submit_log_entries(std::__cxx11::list > const&, ObcLockManager&&, std::optional >&&, boost::intrusive_ptr, int)+0x443) [0x55f89f916563] 2023-12-19T06:34:00.816 INFO:tasks.ceph.osd.1.smithi120.stderr: 15: (PrimaryLogPG::record_write_error(boost::intrusive_ptr, hobject_t const&, MOSDOpReply*, int, PrimaryLogPG::OpContext*)+0x6e5) [0x55f89f8c6175] 2023-12-19T06:34:00.816 INFO:tasks.ceph.osd.1.smithi120.stderr: 16: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x70e) [0x55f89f8db99e] 2023-12-19T06:34:00.816 INFO:tasks.ceph.osd.1.smithi120.stderr: 17: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x30ce) [0x55f89f8c961e] 2023-12-19T06:34:00.816 INFO:tasks.ceph.osd.1.smithi120.stderr: 18: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55f89f81a3c7] 2023-12-19T06:34:00.816 INFO:tasks.ceph.osd.1.smithi120.stderr: 19: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55f89fa0fa39] 2023-12-19T06:34:00.816 INFO:tasks.ceph.osd.1.smithi120.stderr: 20: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xbf7) [0x55f89f830787] 2023-12-19T06:34:00.816 INFO:tasks.ceph.osd.1.smithi120.stderr: 21: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x25b) [0x55f89fce1c2b] 2023-12-19T06:34:00.816 INFO:tasks.ceph.osd.1.smithi120.stderr: 22: ceph-osd(+0xaa3194) [0x55f89fce2194] 2023-12-19T06:34:00.816 INFO:tasks.ceph.osd.1.smithi120.stderr: 23: /lib64/libc.so.6(+0x9f802) [0x7ff82029f802] 2023-12-19T06:34:00.816 INFO:tasks.ceph.osd.1.smithi120.stderr: 24: /lib64/libc.so.6(+0x3f450) [0x7ff82023f450] 2023-12-19T06:34:00.816 INFO:tasks.ceph.osd.1.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-19T06:34:00.816 INFO:tasks.ceph.osd.1.smithi120.stderr: 2023-12-19T06:34:00.826 INFO:tasks.ceph.osd.1.smithi120.stderr: -702> 2023-12-19T06:34:00.789+0000 7ff7ff37e640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.2.0-1377-g24e2e32a/rpm/el9/BUILD/ceph-18.2.0-1377-g24e2e32a/src/osd/PGLog.cc: In function 'void PGLog::check()' thread 7ff7ff37e640 time 2023-12-19T06:34:00.771061+0000 2023-12-19T06:34:00.826 INFO:tasks.ceph.osd.1.smithi120.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.2.0-1377-g24e2e32a/rpm/el9/BUILD/ceph-18.2.0-1377-g24e2e32a/src/osd/PGLog.cc: 628: FAILED ceph_assert(log_keys_debug.count(i->get_key_name())) 2023-12-19T06:34:00.826 INFO:tasks.ceph.osd.1.smithi120.stderr: 2023-12-19T06:34:00.826 INFO:tasks.ceph.osd.1.smithi120.stderr: ceph version 18.2.0-1377-g24e2e32a (24e2e32ab893c11f7e31ee84381b2f961d1b317c) reef (stable) 2023-12-19T06:34:00.826 INFO:tasks.ceph.osd.1.smithi120.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x55f89f6981c9] 2023-12-19T06:34:00.826 INFO:tasks.ceph.osd.1.smithi120.stderr: 2: ceph-osd(+0x459385) [0x55f89f698385] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 3: ceph-osd(+0x3fca76) [0x55f89f63ba76] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 4: (PGLog::write_log_and_missing(ceph::os::Transaction&, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >*, coll_t const&, ghobject_t const&, bool)+0x1e5) [0x55f89f8a4595] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 5: (PG::prepare_write(pg_info_t&, pg_info_t&, PastIntervals&, PGLog&, bool, bool, bool, ceph::os::Transaction&)+0x1ae) [0x55f89f86c8ee] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 6: (PeeringState::write_if_dirty(ceph::os::Transaction&)+0x85) [0x55f89fa31315] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 7: (PeeringState::append_log_entries_update_missing(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x2a8) [0x55f89fa3bc28] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 8: (PeeringState::merge_new_log_entries(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x90) [0x55f89fa3c090] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 9: ceph-osd(+0x6d6781) [0x55f89f915781] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 10: (PrimaryLogPG::submit_log_entries(std::__cxx11::list > const&, ObcLockManager&&, std::optional >&&, boost::intrusive_ptr, int)+0x443) [0x55f89f916563] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 11: (PrimaryLogPG::record_write_error(boost::intrusive_ptr, hobject_t const&, MOSDOpReply*, int, PrimaryLogPG::OpContext*)+0x6e5) [0x55f89f8c6175] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 12: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x70e) [0x55f89f8db99e] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 13: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x30ce) [0x55f89f8c961e] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 14: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55f89f81a3c7] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 15: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55f89fa0fa39] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 16: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xbf7) [0x55f89f830787] 2023-12-19T06:34:00.827 INFO:tasks.ceph.osd.1.smithi120.stderr: 17: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x25b) [0x55f89fce1c2b] 2023-12-19T06:34:00.828 INFO:tasks.ceph.osd.1.smithi120.stderr: 18: ceph-osd(+0xaa3194) [0x55f89fce2194] 2023-12-19T06:34:00.828 INFO:tasks.ceph.osd.1.smithi120.stderr: 19: /lib64/libc.so.6(+0x9f802) [0x7ff82029f802] 2023-12-19T06:34:00.828 INFO:tasks.ceph.osd.1.smithi120.stderr: 20: /lib64/libc.so.6(+0x3f450) [0x7ff82023f450] 2023-12-19T06:34:00.828 INFO:tasks.ceph.osd.1.smithi120.stderr: 2023-12-19T06:34:00.828 INFO:tasks.ceph.osd.1.smithi120.stderr: -452> 2023-12-19T06:34:00.793+0000 7ff7ff37e640 -1 *** Caught signal (Aborted) ** 2023-12-19T06:34:00.828 INFO:tasks.ceph.osd.1.smithi120.stderr: in thread 7ff7ff37e640 thread_name:tp_osd_tp 2023-12-19T06:34:00.828 INFO:tasks.ceph.osd.1.smithi120.stderr: 2023-12-19T06:34:00.828 INFO:tasks.ceph.osd.1.smithi120.stderr: ceph version 18.2.0-1377-g24e2e32a (24e2e32ab893c11f7e31ee84381b2f961d1b317c) reef (stable) 2023-12-19T06:34:00.828 INFO:tasks.ceph.osd.1.smithi120.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7ff820254db0] 2023-12-19T06:34:00.828 INFO:tasks.ceph.osd.1.smithi120.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7ff8202a154c] 2023-12-19T06:34:00.828 INFO:tasks.ceph.osd.1.smithi120.stderr: 3: raise() 2023-12-19T06:34:00.828 INFO:tasks.ceph.osd.1.smithi120.stderr: 4: abort() 2023-12-19T06:34:00.828 INFO:tasks.ceph.osd.1.smithi120.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x179) [0x55f89f698224] 2023-12-19T06:34:00.828 INFO:tasks.ceph.osd.1.smithi120.stderr: 6: ceph-osd(+0x459385) [0x55f89f698385] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 7: ceph-osd(+0x3fca76) [0x55f89f63ba76] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 8: (PGLog::write_log_and_missing(ceph::os::Transaction&, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >*, coll_t const&, ghobject_t const&, bool)+0x1e5) [0x55f89f8a4595] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 9: (PG::prepare_write(pg_info_t&, pg_info_t&, PastIntervals&, PGLog&, bool, bool, bool, ceph::os::Transaction&)+0x1ae) [0x55f89f86c8ee] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 10: (PeeringState::write_if_dirty(ceph::os::Transaction&)+0x85) [0x55f89fa31315] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 11: (PeeringState::append_log_entries_update_missing(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x2a8) [0x55f89fa3bc28] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 12: (PeeringState::merge_new_log_entries(std::__cxx11::list > const&, ceph::os::Transaction&, std::optional, std::optional)+0x90) [0x55f89fa3c090] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 13: ceph-osd(+0x6d6781) [0x55f89f915781] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 14: (PrimaryLogPG::submit_log_entries(std::__cxx11::list > const&, ObcLockManager&&, std::optional >&&, boost::intrusive_ptr, int)+0x443) [0x55f89f916563] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 15: (PrimaryLogPG::record_write_error(boost::intrusive_ptr, hobject_t const&, MOSDOpReply*, int, PrimaryLogPG::OpContext*)+0x6e5) [0x55f89f8c6175] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 16: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x70e) [0x55f89f8db99e] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 17: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x30ce) [0x55f89f8c961e] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 18: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x197) [0x55f89f81a3c7] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 19: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x69) [0x55f89fa0fa39] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 20: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xbf7) [0x55f89f830787] 2023-12-19T06:34:00.829 INFO:tasks.ceph.osd.1.smithi120.stderr: 21: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x25b) [0x55f89fce1c2b] 2023-12-19T06:34:00.830 INFO:tasks.ceph.osd.1.smithi120.stderr: 22: ceph-osd(+0xaa3194) [0x55f89fce2194] 2023-12-19T06:34:00.830 INFO:tasks.ceph.osd.1.smithi120.stderr: 23: /lib64/libc.so.6(+0x9f802) [0x7ff82029f802] 2023-12-19T06:34:00.830 INFO:tasks.ceph.osd.1.smithi120.stderr: 24: /lib64/libc.so.6(+0x3f450) [0x7ff82023f450] 2023-12-19T06:34:00.830 INFO:tasks.ceph.osd.1.smithi120.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-19T06:34:00.830 INFO:tasks.ceph.osd.1.smithi120.stderr: 2023-12-19T06:34:01.178 INFO:teuthology.orchestra.run.smithi188.stdout:generic/375 1s 2023-12-19T06:34:01.670 INFO:teuthology.orchestra.run.smithi188.stdout:generic/376 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:34:02.758 INFO:teuthology.orchestra.run.smithi188.stdout:generic/377 1s 2023-12-19T06:34:03.798 INFO:teuthology.orchestra.run.smithi188.stdout:generic/378 1s 2023-12-19T06:34:04.245 INFO:teuthology.orchestra.run.smithi188.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T06:34:04.713 INFO:teuthology.orchestra.run.smithi188.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T06:34:05.179 INFO:teuthology.orchestra.run.smithi188.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T06:34:05.629 INFO:teuthology.orchestra.run.smithi188.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T06:34:06.052 INFO:teuthology.orchestra.run.smithi188.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T06:34:06.504 INFO:teuthology.orchestra.run.smithi188.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T06:34:06.950 INFO:teuthology.orchestra.run.smithi188.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T06:34:07.414 INFO:teuthology.orchestra.run.smithi188.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T06:34:07.892 INFO:teuthology.orchestra.run.smithi188.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-12-19T06:34:08.358 INFO:teuthology.orchestra.run.smithi188.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T06:34:09.018 INFO:teuthology.orchestra.run.smithi188.stdout:generic/392 [not run] ceph does not support shutdown 2023-12-19T06:34:10.630 INFO:teuthology.orchestra.run.smithi188.stdout:generic/393 1s 2023-12-19T06:34:11.115 INFO:tasks.ceph.osd.1.smithi120.stderr:daemon-helper: command crashed with signal 6 2023-12-19T06:34:11.233 INFO:teuthology.orchestra.run.smithi188.stdout:generic/394 1s 2023-12-19T06:34:11.816 INFO:teuthology.orchestra.run.smithi188.stdout:generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T06:34:12.430 INFO:teuthology.orchestra.run.smithi188.stdout:generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T06:34:13.027 INFO:teuthology.orchestra.run.smithi188.stdout:generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T06:34:13.632 INFO:teuthology.orchestra.run.smithi188.stdout:generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T06:34:14.061 INFO:teuthology.orchestra.run.smithi188.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-19T06:34:15.277 INFO:teuthology.orchestra.run.smithi188.stdout:generic/401 1s 2023-12-19T06:34:16.027 INFO:teuthology.orchestra.run.smithi188.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-12-19T06:34:17.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-12-19T06:34:17.789 INFO:teuthology.orchestra.run.smithi188.stdout:generic/403 1s 2023-12-19T06:34:18.269 INFO:teuthology.orchestra.run.smithi188.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T06:34:21.611 INFO:teuthology.orchestra.run.smithi188.stdout:generic/406 3s 2023-12-19T06:34:22.216 INFO:teuthology.orchestra.run.smithi188.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-12-19T06:34:22.774 INFO:teuthology.orchestra.run.smithi188.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-19T06:34:23.245 INFO:teuthology.orchestra.run.smithi188.stdout:generic/409 [not run] require 172.21.15.120:6789:/scratch to be local device 2023-12-19T06:34:23.728 INFO:teuthology.orchestra.run.smithi188.stdout:generic/410 [not run] require 172.21.15.120:6789:/scratch to be local device 2023-12-19T06:34:23.763 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~7s 2023-12-19T06:34:24.207 INFO:teuthology.orchestra.run.smithi188.stdout:generic/411 [not run] require 172.21.15.120:6789:/scratch to be local device 2023-12-19T06:34:25.586 INFO:teuthology.orchestra.run.smithi188.stdout:generic/412 1s 2023-12-19T06:34:26.284 INFO:teuthology.orchestra.run.smithi188.stdout:generic/413 [not run] mount 172.21.15.120:6789:/scratch with dax failed 2023-12-19T06:34:27.070 INFO:teuthology.orchestra.run.smithi188.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:34:27.694 INFO:teuthology.orchestra.run.smithi188.stdout:generic/417 [not run] ceph does not support shutdown 2023-12-19T06:34:28.280 INFO:teuthology.orchestra.run.smithi188.stdout:generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T06:34:30.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~13s 2023-12-19T06:34:36.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~20s 2023-12-19T06:34:37.022 INFO:teuthology.orchestra.run.smithi188.stdout:generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T06:34:37.623 INFO:teuthology.orchestra.run.smithi188.stdout:generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T06:34:38.107 INFO:teuthology.orchestra.run.smithi188.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-19T06:34:38.745 INFO:teuthology.orchestra.run.smithi188.stdout:generic/423 0s 2023-12-19T06:34:39.249 INFO:teuthology.orchestra.run.smithi188.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-12-19T06:34:39.786 INFO:teuthology.orchestra.run.smithi188.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-12-19T06:34:43.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~26s 2023-12-19T06:34:49.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~33s 2023-12-19T06:34:53.100 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:34:53.103 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:34:53.106 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:34:56.333 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~39s 2023-12-19T06:35:01.830 INFO:teuthology.orchestra.run.smithi188.stdout:generic/426 22s 2023-12-19T06:35:02.809 INFO:teuthology.orchestra.run.smithi188.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-19T06:35:02.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~46s 2023-12-19T06:35:03.344 INFO:teuthology.orchestra.run.smithi188.stdout:generic/428 1s 2023-12-19T06:35:04.050 INFO:teuthology.orchestra.run.smithi188.stdout:generic/430 1s 2023-12-19T06:35:04.655 INFO:teuthology.orchestra.run.smithi188.stdout:generic/431 0s 2023-12-19T06:35:05.338 INFO:teuthology.orchestra.run.smithi188.stdout:generic/432 1s 2023-12-19T06:35:05.949 INFO:teuthology.orchestra.run.smithi188.stdout:generic/433 0s 2023-12-19T06:35:06.612 INFO:teuthology.orchestra.run.smithi188.stdout:generic/434 1s 2023-12-19T06:35:07.296 INFO:teuthology.orchestra.run.smithi188.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T06:35:08.618 INFO:teuthology.orchestra.run.smithi188.stdout:generic/437 1s 2023-12-19T06:35:09.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~52s 2023-12-19T06:35:15.870 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~59s 2023-12-19T06:35:16.551 INFO:teuthology.orchestra.run.smithi188.stdout:generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T06:35:17.232 INFO:teuthology.orchestra.run.smithi188.stdout:generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-12-19T06:35:17.783 INFO:teuthology.orchestra.run.smithi188.stdout:generic/441 [not run] require 172.21.15.120:6789:/scratch to be valid block disk 2023-12-19T06:35:18.302 INFO:teuthology.orchestra.run.smithi188.stdout:generic/443 1s 2023-12-19T06:35:18.924 INFO:teuthology.orchestra.run.smithi188.stdout:generic/444 0s 2023-12-19T06:35:19.556 INFO:teuthology.orchestra.run.smithi188.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T06:35:22.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~65s 2023-12-19T06:35:24.366 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:35:24.368 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:35:24.370 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:35:26.793 INFO:teuthology.orchestra.run.smithi188.stdout:generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-12-19T06:35:27.561 INFO:teuthology.orchestra.run.smithi188.stdout:generic/448 1s 2023-12-19T06:35:28.120 INFO:teuthology.orchestra.run.smithi188.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-19T06:35:28.899 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~72s 2023-12-19T06:35:33.417 INFO:teuthology.orchestra.run.smithi188.stdout:generic/450 5s 2023-12-19T06:35:35.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~78s 2023-12-19T06:35:41.926 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~85s 2023-12-19T06:35:48.438 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~91s 2023-12-19T06:35:54.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~98s 2023-12-19T06:35:55.022 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:35:55.026 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:35:55.028 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:36:01.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~104s 2023-12-19T06:36:04.050 INFO:teuthology.orchestra.run.smithi188.stdout:generic/451 30s 2023-12-19T06:36:05.680 INFO:teuthology.orchestra.run.smithi188.stdout:generic/452 1s 2023-12-19T06:36:06.173 INFO:teuthology.orchestra.run.smithi188.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-12-19T06:36:06.665 INFO:teuthology.orchestra.run.smithi188.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-12-19T06:36:07.202 INFO:teuthology.orchestra.run.smithi188.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-19T06:36:07.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~111s 2023-12-19T06:36:07.992 INFO:teuthology.orchestra.run.smithi188.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-19T06:36:14.494 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~117s 2023-12-19T06:36:21.007 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~124s 2023-12-19T06:36:25.205 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:36:25.208 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:36:25.211 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:36:27.523 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~130s 2023-12-19T06:36:34.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~137s 2023-12-19T06:36:40.551 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~143s 2023-12-19T06:36:47.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~150s 2023-12-19T06:36:53.581 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~156s 2023-12-19T06:36:55.435 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:36:55.438 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:36:55.440 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:37:00.094 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~163s 2023-12-19T06:37:06.608 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~169s 2023-12-19T06:37:13.124 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~176s 2023-12-19T06:37:19.682 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~182s 2023-12-19T06:37:25.660 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:37:25.664 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:37:25.667 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:37:26.195 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~189s 2023-12-19T06:37:32.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~195s 2023-12-19T06:37:39.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~202s 2023-12-19T06:37:45.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~208s 2023-12-19T06:37:52.251 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~215s 2023-12-19T06:37:55.854 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:37:55.858 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:37:55.860 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:37:55.907 INFO:tasks.ceph.osd.0.smithi120.stderr:2023-12-19T06:37:55.904+0000 7f4d2d9a2640 -1 Fail to open '/proc/103097/cmdline' error = (2) No such file or directory 2023-12-19T06:37:55.907 INFO:tasks.ceph.osd.2.smithi120.stderr:2023-12-19T06:37:55.904+0000 7fe01984b640 -1 Fail to open '/proc/103097/cmdline' error = (2) No such file or directory 2023-12-19T06:37:55.907 INFO:tasks.ceph.osd.2.smithi120.stderr:2023-12-19T06:37:55.904+0000 7fe01984b640 -1 received signal: Hangup from (PID: 103097) UID: 0 2023-12-19T06:37:55.908 INFO:tasks.ceph.osd.3.smithi120.stderr:2023-12-19T06:37:55.904+0000 7f0f9bda4640 -1 Fail to open '/proc/103097/cmdline' error = (2) No such file or directory 2023-12-19T06:37:55.908 INFO:tasks.ceph.osd.3.smithi120.stderr:2023-12-19T06:37:55.904+0000 7f0f9bda4640 -1 received signal: Hangup from (PID: 103097) UID: 0 2023-12-19T06:37:55.908 INFO:tasks.ceph.osd.0.smithi120.stderr:2023-12-19T06:37:55.904+0000 7f4d2d9a2640 -1 received signal: Hangup from (PID: 103097) UID: 0 2023-12-19T06:37:58.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~222s 2023-12-19T06:38:05.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~228s 2023-12-19T06:38:11.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~235s 2023-12-19T06:38:18.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~241s 2023-12-19T06:38:24.826 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~248s 2023-12-19T06:38:31.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~254s 2023-12-19T06:38:37.853 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~261s 2023-12-19T06:38:44.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~267s 2023-12-19T06:38:50.878 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~274s 2023-12-19T06:38:57.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~280s 2023-12-19T06:39:03.904 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~287s 2023-12-19T06:39:10.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~293s 2023-12-19T06:39:16.930 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~300s 2023-12-19T06:39:23.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~306s 2023-12-19T06:39:23.442 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-12-19T06:39:23.443 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T06:39:23.443 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T06:39:23.551 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2023-12-19T06:39:23.551 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T06:39:23.610 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T06:39:23.973 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.970+0000 7fb0435c4640 1 Processor -- start 2023-12-19T06:39:23.973 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.970+0000 7fb0435c4640 1 -- start start 2023-12-19T06:39:23.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.971+0000 7fb0435c4640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb03c0b79b0 0x7fb03c0b7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:23.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.971+0000 7fb0435c4640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb03c0b8860 0x7fb03c144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:23.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.971+0000 7fb0435c4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c145010 0x7fb03c14b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:23.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.971+0000 7fb0435c4640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03c14ae10 con 0x7fb03c0b8860 2023-12-19T06:39:23.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.971+0000 7fb0435c4640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03c0bacc0 con 0x7fb03c0b79b0 2023-12-19T06:39:23.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.971+0000 7fb0435c4640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c14ab20 con 0x7fb03c145010 2023-12-19T06:39:23.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.971+0000 7fb040b5f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb03c0b8860 0x7fb03c144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:23.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.971+0000 7fb040b5f640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb03c0b8860 0x7fb03c144ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54220/0 (socket says 172.21.15.120:54220) 2023-12-19T06:39:23.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.971+0000 7fb040b5f640 1 -- 172.21.15.120:0/238419465 learned_addr learned my addr 172.21.15.120:0/238419465 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T06:39:23.974 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.971+0000 7fb041360640 1 --2- 172.21.15.120:0/238419465 >> v2:172.21.15.155:3300/0 conn(0x7fb03c0b79b0 0x7fb03c0b7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:23.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.971+0000 7fb041b61640 1 --2- 172.21.15.120:0/238419465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c145010 0x7fb03c14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:23.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.972+0000 7fb041360640 1 -- 172.21.15.120:0/238419465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c145010 msgr2=0x7fb03c14b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T06:39:23.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.972+0000 7fb041360640 1 --2- 172.21.15.120:0/238419465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c145010 0x7fb03c14b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:23.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.972+0000 7fb041360640 1 -- 172.21.15.120:0/238419465 >> v2:172.21.15.120:3300/0 conn(0x7fb03c0b8860 msgr2=0x7fb03c144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T06:39:23.975 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.972+0000 7fb041360640 1 --2- 172.21.15.120:0/238419465 >> v2:172.21.15.120:3300/0 conn(0x7fb03c0b8860 0x7fb03c144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:23.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.972+0000 7fb041360640 1 -- 172.21.15.120:0/238419465 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c0b96b0 con 0x7fb03c0b79b0 2023-12-19T06:39:23.976 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.974+0000 7fb041360640 1 --2- 172.21.15.120:0/238419465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0b79b0 0x7fb03c0b7d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0bde90 tx=0x7fb03402be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c84cb0f324d067b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:23.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.974+0000 7fb033fff640 1 -- 172.21.15.120:0/238419465 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03402cbf0 con 0x7fb03c0b79b0 2023-12-19T06:39:23.977 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.974+0000 7fb033fff640 1 -- 172.21.15.120:0/238419465 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03402cd50 con 0x7fb03c0b79b0 2023-12-19T06:39:23.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.975+0000 7fb0435c4640 1 -- 172.21.15.120:0/238419465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0b79b0 msgr2=0x7fb03c0b7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:23.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.975+0000 7fb0435c4640 1 --2- 172.21.15.120:0/238419465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0b79b0 0x7fb03c0b7d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0bde90 tx=0x7fb03402be40 comp rx=0 tx=0).stop 2023-12-19T06:39:23.978 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.975+0000 7fb0435c4640 1 -- 172.21.15.120:0/238419465 shutdown_connections 2023-12-19T06:39:23.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.975+0000 7fb0435c4640 1 --2- 172.21.15.120:0/238419465 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c145010 0x7fb03c14b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:23.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.975+0000 7fb0435c4640 1 --2- 172.21.15.120:0/238419465 >> v2:172.21.15.120:3300/0 conn(0x7fb03c0b8860 0x7fb03c144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:23.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.975+0000 7fb0435c4640 1 --2- 172.21.15.120:0/238419465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0b79b0 0x7fb03c0b7d90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:23.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.975+0000 7fb0435c4640 1 -- 172.21.15.120:0/238419465 >> 172.21.15.120:0/238419465 conn(0x7fb03c0c0340 msgr2=0x7fb03c0c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T06:39:23.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.976+0000 7fb0435c4640 1 -- 172.21.15.120:0/238419465 shutdown_connections 2023-12-19T06:39:23.979 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.976+0000 7fb0435c4640 1 -- 172.21.15.120:0/238419465 wait complete. 2023-12-19T06:39:23.980 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.977+0000 7fb0435c4640 1 Processor -- start 2023-12-19T06:39:23.982 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.977+0000 7fb0435c4640 1 -- start start 2023-12-19T06:39:23.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.978+0000 7fb0435c4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0b79b0 0x7fb03c148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:23.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.978+0000 7fb0435c4640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb03c0b8860 0x7fb03c1464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:23.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.978+0000 7fb0435c4640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c145010 0x7fb03c1e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:23.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.979+0000 7fb041360640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0b79b0 0x7fb03c148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:23.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.979+0000 7fb041360640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0b79b0 0x7fb03c148390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:54808/0 (socket says 172.21.15.120:54808) 2023-12-19T06:39:23.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.979+0000 7fb041360640 1 -- 172.21.15.120:0/2389804053 learned_addr learned my addr 172.21.15.120:0/2389804053 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T06:39:23.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.979+0000 7fb040b5f640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb03c0b8860 0x7fb03c1464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:23.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.979+0000 7fb041b61640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c145010 0x7fb03c1e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:23.983 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.979+0000 7fb0435c4640 1 -- 172.21.15.120:0/2389804053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0a2c10 con 0x7fb03c0b8860 2023-12-19T06:39:23.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.979+0000 7fb0435c4640 1 -- 172.21.15.120:0/2389804053 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c1488d0 con 0x7fb03c0b79b0 2023-12-19T06:39:23.984 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.979+0000 7fb0435c4640 1 -- 172.21.15.120:0/2389804053 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0a1d20 con 0x7fb03c145010 2023-12-19T06:39:23.985 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.980+0000 7fb040b5f640 1 -- 172.21.15.120:0/2389804053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c145010 msgr2=0x7fb03c1e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:23.986 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.980+0000 7fb040b5f640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c145010 0x7fb03c1e7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:23.986 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.980+0000 7fb040b5f640 1 -- 172.21.15.120:0/2389804053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0b79b0 msgr2=0x7fb03c148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:23.986 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.980+0000 7fb040b5f640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0b79b0 0x7fb03c148390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:23.986 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.980+0000 7fb040b5f640 1 -- 172.21.15.120:0/2389804053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb034009a70 con 0x7fb03c0b8860 2023-12-19T06:39:23.986 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.980+0000 7fb040b5f640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb03c0b8860 0x7fb03c1464c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00e800 tx=0x7fb02c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:23.986 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.980+0000 7fb041b61640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c145010 0x7fb03c1e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T06:39:23.986 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.980+0000 7fb031ffb640 1 -- 172.21.15.120:0/2389804053 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00c8e0 con 0x7fb03c0b8860 2023-12-19T06:39:23.987 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.980+0000 7fb031ffb640 1 -- 172.21.15.120:0/2389804053 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c00ca40 con 0x7fb03c0b8860 2023-12-19T06:39:23.987 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.981+0000 7fb0435c4640 1 -- 172.21.15.120:0/2389804053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03c0a2000 con 0x7fb03c0b8860 2023-12-19T06:39:23.987 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.981+0000 7fb031ffb640 1 -- 172.21.15.120:0/2389804053 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c00cdb0 con 0x7fb03c0b8860 2023-12-19T06:39:23.988 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.982+0000 7fb0435c4640 1 -- 172.21.15.120:0/2389804053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c0b5c80 con 0x7fb03c0b8860 2023-12-19T06:39:23.989 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.983+0000 7fb0435c4640 1 -- 172.21.15.120:0/2389804053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c0a2190 con 0x7fb03c0b8860 2023-12-19T06:39:23.989 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.984+0000 7fb031ffb640 1 -- 172.21.15.120:0/2389804053 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb02c013470 con 0x7fb03c0b8860 2023-12-19T06:39:23.989 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.985+0000 7fb031ffb640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb02006a430 0x7fb02006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:23.989 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.985+0000 7fb031ffb640 1 -- 172.21.15.120:0/2389804053 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb02c088a20 con 0x7fb03c0b8860 2023-12-19T06:39:23.989 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.985+0000 7fb041360640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb02006a430 0x7fb02006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:23.990 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.986+0000 7fb041360640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb02006a430 0x7fb02006c8f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb03402be80 tx=0x7fb034030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:23.996 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:23.993+0000 7fb031ffb640 1 -- 172.21.15.120:0/2389804053 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb02c053f70 con 0x7fb03c0b8860 2023-12-19T06:39:24.302 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.299+0000 7fb0435c4640 1 -- 172.21.15.120:0/2389804053 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb03c04e080 con 0x7fb03c0b8860 2023-12-19T06:39:24.305 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-12-19T06:39:24.305 INFO:teuthology.orchestra.run.smithi120.stdout:{"epoch":33,"fsid":"90961127-a1a1-4949-bae3-e6c73f63cc7e","created":"2023-12-19T05:38:33.949246+0000","modified":"2023-12-19T06:34:03.495190+0000","last_up_change":"2023-12-19T06:34:02.482307+0000","last_in_change":"2023-12-19T05:38:36.185466+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T05:38:45.976868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T05:39:35.668117+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.2400000095367432,"score_stable":2.2400000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.9700000286102295,"raw_score_stable":1.9700000286102295,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T05:39:36.131433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"79d4cc7c-7096-44fc-a6c2-7fc9234f8f67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6816","nonce":89800},{"type":"v1","addr":"172.21.15.120:6818","nonce":89800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6819","nonce":89800},{"type":"v1","addr":"172.21.15.120:6821","nonce":89800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6826","nonce":89800},{"type":"v1","addr":"172.21.15.120:6828","nonce":89800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6823","nonce":89800},{"type":"v1","addr":"172.21.15.120:6824","nonce":89800}]},"public_addr":"172.21.15.120:6818/89800","cluster_addr":"172.21.15.120:6821/89800","heartbeat_back_addr":"172.21.15.120:6828/89800","heartbeat_front_addr":"172.21.15.120:6824/89800","state":["exists","up"]},{"osd":1,"uuid":"a67bad17-42c7-4fb9-aa1b-27baf6360317","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":32,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6808","nonce":89795},{"type":"v1","addr":"172.21.15.120:6809","nonce":89795}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6810","nonce":89795},{"type":"v1","addr":"172.21.15.120:6811","nonce":89795}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6814","nonce":89795},{"type":"v1","addr":"172.21.15.120:6815","nonce":89795}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6812","nonce":89795},{"type":"v1","addr":"172.21.15.120:6813","nonce":89795}]},"public_addr":"172.21.15.120:6809/89795","cluster_addr":"172.21.15.120:6811/89795","heartbeat_back_addr":"172.21.15.120:6815/89795","heartbeat_front_addr":"172.21.15.120:6813/89795","state":["exists"]},{"osd":2,"uuid":"8b220892-ce97-4c80-98fd-b72839b10837","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":89798},{"type":"v1","addr":"172.21.15.120:6801","nonce":89798}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":89798},{"type":"v1","addr":"172.21.15.120:6803","nonce":89798}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":89798},{"type":"v1","addr":"172.21.15.120:6807","nonce":89798}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":89798},{"type":"v1","addr":"172.21.15.120:6805","nonce":89798}]},"public_addr":"172.21.15.120:6801/89798","cluster_addr":"172.21.15.120:6803/89798","heartbeat_back_addr":"172.21.15.120:6807/89798","heartbeat_front_addr":"172.21.15.120:6805/89798","state":["exists","up"]},{"osd":3,"uuid":"34b9805c-832b-42bd-aef6-825d587ca48d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6817","nonce":89801},{"type":"v1","addr":"172.21.15.120:6820","nonce":89801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6822","nonce":89801},{"type":"v1","addr":"172.21.15.120:6825","nonce":89801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6830","nonce":89801},{"type":"v1","addr":"172.21.15.120:6831","nonce":89801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6827","nonce":89801},{"type":"v1","addr":"172.21.15.120:6829","nonce":89801}]},"public_addr":"172.21.15.120:6820/89801","cluster_addr":"172.21.15.120:6825/89801","heartbeat_back_addr":"172.21.15.120:6831/89801","heartbeat_front_addr":"172.21.15.120:6829/89801","state":["exists","up"]},{"osd":4,"uuid":"d60bb2a2-3f9d-48ab-82cd-d95cd1f3bf28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":89853},{"type":"v1","addr":"172.21.15.155:6801","nonce":89853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6803","nonce":89853},{"type":"v1","addr":"172.21.15.155:6806","nonce":89853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6815","nonce":89853},{"type":"v1","addr":"172.21.15.155:6818","nonce":89853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":89853},{"type":"v1","addr":"172.21.15.155:6811","nonce":89853}]},"public_addr":"172.21.15.155:6801/89853","cluster_addr":"172.21.15.155:6806/89853","heartbeat_back_addr":"172.21.15.155:6818/89853","heartbeat_front_addr":"172.21.15.155:6811/89853","state":["exists","up"]},{"osd":5,"uuid":"952d8346-f540-49c5-8d5b-beda607a751e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":89854},{"type":"v1","addr":"172.21.15.155:6814","nonce":89854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6817","nonce":89854},{"type":"v1","addr":"172.21.15.155:6819","nonce":89854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":89854},{"type":"v1","addr":"172.21.15.155:6824","nonce":89854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":89854},{"type":"v1","addr":"172.21.15.155:6821","nonce":89854}]},"public_addr":"172.21.15.155:6814/89854","cluster_addr":"172.21.15.155:6819/89854","heartbeat_back_addr":"172.21.15.155:6824/89854","heartbeat_front_addr":"172.21.15.155:6821/89854","state":["exists","up"]},{"osd":6,"uuid":"49077f3f-f51f-43c1-96da-0bf0bbb9ed74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":89855},{"type":"v1","addr":"172.21.15.155:6804","nonce":89855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6805","nonce":89855},{"type":"v1","addr":"172.21.15.155:6807","nonce":89855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6813","nonce":89855},{"type":"v1","addr":"172.21.15.155:6816","nonce":89855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6809","nonce":89855},{"type":"v1","addr":"172.21.15.155:6810","nonce":89855}]},"public_addr":"172.21.15.155:6804/89855","cluster_addr":"172.21.15.155:6807/89855","heartbeat_back_addr":"172.21.15.155:6816/89855","heartbeat_front_addr":"172.21.15.155:6810/89855","state":["exists","up"]},{"osd":7,"uuid":"fc60ebed-2b82-47ea-b968-28b662f8bbf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6823","nonce":89856},{"type":"v1","addr":"172.21.15.155:6825","nonce":89856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":89856},{"type":"v1","addr":"172.21.15.155:6827","nonce":89856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":89856},{"type":"v1","addr":"172.21.15.155:6831","nonce":89856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":89856},{"type":"v1","addr":"172.21.15.155:6829","nonce":89856}]},"public_addr":"172.21.15.155:6825/89856","cluster_addr":"172.21.15.155:6827/89856","heartbeat_back_addr":"172.21.15.155:6831/89856","heartbeat_front_addr":"172.21.15.155:6829/89856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.315141+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.390689+0000","dead_epoch":32},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.265249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.324338+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.400453+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.381442+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.380128+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T05:38:41.278354+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T06:39:24.306 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.300+0000 7fb031ffb640 1 -- 172.21.15.120:0/2389804053 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16236 (secure 0 0 0) 0x7fb02c017090 con 0x7fb03c0b8860 2023-12-19T06:39:24.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.304+0000 7fb0435c4640 1 -- 172.21.15.120:0/2389804053 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb02006a430 msgr2=0x7fb02006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:24.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.304+0000 7fb0435c4640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb02006a430 0x7fb02006c8f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb03402be80 tx=0x7fb034030000 comp rx=0 tx=0).stop 2023-12-19T06:39:24.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.304+0000 7fb0435c4640 1 -- 172.21.15.120:0/2389804053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb03c0b8860 msgr2=0x7fb03c1464c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:24.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.304+0000 7fb0435c4640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb03c0b8860 0x7fb03c1464c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00e800 tx=0x7fb02c00ecc0 comp rx=0 tx=0).stop 2023-12-19T06:39:24.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.304+0000 7fb0435c4640 1 -- 172.21.15.120:0/2389804053 shutdown_connections 2023-12-19T06:39:24.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.304+0000 7fb0435c4640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb02006a430 0x7fb02006c8f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:24.308 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.304+0000 7fb0435c4640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb03c145010 0x7fb03c1e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:24.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.304+0000 7fb0435c4640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb03c0b8860 0x7fb03c1464c0 secure :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00e800 tx=0x7fb02c00ecc0 comp rx=0 tx=0).stop 2023-12-19T06:39:24.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.304+0000 7fb0435c4640 1 --2- 172.21.15.120:0/2389804053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb03c0b79b0 0x7fb03c148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:24.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.304+0000 7fb0435c4640 1 -- 172.21.15.120:0/2389804053 >> 172.21.15.120:0/2389804053 conn(0x7fb03c0c0340 msgr2=0x7fb03c14b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T06:39:24.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.304+0000 7fb0435c4640 1 -- 172.21.15.120:0/2389804053 shutdown_connections 2023-12-19T06:39:24.309 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.305+0000 7fb0435c4640 1 -- 172.21.15.120:0/2389804053 wait complete. 2023-12-19T06:39:24.339 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T05:38:45.976868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T05:39:35.668117+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.240000009536743, 'score_stable': 2.240000009536743, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.9700000286102295, 'raw_score_stable': 1.9700000286102295, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T05:39:36.131433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T06:39:24.340 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T06:39:24.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.507+0000 7fb72759e640 1 Processor -- start 2023-12-19T06:39:24.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.507+0000 7fb72759e640 1 -- start start 2023-12-19T06:39:24.511 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.508+0000 7fb72759e640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fb720007430 0x7fb720040100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:24.511 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.508+0000 7fb72759e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb720007b50 0x7fb7200d5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:24.511 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.508+0000 7fb72759e640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb720008e60 con 0x7fb7200d5bc0 2023-12-19T06:39:24.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.508+0000 7fb72759e640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb720008530 con 0x7fb720007430 2023-12-19T06:39:24.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.508+0000 7fb72759e640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7200d6010 con 0x7fb720007b50 2023-12-19T06:39:24.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.508+0000 7fb725d9b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb720007b50 0x7fb7200d5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:24.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.508+0000 7fb725d9b640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fb720007b50 0x7fb7200d5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.120:54816/0 (socket says 172.21.15.120:54816) 2023-12-19T06:39:24.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.508+0000 7fb725d9b640 1 -- 172.21.15.120:0/1846794048 learned_addr learned my addr 172.21.15.120:0/1846794048 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T06:39:24.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.509+0000 7fb72659c640 1 --2- 172.21.15.120:0/1846794048 >> v2:172.21.15.120:3300/0 conn(0x7fb720007430 0x7fb720040100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:24.513 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.509+0000 7fb725d9b640 1 -- 172.21.15.120:0/1846794048 >> v2:172.21.15.120:3300/0 conn(0x7fb720007430 msgr2=0x7fb720040100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T06:39:24.513 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.509+0000 7fb725d9b640 1 --2- 172.21.15.120:0/1846794048 >> v2:172.21.15.120:3300/0 conn(0x7fb720007430 0x7fb720040100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:24.513 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.509+0000 7fb725d9b640 1 -- 172.21.15.120:0/1846794048 >> v1:172.21.15.155:6789/0 conn(0x7fb7200d5bc0 legacy=0x7fb7200d2510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T06:39:24.513 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.509+0000 7fb725d9b640 1 -- 172.21.15.120:0/1846794048 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720040720 con 0x7fb720007b50 2023-12-19T06:39:24.513 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.510+0000 7fb725d9b640 1 --2- 172.21.15.120:0/1846794048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb720007b50 0x7fb7200d5680 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb720009d30 tx=0x7fb71802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=602e36b1f35a4eb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:24.513 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.511+0000 7fb72559a640 1 -- 172.21.15.120:0/1846794048 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718030860 con 0x7fb720007b50 2023-12-19T06:39:24.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.511+0000 7fb72559a640 1 -- 172.21.15.120:0/1846794048 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7180309c0 con 0x7fb720007b50 2023-12-19T06:39:24.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.511+0000 7fb72559a640 1 -- 172.21.15.120:0/1846794048 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718030d50 con 0x7fb720007b50 2023-12-19T06:39:24.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.512+0000 7fb72759e640 1 -- 172.21.15.120:0/1846794048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb720007b50 msgr2=0x7fb7200d5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:24.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.512+0000 7fb72759e640 1 --2- 172.21.15.120:0/1846794048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb720007b50 0x7fb7200d5680 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb720009d30 tx=0x7fb71802b9a0 comp rx=0 tx=0).stop 2023-12-19T06:39:24.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.512+0000 7fb72759e640 1 -- 172.21.15.120:0/1846794048 shutdown_connections 2023-12-19T06:39:24.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.512+0000 7fb72759e640 1 --2- 172.21.15.120:0/1846794048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb720007b50 0x7fb7200d5680 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb720009d30 tx=0x7fb71802b9a0 comp rx=0 tx=0).stop 2023-12-19T06:39:24.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.512+0000 7fb72759e640 1 --2- 172.21.15.120:0/1846794048 >> v2:172.21.15.120:3300/0 conn(0x7fb720007430 0x7fb720040100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:24.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.512+0000 7fb72759e640 1 -- 172.21.15.120:0/1846794048 >> 172.21.15.120:0/1846794048 conn(0x7fb720041060 msgr2=0x7fb720041440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T06:39:24.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.513+0000 7fb72759e640 1 -- 172.21.15.120:0/1846794048 shutdown_connections 2023-12-19T06:39:24.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.513+0000 7fb72759e640 1 -- 172.21.15.120:0/1846794048 wait complete. 2023-12-19T06:39:24.517 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.515+0000 7fb72759e640 1 Processor -- start 2023-12-19T06:39:24.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.515+0000 7fb72759e640 1 -- start start 2023-12-19T06:39:24.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.516+0000 7fb72759e640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb720007430 0x7fb72003d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:24.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.516+0000 7fb72759e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7200d5bc0 0x7fb720039bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.516+0000 7fb72659c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb720007430 0x7fb72003d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.516+0000 7fb72659c640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb720007430 0x7fb72003d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:37296/0 (socket says 172.21.15.120:37296) 2023-12-19T06:39:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.516+0000 7fb72659c640 1 -- 172.21.15.120:0/2337396693 learned_addr learned my addr 172.21.15.120:0/2337396693 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T06:39:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.516+0000 7fb725d9b640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7200d5bc0 0x7fb720039bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.517+0000 7fb72759e640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72003a0f0 0x7fb7200363f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.517+0000 7fb72759e640 1 -- 172.21.15.120:0/2337396693 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72003da80 con 0x7fb72003a0f0 2023-12-19T06:39:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.517+0000 7fb72759e640 1 -- 172.21.15.120:0/2337396693 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72003a570 con 0x7fb7200d5bc0 2023-12-19T06:39:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.517+0000 7fb726d9d640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72003a0f0 0x7fb7200363f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:24.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.517+0000 7fb72759e640 1 -- 172.21.15.120:0/2337396693 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7200ce930 con 0x7fb720007430 2023-12-19T06:39:24.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.518+0000 7fb725d9b640 1 -- 172.21.15.120:0/2337396693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb720007430 msgr2=0x7fb72003d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:24.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.518+0000 7fb725d9b640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb720007430 0x7fb72003d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:24.521 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.518+0000 7fb725d9b640 1 -- 172.21.15.120:0/2337396693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72003a0f0 msgr2=0x7fb7200363f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:24.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.518+0000 7fb725d9b640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72003a0f0 0x7fb7200363f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:24.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.518+0000 7fb725d9b640 1 -- 172.21.15.120:0/2337396693 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7180094d0 con 0x7fb7200d5bc0 2023-12-19T06:39:24.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.518+0000 7fb725d9b640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7200d5bc0 0x7fb720039bb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb718033000 tx=0x7fb718004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:24.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.518+0000 7fb716ffd640 1 -- 172.21.15.120:0/2337396693 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718039c90 con 0x7fb7200d5bc0 2023-12-19T06:39:24.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.518+0000 7fb716ffd640 1 -- 172.21.15.120:0/2337396693 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb718039df0 con 0x7fb7200d5bc0 2023-12-19T06:39:24.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.519+0000 7fb716ffd640 1 -- 172.21.15.120:0/2337396693 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718004220 con 0x7fb7200d5bc0 2023-12-19T06:39:24.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.519+0000 7fb72759e640 1 -- 172.21.15.120:0/2337396693 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7200cec10 con 0x7fb7200d5bc0 2023-12-19T06:39:24.523 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.520+0000 7fb72759e640 1 -- 172.21.15.120:0/2337396693 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb720039200 con 0x7fb7200d5bc0 2023-12-19T06:39:24.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.523+0000 7fb716ffd640 1 -- 172.21.15.120:0/2337396693 <== mon.1 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb718004380 con 0x7fb7200d5bc0 2023-12-19T06:39:24.525 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.523+0000 7fb72759e640 1 -- 172.21.15.120:0/2337396693 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb720005330 con 0x7fb7200d5bc0 2023-12-19T06:39:24.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.523+0000 7fb716ffd640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb70806a500 0x7fb70806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:24.526 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.524+0000 7fb72659c640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb70806a500 0x7fb70806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:24.527 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.525+0000 7fb72659c640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb70806a500 0x7fb70806c9c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009c50 tx=0x7fb71c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:24.527 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.525+0000 7fb716ffd640 1 -- 172.21.15.120:0/2337396693 <== mon.1 v2:172.21.15.155:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb71803e070 con 0x7fb7200d5bc0 2023-12-19T06:39:24.533 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.531+0000 7fb716ffd640 1 -- 172.21.15.120:0/2337396693 <== mon.1 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fb718076300 con 0x7fb7200d5bc0 2023-12-19T06:39:24.832 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.830+0000 7fb72759e640 1 -- 172.21.15.120:0/2337396693 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7200d0a30 con 0x7fb7200d5bc0 2023-12-19T06:39:24.833 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.830+0000 7fb716ffd640 1 -- 172.21.15.120:0/2337396693 <== mon.1 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7180340a0 con 0x7fb7200d5bc0 2023-12-19T06:39:24.833 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 1 2023-12-19T06:39:24.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.833+0000 7fb72759e640 1 -- 172.21.15.120:0/2337396693 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb70806a500 msgr2=0x7fb70806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:24.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.833+0000 7fb72759e640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb70806a500 0x7fb70806c9c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb71c009c50 tx=0x7fb71c009190 comp rx=0 tx=0).stop 2023-12-19T06:39:24.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.833+0000 7fb72759e640 1 -- 172.21.15.120:0/2337396693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7200d5bc0 msgr2=0x7fb720039bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:24.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.833+0000 7fb72759e640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7200d5bc0 0x7fb720039bb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb718033000 tx=0x7fb718004730 comp rx=0 tx=0).stop 2023-12-19T06:39:24.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.833+0000 7fb72759e640 1 -- 172.21.15.120:0/2337396693 shutdown_connections 2023-12-19T06:39:24.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.833+0000 7fb72759e640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fb70806a500 0x7fb70806c9c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:24.836 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.833+0000 7fb72759e640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fb72003a0f0 0x7fb7200363f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.833+0000 7fb72759e640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7200d5bc0 0x7fb720039bb0 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb718033000 tx=0x7fb718004730 comp rx=0 tx=0).stop 2023-12-19T06:39:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.833+0000 7fb72759e640 1 --2- 172.21.15.120:0/2337396693 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fb720007430 0x7fb72003d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.833+0000 7fb72759e640 1 -- 172.21.15.120:0/2337396693 >> 172.21.15.120:0/2337396693 conn(0x7fb720041060 msgr2=0x7fb7200cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T06:39:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.833+0000 7fb72759e640 1 -- 172.21.15.120:0/2337396693 shutdown_connections 2023-12-19T06:39:24.837 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:24.833+0000 7fb72759e640 1 -- 172.21.15.120:0/2337396693 wait complete. 2023-12-19T06:39:24.853 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T06:39:25.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.016+0000 7fdc51d18640 1 Processor -- start 2023-12-19T06:39:25.019 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.016+0000 7fdc51d18640 1 -- start start 2023-12-19T06:39:25.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.017+0000 7fdc51d18640 1 --2- >> v2:172.21.15.120:3300/0 conn(0x7fdc4c06cae0 0x7fdc4c06bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:25.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.017+0000 7fdc51d18640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4c0b8f00 con 0x7fdc4c0baca0 2023-12-19T06:39:25.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.017+0000 7fdc51d18640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4c06c480 con 0x7fdc4c06bff0 2023-12-19T06:39:25.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.017+0000 7fdc51d18640 1 -- --> v2:172.21.15.120:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c0b95b0 con 0x7fdc4c06cae0 2023-12-19T06:39:25.020 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.017+0000 7fdc4b7fe640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fdc4c0baca0 0x7fdc4c148d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52536/0 (socket says 172.21.15.120:52536) 2023-12-19T06:39:25.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.017+0000 7fdc4b7fe640 1 -- 172.21.15.120:0/2265450803 learned_addr learned my addr 172.21.15.120:0/2265450803 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T06:39:25.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.017+0000 7fdc4affd640 1 --2- 172.21.15.120:0/2265450803 >> v2:172.21.15.120:3300/0 conn(0x7fdc4c06cae0 0x7fdc4c06bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:25.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.018+0000 7fdc4a7fc640 1 -- 172.21.15.120:0/2265450803 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144808455 0 0) 0x7fdc4c0b8f00 con 0x7fdc4c0baca0 2023-12-19T06:39:25.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.018+0000 7fdc4a7fc640 1 -- 172.21.15.120:0/2265450803 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc34003520 con 0x7fdc4c0baca0 2023-12-19T06:39:25.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.018+0000 7fdc4affd640 1 -- 172.21.15.120:0/2265450803 >> v1:172.21.15.155:6789/0 conn(0x7fdc4c06bff0 legacy=0x7fdc4c159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T06:39:25.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.018+0000 7fdc4affd640 1 -- 172.21.15.120:0/2265450803 >> v1:172.21.15.120:6789/0 conn(0x7fdc4c0baca0 legacy=0x7fdc4c148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:25.021 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.018+0000 7fdc4affd640 1 -- 172.21.15.120:0/2265450803 --> v2:172.21.15.120:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c0b9890 con 0x7fdc4c06cae0 2023-12-19T06:39:25.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.019+0000 7fdc4affd640 1 --2- 172.21.15.120:0/2265450803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc4c06cae0 0x7fdc4c06bab0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0097a0 tx=0x7fdc3c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c5590bc7a04d3c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:25.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.019+0000 7fdc4a7fc640 1 -- 172.21.15.120:0/2265450803 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c031830 con 0x7fdc4c06cae0 2023-12-19T06:39:25.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.019+0000 7fdc4a7fc640 1 -- 172.21.15.120:0/2265450803 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c031990 con 0x7fdc4c06cae0 2023-12-19T06:39:25.022 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.019+0000 7fdc4a7fc640 1 -- 172.21.15.120:0/2265450803 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c031d20 con 0x7fdc4c06cae0 2023-12-19T06:39:25.023 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.020+0000 7fdc51d18640 1 -- 172.21.15.120:0/2265450803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc4c06cae0 msgr2=0x7fdc4c06bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:25.023 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.020+0000 7fdc51d18640 1 --2- 172.21.15.120:0/2265450803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc4c06cae0 0x7fdc4c06bab0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0097a0 tx=0x7fdc3c02b8d0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.024 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.020+0000 7fdc51d18640 1 -- 172.21.15.120:0/2265450803 shutdown_connections 2023-12-19T06:39:25.024 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.020+0000 7fdc51d18640 1 --2- 172.21.15.120:0/2265450803 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc4c06cae0 0x7fdc4c06bab0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.024 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.020+0000 7fdc51d18640 1 -- 172.21.15.120:0/2265450803 >> 172.21.15.120:0/2265450803 conn(0x7fdc4c069d00 msgr2=0x7fdc4c06a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T06:39:25.024 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.021+0000 7fdc51d18640 1 -- 172.21.15.120:0/2265450803 shutdown_connections 2023-12-19T06:39:25.024 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.021+0000 7fdc51d18640 1 -- 172.21.15.120:0/2265450803 wait complete. 2023-12-19T06:39:25.025 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.022+0000 7fdc51d18640 1 Processor -- start 2023-12-19T06:39:25.025 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.022+0000 7fdc51d18640 1 -- start start 2023-12-19T06:39:25.026 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.023+0000 7fdc51d18640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc4c06bff0 0x7fdc4c0bced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:25.026 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.023+0000 7fdc51d18640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc4c0baca0 0x7fdc4c1df830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:25.026 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.023+0000 7fdc4b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc4c06bff0 0x7fdc4c0bced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc51d18640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc4c1ddd70 0x7fdc4c1dc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc51d18640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c1dfd70 con 0x7fdc4c0baca0 2023-12-19T06:39:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc4b7fe640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc4c06bff0 0x7fdc4c0bced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3301/0 says I am v2:172.21.15.120:37312/0 (socket says 172.21.15.120:37312) 2023-12-19T06:39:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc51d18640 1 -- 172.21.15.120:0/942317045 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c1dd950 con 0x7fdc4c1ddd70 2023-12-19T06:39:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc4b7fe640 1 -- 172.21.15.120:0/942317045 learned_addr learned my addr 172.21.15.120:0/942317045 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T06:39:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc51d18640 1 -- 172.21.15.120:0/942317045 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0bc1a0 con 0x7fdc4c06bff0 2023-12-19T06:39:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc4affd640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc4c0baca0 0x7fdc4c1df830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:25.027 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc4bfff640 1 --2- 172.21.15.120:0/942317045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc4c1ddd70 0x7fdc4c1dc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:25.028 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc4b7fe640 1 -- 172.21.15.120:0/942317045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc4c1ddd70 msgr2=0x7fdc4c1dc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:25.028 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc4b7fe640 1 --2- 172.21.15.120:0/942317045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc4c1ddd70 0x7fdc4c1dc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.028 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc4b7fe640 1 -- 172.21.15.120:0/942317045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc4c0baca0 msgr2=0x7fdc4c1df830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:25.028 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc4b7fe640 1 --2- 172.21.15.120:0/942317045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc4c0baca0 0x7fdc4c1df830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.028 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc4b7fe640 1 -- 172.21.15.120:0/942317045 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c009400 con 0x7fdc4c06bff0 2023-12-19T06:39:25.028 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc4b7fe640 1 --2- 172.21.15.120:0/942317045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc4c06bff0 0x7fdc4c0bced0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c500 tx=0x7fdc4000c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:25.028 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.024+0000 7fdc33fff640 1 -- 172.21.15.120:0/942317045 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40005ce0 con 0x7fdc4c06bff0 2023-12-19T06:39:25.028 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.025+0000 7fdc33fff640 1 -- 172.21.15.120:0/942317045 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc40005e40 con 0x7fdc4c06bff0 2023-12-19T06:39:25.028 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.025+0000 7fdc33fff640 1 -- 172.21.15.120:0/942317045 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc40007330 con 0x7fdc4c06bff0 2023-12-19T06:39:25.029 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.025+0000 7fdc51d18640 1 -- 172.21.15.120:0/942317045 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4c0bc480 con 0x7fdc4c06bff0 2023-12-19T06:39:25.029 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.025+0000 7fdc51d18640 1 -- 172.21.15.120:0/942317045 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4c147030 con 0x7fdc4c06bff0 2023-12-19T06:39:25.029 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.027+0000 7fdc51d18640 1 -- 172.21.15.120:0/942317045 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc4c0bbfe0 con 0x7fdc4c06bff0 2023-12-19T06:39:25.030 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.027+0000 7fdc33fff640 1 -- 172.21.15.120:0/942317045 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdc40007550 con 0x7fdc4c06bff0 2023-12-19T06:39:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.028+0000 7fdc33fff640 1 --2- 172.21.15.120:0/942317045 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdc3806a430 0x7fdc3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.028+0000 7fdc33fff640 1 -- 172.21.15.120:0/942317045 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc40087dd0 con 0x7fdc4c06bff0 2023-12-19T06:39:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.028+0000 7fdc4affd640 1 --2- 172.21.15.120:0/942317045 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdc3806a430 0x7fdc3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:25.031 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.028+0000 7fdc4affd640 1 --2- 172.21.15.120:0/942317045 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdc3806a430 0x7fdc3806c8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c036000 tx=0x7fdc3c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:25.036 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.033+0000 7fdc33fff640 1 -- 172.21.15.120:0/942317045 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fdc4008b030 con 0x7fdc4c06bff0 2023-12-19T06:39:25.329 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.327+0000 7fdc51d18640 1 -- 172.21.15.120:0/942317045 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc4c147030 con 0x7fdc4c06bff0 2023-12-19T06:39:25.330 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.327+0000 7fdc33fff640 1 -- 172.21.15.120:0/942317045 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdc40017020 con 0x7fdc4c06bff0 2023-12-19T06:39:25.330 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 32 2023-12-19T06:39:25.333 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.330+0000 7fdc51d18640 1 -- 172.21.15.120:0/942317045 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdc3806a430 msgr2=0x7fdc3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:25.333 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.330+0000 7fdc51d18640 1 --2- 172.21.15.120:0/942317045 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdc3806a430 0x7fdc3806c8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c036000 tx=0x7fdc3c03c040 comp rx=0 tx=0).stop 2023-12-19T06:39:25.333 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.330+0000 7fdc51d18640 1 -- 172.21.15.120:0/942317045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc4c06bff0 msgr2=0x7fdc4c0bced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:25.334 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.330+0000 7fdc51d18640 1 --2- 172.21.15.120:0/942317045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc4c06bff0 0x7fdc4c0bced0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000c500 tx=0x7fdc4000c9c0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.334 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.330+0000 7fdc51d18640 1 -- 172.21.15.120:0/942317045 shutdown_connections 2023-12-19T06:39:25.334 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.331+0000 7fdc51d18640 1 --2- 172.21.15.120:0/942317045 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fdc3806a430 0x7fdc3806c8f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.334 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.331+0000 7fdc51d18640 1 --2- 172.21.15.120:0/942317045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdc4c1ddd70 0x7fdc4c1dc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.334 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.331+0000 7fdc51d18640 1 --2- 172.21.15.120:0/942317045 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fdc4c0baca0 0x7fdc4c1df830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.334 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.331+0000 7fdc51d18640 1 --2- 172.21.15.120:0/942317045 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fdc4c06bff0 0x7fdc4c0bced0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.334 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.331+0000 7fdc51d18640 1 -- 172.21.15.120:0/942317045 >> 172.21.15.120:0/942317045 conn(0x7fdc4c069d00 msgr2=0x7fdc4c148b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T06:39:25.334 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.332+0000 7fdc51d18640 1 -- 172.21.15.120:0/942317045 shutdown_connections 2023-12-19T06:39:25.334 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.332+0000 7fdc51d18640 1 -- 172.21.15.120:0/942317045 wait complete. 2023-12-19T06:39:25.352 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T06:39:25.507 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.504+0000 7fd113d81640 1 Processor -- start 2023-12-19T06:39:25.508 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.505+0000 7fd113d81640 1 -- start start 2023-12-19T06:39:25.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.506+0000 7fd113d81640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd10c14f310 0x7fd10c14f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:25.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.506+0000 7fd113d81640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd10c0b99d0 0x7fd10c0b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:25.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.506+0000 7fd113d81640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd10c14ee80 con 0x7fd10c1490d0 2023-12-19T06:39:25.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.506+0000 7fd113d81640 1 -- --> v2:172.21.15.155:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10c06b690 con 0x7fd10c0b99d0 2023-12-19T06:39:25.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.506+0000 7fd113d81640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c14fcb0 con 0x7fd10c14f310 2023-12-19T06:39:25.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.506+0000 7fd111b1d640 1 --1- >> v1:172.21.15.155:6789/0 conn(0x7fd10c1490d0 0x7fd10c152400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.155:6789/0 says I am v1:172.21.15.120:44918/0 (socket says 172.21.15.120:44918) 2023-12-19T06:39:25.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.506+0000 7fd11231e640 1 --2- >> v2:172.21.15.155:3300/0 conn(0x7fd10c0b99d0 0x7fd10c0b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:25.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.506+0000 7fd111b1d640 1 -- 172.21.15.120:0/815881216 learned_addr learned my addr 172.21.15.120:0/815881216 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T06:39:25.509 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.506+0000 7fd11131c640 1 --2- 172.21.15.120:0/815881216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd10c14f310 0x7fd10c14f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:25.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.506+0000 7fd110b1b640 1 -- 172.21.15.120:0/815881216 <== mon.1 v1:172.21.15.155:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061307612 0 0) 0x7fd10c14ee80 con 0x7fd10c1490d0 2023-12-19T06:39:25.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.506+0000 7fd11231e640 1 -- 172.21.15.120:0/815881216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd10c14f310 msgr2=0x7fd10c14f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T06:39:25.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.506+0000 7fd11231e640 1 --2- 172.21.15.120:0/815881216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd10c14f310 0x7fd10c14f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.506+0000 7fd11231e640 1 -- 172.21.15.120:0/815881216 >> v1:172.21.15.155:6789/0 conn(0x7fd10c1490d0 legacy=0x7fd10c152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:25.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.506+0000 7fd11231e640 1 -- 172.21.15.120:0/815881216 --> v2:172.21.15.155:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c0ba3a0 con 0x7fd10c0b99d0 2023-12-19T06:39:25.510 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.507+0000 7fd11231e640 1 --2- 172.21.15.120:0/815881216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c0b99d0 0x7fd10c0b9e60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd104009d90 tx=0x7fd10402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1345cbd049a4897 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:25.511 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.508+0000 7fd110b1b640 1 -- 172.21.15.120:0/815881216 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10402cc80 con 0x7fd10c0b99d0 2023-12-19T06:39:25.511 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.508+0000 7fd110b1b640 1 -- 172.21.15.120:0/815881216 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10402cde0 con 0x7fd10c0b99d0 2023-12-19T06:39:25.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.508+0000 7fd110b1b640 1 -- 172.21.15.120:0/815881216 <== mon.1 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104034660 con 0x7fd10c0b99d0 2023-12-19T06:39:25.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.509+0000 7fd113d81640 1 -- 172.21.15.120:0/815881216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c0b99d0 msgr2=0x7fd10c0b9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:25.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.509+0000 7fd113d81640 1 --2- 172.21.15.120:0/815881216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c0b99d0 0x7fd10c0b9e60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd104009d90 tx=0x7fd10402bed0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.509+0000 7fd113d81640 1 -- 172.21.15.120:0/815881216 shutdown_connections 2023-12-19T06:39:25.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.509+0000 7fd113d81640 1 --2- 172.21.15.120:0/815881216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c0b99d0 0x7fd10c0b9e60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.509+0000 7fd113d81640 1 --2- 172.21.15.120:0/815881216 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd10c14f310 0x7fd10c14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.509+0000 7fd113d81640 1 -- 172.21.15.120:0/815881216 >> 172.21.15.120:0/815881216 conn(0x7fd10c0be180 msgr2=0x7fd10c0be590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T06:39:25.512 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.509+0000 7fd113d81640 1 -- 172.21.15.120:0/815881216 shutdown_connections 2023-12-19T06:39:25.513 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.510+0000 7fd113d81640 1 -- 172.21.15.120:0/815881216 wait complete. 2023-12-19T06:39:25.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.511+0000 7fd113d81640 1 Processor -- start 2023-12-19T06:39:25.514 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.511+0000 7fd113d81640 1 -- start start 2023-12-19T06:39:25.515 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.512+0000 7fd113d81640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd10c0b99d0 0x7fd10c0b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:25.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.512+0000 7fd111b1d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd10c0b99d0 0x7fd10c0b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:25.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.512+0000 7fd111b1d640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd10c0b99d0 0x7fd10c0b5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54272/0 (socket says 172.21.15.120:54272) 2023-12-19T06:39:25.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.512+0000 7fd111b1d640 1 -- 172.21.15.120:0/3387322291 learned_addr learned my addr 172.21.15.120:0/3387322291 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T06:39:25.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.513+0000 7fd113d81640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c1490d0 0x7fd10c148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:25.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.513+0000 7fd113d81640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd10c14f310 0x7fd10c0b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:25.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.513+0000 7fd113d81640 1 -- 172.21.15.120:0/3387322291 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0b64d0 con 0x7fd10c0b99d0 2023-12-19T06:39:25.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.513+0000 7fd11131c640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c1490d0 0x7fd10c148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:25.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.513+0000 7fd11231e640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd10c14f310 0x7fd10c0b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:25.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.513+0000 7fd113d81640 1 -- 172.21.15.120:0/3387322291 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c148670 con 0x7fd10c1490d0 2023-12-19T06:39:25.516 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.513+0000 7fd113d81640 1 -- 172.21.15.120:0/3387322291 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0b7a90 con 0x7fd10c14f310 2023-12-19T06:39:25.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.514+0000 7fd111b1d640 1 -- 172.21.15.120:0/3387322291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd10c14f310 msgr2=0x7fd10c0b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:25.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.514+0000 7fd111b1d640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd10c14f310 0x7fd10c0b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.514+0000 7fd111b1d640 1 -- 172.21.15.120:0/3387322291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c1490d0 msgr2=0x7fd10c148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:25.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.514+0000 7fd111b1d640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c1490d0 0x7fd10c148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.514+0000 7fd111b1d640 1 -- 172.21.15.120:0/3387322291 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd104009a70 con 0x7fd10c0b99d0 2023-12-19T06:39:25.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.514+0000 7fd111b1d640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd10c0b99d0 0x7fd10c0b5c80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00c730 tx=0x7fd0fc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:25.518 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.514+0000 7fd1027fc640 1 -- 172.21.15.120:0/3387322291 <== mon.0 v2:172.21.15.120:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc0072d0 con 0x7fd10c0b99d0 2023-12-19T06:39:25.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.514+0000 7fd113d81640 1 -- 172.21.15.120:0/3387322291 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10c14ede0 con 0x7fd10c0b99d0 2023-12-19T06:39:25.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.515+0000 7fd113d81640 1 -- 172.21.15.120:0/3387322291 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c14e2e0 con 0x7fd10c0b99d0 2023-12-19T06:39:25.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.515+0000 7fd1027fc640 1 -- 172.21.15.120:0/3387322291 <== mon.0 v2:172.21.15.120:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0fc007430 con 0x7fd10c0b99d0 2023-12-19T06:39:25.519 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.515+0000 7fd1027fc640 1 -- 172.21.15.120:0/3387322291 <== mon.0 v2:172.21.15.120:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc00ce40 con 0x7fd10c0b99d0 2023-12-19T06:39:25.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.517+0000 7fd1027fc640 1 -- 172.21.15.120:0/3387322291 <== mon.0 v2:172.21.15.120:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd0fc0047e0 con 0x7fd10c0b99d0 2023-12-19T06:39:25.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.517+0000 7fd113d81640 1 -- 172.21.15.120:0/3387322291 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f4005250 con 0x7fd10c0b99d0 2023-12-19T06:39:25.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.517+0000 7fd1027fc640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd0f006a430 0x7fd0f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:25.520 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.518+0000 7fd1027fc640 1 -- 172.21.15.120:0/3387322291 <== mon.0 v2:172.21.15.120:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd0fc087e20 con 0x7fd10c0b99d0 2023-12-19T06:39:25.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.519+0000 7fd11131c640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd0f006a430 0x7fd0f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:25.522 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.520+0000 7fd11131c640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd0f006a430 0x7fd0f006c8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd10c1e1a30 tx=0x7fd108009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:25.528 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.525+0000 7fd1027fc640 1 -- 172.21.15.120:0/3387322291 <== mon.0 v2:172.21.15.120:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7fd0fc0534b0 con 0x7fd10c0b99d0 2023-12-19T06:39:25.863 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.860+0000 7fd113d81640 1 -- 172.21.15.120:0/3387322291 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0f4005a80 con 0x7fd10c0b99d0 2023-12-19T06:39:25.863 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.861+0000 7fd1027fc640 1 -- 172.21.15.120:0/3387322291 <== mon.0 v2:172.21.15.120:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0fc0180a0 con 0x7fd10c0b99d0 2023-12-19T06:39:25.867 INFO:teuthology.orchestra.run.smithi120.stdout:pg_num: 64 2023-12-19T06:39:25.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.864+0000 7fd113d81640 1 -- 172.21.15.120:0/3387322291 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd0f006a430 msgr2=0x7fd0f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:25.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.864+0000 7fd113d81640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd0f006a430 0x7fd0f006c8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd10c1e1a30 tx=0x7fd108009190 comp rx=0 tx=0).stop 2023-12-19T06:39:25.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.864+0000 7fd113d81640 1 -- 172.21.15.120:0/3387322291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd10c0b99d0 msgr2=0x7fd10c0b5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:25.867 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.864+0000 7fd113d81640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd10c0b99d0 0x7fd10c0b5c80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00c730 tx=0x7fd0fc00cbf0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.865+0000 7fd113d81640 1 -- 172.21.15.120:0/3387322291 shutdown_connections 2023-12-19T06:39:25.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.865+0000 7fd113d81640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7fd0f006a430 0x7fd0f006c8f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.865+0000 7fd113d81640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fd10c14f310 0x7fd10c0b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.865+0000 7fd113d81640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd10c1490d0 0x7fd10c148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.865+0000 7fd113d81640 1 --2- 172.21.15.120:0/3387322291 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fd10c0b99d0 0x7fd10c0b5c80 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:25.868 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.865+0000 7fd113d81640 1 -- 172.21.15.120:0/3387322291 >> 172.21.15.120:0/3387322291 conn(0x7fd10c0be180 msgr2=0x7fd10c06c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T06:39:25.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.865+0000 7fd113d81640 1 -- 172.21.15.120:0/3387322291 shutdown_connections 2023-12-19T06:39:25.869 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:25.865+0000 7fd113d81640 1 -- 172.21.15.120:0/3387322291 wait complete. 2023-12-19T06:39:25.887 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T06:39:26.059 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.056+0000 7fad0abf6640 1 Processor -- start 2023-12-19T06:39:26.059 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.056+0000 7fad0abf6640 1 -- start start 2023-12-19T06:39:26.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.057+0000 7fad0abf6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad0414f910 0x7fad0415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:26.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.057+0000 7fad0abf6640 1 -- --> v1:172.21.15.120:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad040b6cc0 con 0x7fad04149310 2023-12-19T06:39:26.060 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.057+0000 7fad0abf6640 1 -- --> v1:172.21.15.155:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0406a410 con 0x7fad0406bbd0 2023-12-19T06:39:26.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.057+0000 7fad0abf6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0406a660 con 0x7fad0414f910 2023-12-19T06:39:26.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.058+0000 7fad08992640 1 --1- >> v1:172.21.15.120:6789/0 conn(0x7fad04149310 0x7fad04069d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.120:6789/0 says I am v1:172.21.15.120:52544/0 (socket says 172.21.15.120:52544) 2023-12-19T06:39:26.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.058+0000 7fad08992640 1 -- 172.21.15.120:0/296620974 learned_addr learned my addr 172.21.15.120:0/296620974 (peer_addr_for_me v1:172.21.15.120:0/0) 2023-12-19T06:39:26.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.058+0000 7fad09193640 1 --2- 172.21.15.120:0/296620974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad0414f910 0x7fad0415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:26.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.058+0000 7fad037fe640 1 -- 172.21.15.120:0/296620974 <== mon.0 v1:172.21.15.120:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342513419 0 0) 0x7fad040b6cc0 con 0x7fad04149310 2023-12-19T06:39:26.061 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.058+0000 7fad037fe640 1 -- 172.21.15.120:0/296620974 --> v1:172.21.15.120:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facec003520 con 0x7fad04149310 2023-12-19T06:39:26.062 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.059+0000 7fad037fe640 1 -- 172.21.15.120:0/296620974 <== mon.0 v1:172.21.15.120:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2856058497 0 0) 0x7facec003520 con 0x7fad04149310 2023-12-19T06:39:26.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.059+0000 7fad037fe640 1 -- 172.21.15.120:0/296620974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad0414f910 msgr2=0x7fad0415a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T06:39:26.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.059+0000 7fad037fe640 1 --2- 172.21.15.120:0/296620974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7fad0414f910 0x7fad0415a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:26.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.059+0000 7fad037fe640 1 -- 172.21.15.120:0/296620974 >> v1:172.21.15.155:6789/0 conn(0x7fad0406bbd0 legacy=0x7fad0414f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:26.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.059+0000 7fad037fe640 1 -- 172.21.15.120:0/296620974 --> v1:172.21.15.120:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040719d0 con 0x7fad04149310 2023-12-19T06:39:26.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.059+0000 7fad037fe640 1 -- 172.21.15.120:0/296620974 <== mon.0 v1:172.21.15.120:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2517971018 0 0) 0x7facf4001670 con 0x7fad04149310 2023-12-19T06:39:26.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.059+0000 7fad037fe640 1 -- 172.21.15.120:0/296620974 >> v1:172.21.15.120:6789/0 conn(0x7fad04149310 legacy=0x7fad04069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:26.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.059+0000 7fad037fe640 1 --2- 172.21.15.120:0/296620974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facec0039f0 0x7facec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:26.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.060+0000 7fad037fe640 1 --2- 172.21.15.120:0/296620974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facec0047c0 0x7facec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:26.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.060+0000 7fad037fe640 1 --2- 172.21.15.120:0/296620974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facec005180 0x7facec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:26.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.060+0000 7fad037fe640 1 -- 172.21.15.120:0/296620974 --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0406a660 con 0x7facec005180 2023-12-19T06:39:26.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.060+0000 7fad08992640 1 --2- 172.21.15.120:0/296620974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facec0039f0 0x7facec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:26.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.060+0000 7fad037fe640 1 -- 172.21.15.120:0/296620974 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facec00c050 con 0x7facec0047c0 2023-12-19T06:39:26.063 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.060+0000 7fad037fe640 1 -- 172.21.15.120:0/296620974 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facec00c210 con 0x7facec0039f0 2023-12-19T06:39:26.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.060+0000 7fad03fff640 1 --2- 172.21.15.120:0/296620974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facec0047c0 0x7facec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:26.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.060+0000 7fad09193640 1 --2- 172.21.15.120:0/296620974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facec005180 0x7facec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:26.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.061+0000 7fad03fff640 1 -- 172.21.15.120:0/296620974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facec0039f0 msgr2=0x7facec003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T06:39:26.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.061+0000 7fad03fff640 1 --2- 172.21.15.120:0/296620974 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facec0039f0 0x7facec003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:26.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.061+0000 7fad03fff640 1 -- 172.21.15.120:0/296620974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facec005180 msgr2=0x7facec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T06:39:26.064 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.061+0000 7fad03fff640 1 --2- 172.21.15.120:0/296620974 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7facec005180 0x7facec00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:26.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.061+0000 7fad03fff640 1 -- 172.21.15.120:0/296620974 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec003520 con 0x7facec0047c0 2023-12-19T06:39:26.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.062+0000 7fad03fff640 1 --2- 172.21.15.120:0/296620974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facec0047c0 0x7facec004c40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7facfc001d80 tx=0x7facec0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daaa5ceee2d09adf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:26.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.063+0000 7fad037fe640 1 -- 172.21.15.120:0/296620974 <== mon.1 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc003b70 con 0x7facec0047c0 2023-12-19T06:39:26.065 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.063+0000 7fad037fe640 1 -- 172.21.15.120:0/296620974 <== mon.1 v2:172.21.15.155:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc003cd0 con 0x7facec0047c0 2023-12-19T06:39:26.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.064+0000 7fad0abf6640 1 -- 172.21.15.120:0/296620974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facec0047c0 msgr2=0x7facec004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:26.067 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.064+0000 7fad0abf6640 1 --2- 172.21.15.120:0/296620974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facec0047c0 0x7facec004c40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7facfc001d80 tx=0x7facec0057f0 comp rx=0 tx=0).stop 2023-12-19T06:39:26.068 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.064+0000 7fad09193640 1 -- 172.21.15.120:0/296620974 reap_dead start 2023-12-19T06:39:26.068 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.064+0000 7fad0abf6640 1 -- 172.21.15.120:0/296620974 shutdown_connections 2023-12-19T06:39:26.068 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.064+0000 7fad0abf6640 1 -- 172.21.15.120:0/296620974 >> 172.21.15.120:0/296620974 conn(0x7fad040bcff0 msgr2=0x7fad040bd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T06:39:26.068 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.064+0000 7fad0abf6640 1 -- 172.21.15.120:0/296620974 shutdown_connections 2023-12-19T06:39:26.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.064+0000 7fad0abf6640 1 -- 172.21.15.120:0/296620974 wait complete. 2023-12-19T06:39:26.069 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.066+0000 7fad0abf6640 1 Processor -- start 2023-12-19T06:39:26.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.066+0000 7fad0abf6640 1 -- start start 2023-12-19T06:39:26.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.067+0000 7fad0abf6640 1 --2- >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facec0047c0 0x7fad041e2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:26.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.067+0000 7fad0abf6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad04149890 0x7fad04149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:26.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.067+0000 7fad0abf6640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad041f0370 0x7fad041f07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:26.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.067+0000 7fad0abf6640 1 -- --> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad041e3510 con 0x7fad041f0370 2023-12-19T06:39:26.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.067+0000 7fad0abf6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad041eff20 con 0x7fad04149890 2023-12-19T06:39:26.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.067+0000 7fad0abf6640 1 -- --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad040b4bc0 con 0x7facec0047c0 2023-12-19T06:39:26.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.067+0000 7fad09193640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad041f0370 0x7fad041f07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:26.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.067+0000 7fad09193640 1 --2- >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad041f0370 0x7fad041f07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.120:3300/0 says I am v2:172.21.15.120:54286/0 (socket says 172.21.15.120:54286) 2023-12-19T06:39:26.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.067+0000 7fad09193640 1 -- 172.21.15.120:0/1875760940 learned_addr learned my addr 172.21.15.120:0/1875760940 (peer_addr_for_me v2:172.21.15.120:0/0) 2023-12-19T06:39:26.071 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.067+0000 7fad08992640 1 --2- 172.21.15.120:0/1875760940 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facec0047c0 0x7fad041e2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:26.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.068+0000 7fad08992640 1 -- 172.21.15.120:0/1875760940 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad04149890 msgr2=0x7fad04149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:26.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.068+0000 7fad08992640 1 --2- 172.21.15.120:0/1875760940 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad04149890 0x7fad04149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:26.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.068+0000 7fad08992640 1 -- 172.21.15.120:0/1875760940 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad041f0370 msgr2=0x7fad041f07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:26.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.068+0000 7fad08992640 1 --2- 172.21.15.120:0/1875760940 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad041f0370 0x7fad041f07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:26.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.068+0000 7fad08992640 1 -- 172.21.15.120:0/1875760940 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040b6320 con 0x7facec0047c0 2023-12-19T06:39:26.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.068+0000 7fad09193640 1 --2- 172.21.15.120:0/1875760940 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad041f0370 0x7fad041f07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T06:39:26.072 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.068+0000 7fad08992640 1 --2- 172.21.15.120:0/1875760940 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facec0047c0 0x7fad041e2fd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7facf40072c0 tx=0x7facf4007780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:26.073 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.068+0000 7fad017fa640 1 -- 172.21.15.120:0/1875760940 <== mon.2 v2:172.21.15.155:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4001630 con 0x7facec0047c0 2023-12-19T06:39:26.073 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.069+0000 7fad0abf6640 1 -- 172.21.15.120:0/1875760940 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad040b48e0 con 0x7facec0047c0 2023-12-19T06:39:26.073 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.069+0000 7fad0abf6640 1 -- 172.21.15.120:0/1875760940 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad04071140 con 0x7facec0047c0 2023-12-19T06:39:26.073 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.070+0000 7fad017fa640 1 -- 172.21.15.120:0/1875760940 <== mon.2 v2:172.21.15.155:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf400f940 con 0x7facec0047c0 2023-12-19T06:39:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.071+0000 7fad017fa640 1 -- 172.21.15.120:0/1875760940 <== mon.2 v2:172.21.15.155:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf400fcb0 con 0x7facec0047c0 2023-12-19T06:39:26.074 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.071+0000 7fad0abf6640 1 -- 172.21.15.120:0/1875760940 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0404e080 con 0x7facec0047c0 2023-12-19T06:39:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.071+0000 7fad017fa640 1 -- 172.21.15.120:0/1875760940 <== mon.2 v2:172.21.15.155:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7facf401d460 con 0x7facec0047c0 2023-12-19T06:39:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.072+0000 7fad017fa640 1 --2- 172.21.15.120:0/1875760940 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7facf006a430 0x7facf006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T06:39:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.072+0000 7fad017fa640 1 -- 172.21.15.120:0/1875760940 <== mon.2 v2:172.21.15.155:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facf4088900 con 0x7facec0047c0 2023-12-19T06:39:26.075 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.072+0000 7fad03fff640 1 --2- 172.21.15.120:0/1875760940 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7facf006a430 0x7facf006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T06:39:26.076 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.073+0000 7fad03fff640 1 --2- 172.21.15.120:0/1875760940 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7facf006a430 0x7facf006c8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7facfc034000 tx=0x7facfc030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T06:39:26.085 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.078+0000 7fad017fa640 1 -- 172.21.15.120:0/1875760940 <== mon.2 v2:172.21.15.155:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179298 (secure 0 0 0) 0x7facf4053f20 con 0x7facec0047c0 2023-12-19T06:39:26.422 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.419+0000 7fad0abf6640 1 -- 172.21.15.120:0/1875760940 --> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fad0414c840 con 0x7facec0047c0 2023-12-19T06:39:26.423 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.421+0000 7fad017fa640 1 -- 172.21.15.120:0/1875760940 <== mon.2 v2:172.21.15.155:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) v1 ==== 80+0+0 (secure 0 0 0) 0x7facf4057500 con 0x7facec0047c0 2023-12-19T06:39:26.425 INFO:teuthology.orchestra.run.smithi120.stderr:listed 0 entries 2023-12-19T06:39:26.431 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.429+0000 7fad0abf6640 1 -- 172.21.15.120:0/1875760940 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7facf006a430 msgr2=0x7facf006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.429+0000 7fad0abf6640 1 --2- 172.21.15.120:0/1875760940 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7facf006a430 0x7facf006c8f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7facfc034000 tx=0x7facfc030000 comp rx=0 tx=0).stop 2023-12-19T06:39:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.429+0000 7fad0abf6640 1 -- 172.21.15.120:0/1875760940 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facec0047c0 msgr2=0x7fad041e2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T06:39:26.432 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.429+0000 7fad0abf6640 1 --2- 172.21.15.120:0/1875760940 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facec0047c0 0x7fad041e2fd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7facf40072c0 tx=0x7facf4007780 comp rx=0 tx=0).stop 2023-12-19T06:39:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.430+0000 7fad0abf6640 1 -- 172.21.15.120:0/1875760940 shutdown_connections 2023-12-19T06:39:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.430+0000 7fad0abf6640 1 --2- 172.21.15.120:0/1875760940 >> [v2:172.21.15.120:6832/89586,v1:172.21.15.120:6833/89586] conn(0x7facf006a430 0x7facf006c8f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.430+0000 7fad0abf6640 1 --2- 172.21.15.120:0/1875760940 >> [v2:172.21.15.120:3300/0,v1:172.21.15.120:6789/0] conn(0x7fad041f0370 0x7fad041f07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.430+0000 7fad0abf6640 1 --2- 172.21.15.120:0/1875760940 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad04149890 0x7fad04149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.430+0000 7fad0abf6640 1 --2- 172.21.15.120:0/1875760940 >> [v2:172.21.15.155:3301/0,v1:172.21.15.155:6790/0] conn(0x7facec0047c0 0x7fad041e2fd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T06:39:26.433 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.430+0000 7fad0abf6640 1 -- 172.21.15.120:0/1875760940 >> 172.21.15.120:0/1875760940 conn(0x7fad040bcff0 msgr2=0x7fad04070720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T06:39:26.438 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.435+0000 7fad0abf6640 1 -- 172.21.15.120:0/1875760940 shutdown_connections 2023-12-19T06:39:26.441 INFO:teuthology.orchestra.run.smithi120.stderr:2023-12-19T06:39:26.439+0000 7fad0abf6640 1 -- 172.21.15.120:0/1875760940 wait complete. 2023-12-19T06:39:26.460 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T06:39:26.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T06:39:26.460 DEBUG:teuthology.orchestra.run.smithi188:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-19T06:39:26.560 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi188.front.sepia.ceph.com 2023-12-19T06:39:26.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T06:39:26.561 DEBUG:teuthology.orchestra.run.smithi188:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T06:39:28.217 INFO:tasks.ceph.osd.0:Sent signal 15 2023-12-19T06:39:28.218 INFO:tasks.ceph.osd.2:Sent signal 15 2023-12-19T06:39:28.218 INFO:tasks.ceph.osd.3:Sent signal 15 2023-12-19T06:39:28.218 INFO:tasks.ceph.osd.4:Sent signal 15 2023-12-19T06:39:28.218 INFO:tasks.ceph.osd.5:Sent signal 15 2023-12-19T06:39:28.219 INFO:tasks.ceph.osd.6:Sent signal 15 2023-12-19T06:39:28.219 INFO:tasks.ceph.osd.7:Sent signal 15 2023-12-19T06:39:28.219 INFO:tasks.ceph.mds.a:Sent signal 15 2023-12-19T06:39:28.219 INFO:tasks.ceph.mds.c:Sent signal 15 2023-12-19T06:39:28.219 INFO:tasks.ceph.mds.b:Sent signal 15 2023-12-19T06:39:28.220 INFO:tasks.ceph.mon.a:Sent signal 15 2023-12-19T06:39:28.220 INFO:tasks.ceph.mon.b:Sent signal 15 2023-12-19T06:39:28.220 INFO:tasks.ceph.mon.c:Sent signal 15 2023-12-19T06:39:28.220 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-12-19T06:39:28.220 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-12-19T06:39:28.221 INFO:tasks.ceph.osd.0.smithi120.stderr:2023-12-19T06:39:28.215+0000 7f4d2d9a2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 89773) UID: 0 2023-12-19T06:39:28.221 INFO:tasks.ceph.osd.0.smithi120.stderr:2023-12-19T06:39:28.215+0000 7f4d2d9a2640 -1 osd.0 33 *** Got signal Terminated *** 2023-12-19T06:39:28.221 INFO:tasks.ceph.osd.0.smithi120.stderr:2023-12-19T06:39:28.215+0000 7f4d2d9a2640 -1 osd.0 33 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-19T06:39:28.222 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-12-19T06:39:28.216+0000 7f756fd05640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 89844) UID: 0 2023-12-19T06:39:28.222 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-12-19T06:39:28.216+0000 7f756fd05640 -1 osd.4 33 *** Got signal Terminated *** 2023-12-19T06:39:28.222 INFO:tasks.ceph.osd.4.smithi155.stderr:2023-12-19T06:39:28.216+0000 7f756fd05640 -1 osd.4 33 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-19T06:39:28.222 INFO:tasks.ceph.osd.2.smithi120.stderr:2023-12-19T06:39:28.216+0000 7fe01984b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 89777) UID: 0 2023-12-19T06:39:28.222 INFO:tasks.ceph.osd.2.smithi120.stderr:2023-12-19T06:39:28.216+0000 7fe01984b640 -1 osd.2 33 *** Got signal Terminated *** 2023-12-19T06:39:28.223 INFO:tasks.ceph.osd.2.smithi120.stderr:2023-12-19T06:39:28.216+0000 7fe01984b640 -1 osd.2 33 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-19T06:39:28.223 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-12-19T06:39:28.216+0000 7f8533f79640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 89846) UID: 0 2023-12-19T06:39:28.223 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-12-19T06:39:28.216+0000 7f8533f79640 -1 osd.5 33 *** Got signal Terminated *** 2023-12-19T06:39:28.223 INFO:tasks.ceph.osd.5.smithi155.stderr:2023-12-19T06:39:28.216+0000 7f8533f79640 -1 osd.5 33 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-19T06:39:28.223 INFO:tasks.ceph.osd.3.smithi120.stderr:2023-12-19T06:39:28.216+0000 7f0f9bda4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 89779) UID: 0 2023-12-19T06:39:28.223 INFO:tasks.ceph.osd.3.smithi120.stderr:2023-12-19T06:39:28.216+0000 7f0f9bda4640 -1 osd.3 33 *** Got signal Terminated *** 2023-12-19T06:39:28.223 INFO:tasks.ceph.osd.3.smithi120.stderr:2023-12-19T06:39:28.216+0000 7f0f9bda4640 -1 osd.3 33 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-19T06:39:28.224 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-12-19T06:39:28.216+0000 7f14f63ce640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 89849) UID: 0 2023-12-19T06:39:28.224 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-12-19T06:39:28.216+0000 7f14f63ce640 -1 osd.6 33 *** Got signal Terminated *** 2023-12-19T06:39:28.224 INFO:tasks.ceph.osd.6.smithi155.stderr:2023-12-19T06:39:28.216+0000 7f14f63ce640 -1 osd.6 33 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-19T06:39:28.224 INFO:tasks.ceph.mds.a.smithi120.stderr:2023-12-19T06:39:28.217+0000 7f9ce0a8b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 99898) UID: 0 2023-12-19T06:39:28.224 INFO:tasks.ceph.mds.a.smithi120.stderr:2023-12-19T06:39:28.217+0000 7f9ce0a8b640 -1 mds.a *** got signal Terminated *** 2023-12-19T06:39:28.224 INFO:tasks.ceph.mds.c.smithi120.stderr:2023-12-19T06:39:28.217+0000 7fdc88b93640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 99899) UID: 0 2023-12-19T06:39:28.225 INFO:tasks.ceph.mds.c.smithi120.stderr:2023-12-19T06:39:28.217+0000 7fdc88b93640 -1 mds.c *** got signal Terminated *** 2023-12-19T06:39:28.225 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-12-19T06:39:28.217+0000 7f3534827640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 89851) UID: 0 2023-12-19T06:39:28.225 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-12-19T06:39:28.217+0000 7f3534827640 -1 osd.7 33 *** Got signal Terminated *** 2023-12-19T06:39:28.225 INFO:tasks.ceph.osd.7.smithi155.stderr:2023-12-19T06:39:28.217+0000 7f3534827640 -1 osd.7 33 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-19T06:39:28.225 INFO:tasks.ceph.mon.a.smithi120.stderr:2023-12-19T06:39:28.218+0000 7f93c2a14640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 89508) UID: 0 2023-12-19T06:39:28.225 INFO:tasks.ceph.mon.a.smithi120.stderr:2023-12-19T06:39:28.218+0000 7f93c2a14640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-19T06:39:28.225 INFO:tasks.ceph.mds.b.smithi155.stderr:2023-12-19T06:39:28.218+0000 7f3e63252640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 95274) UID: 0 2023-12-19T06:39:28.226 INFO:tasks.ceph.mds.b.smithi155.stderr:2023-12-19T06:39:28.218+0000 7f3e63252640 -1 mds.b *** got signal Terminated *** 2023-12-19T06:39:28.226 INFO:tasks.ceph.mon.b.smithi155.stderr:2023-12-19T06:39:28.218+0000 7fcc1c7f6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 89275) UID: 0 2023-12-19T06:39:28.226 INFO:tasks.ceph.mon.b.smithi155.stderr:2023-12-19T06:39:28.218+0000 7fcc1c7f6640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-12-19T06:39:28.229 INFO:tasks.ceph.mon.c.smithi155.stderr:2023-12-19T06:39:28.226+0000 7f98b21e6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 89278) UID: 0 2023-12-19T06:39:28.229 INFO:tasks.ceph.mon.c.smithi155.stderr:2023-12-19T06:39:28.226+0000 7f98b21e6640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-12-19T06:39:28.422 INFO:tasks.ceph.mgr.x.smithi155.stderr:daemon-helper: command crashed with signal 15 2023-12-19T06:40:31.079 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:40:31.083 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:40:31.085 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:41:01.224 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:41:01.228 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:41:01.231 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:41:31.368 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:41:31.371 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:41:31.374 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:42:01.587 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:42:01.591 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:42:01.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:42:31.806 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:42:31.810 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:42:31.812 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:43:02.150 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:43:02.153 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:43:02.156 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:43:32.361 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:43:32.365 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:43:32.367 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:44:02.505 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:44:02.508 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:44:02.511 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:44:32.642 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:44:32.645 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:44:32.648 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:45:02.798 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:45:02.802 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:45:02.804 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:45:33.112 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:45:33.116 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:45:33.119 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:46:03.261 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:46:03.265 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:46:03.269 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:46:33.410 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:46:33.414 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:46:33.417 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:47:03.562 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:47:03.566 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:47:03.573 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:47:33.888 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:47:33.892 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:47:33.896 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:48:04.226 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:48:04.229 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:48:04.231 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:48:34.411 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:48:34.414 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:48:34.416 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:49:04.622 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:49:04.625 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:49:04.628 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:49:34.847 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:49:34.850 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:49:34.853 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:50:05.060 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:50:05.064 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:50:05.066 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:50:35.339 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:50:35.343 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:50:35.346 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:51:05.477 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:51:05.482 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:51:05.485 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:51:35.791 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:51:35.794 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:51:35.796 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:52:05.996 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:52:06.001 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:52:06.004 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:52:36.324 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:52:36.328 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:52:36.330 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:53:06.459 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:53:06.462 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:53:06.465 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:53:36.603 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:53:36.606 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:53:36.609 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:54:06.831 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:54:06.835 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:54:06.838 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:54:37.034 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:54:37.037 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:54:37.040 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:55:07.254 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:55:07.257 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:55:07.260 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:55:37.398 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:55:37.402 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:55:37.404 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:56:07.625 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:56:07.629 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:56:07.632 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:56:37.852 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:56:37.856 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:56:37.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:57:08.063 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:57:08.067 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:57:08.070 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:57:38.216 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:57:38.220 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:57:38.223 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:58:08.417 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:58:08.420 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:58:08.422 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:58:38.637 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:58:38.641 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:58:38.645 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:59:08.780 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:59:08.784 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:59:08.786 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:59:39.016 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:59:39.020 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T06:59:39.023 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:00:09.166 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:00:09.169 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:00:09.172 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:00:39.305 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:00:39.308 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:00:39.311 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:01:09.717 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:01:09.721 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:01:09.724 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:01:39.918 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:01:39.922 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:01:39.925 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:02:10.138 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:02:10.142 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:02:10.145 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:02:40.282 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:02:40.286 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:02:40.289 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:03:10.426 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:03:10.431 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:03:10.434 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:03:40.737 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:03:40.741 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:03:40.746 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:04:10.882 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:04:10.885 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:04:10.888 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:04:41.051 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:04:41.057 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:04:41.060 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:05:11.204 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:05:11.207 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:05:11.210 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:05:41.422 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:05:41.425 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:05:41.428 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:06:11.595 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:06:11.599 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:06:11.602 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:06:41.813 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:06:41.817 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:06:41.819 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:07:12.054 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:07:12.058 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:07:12.060 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:07:42.190 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:07:42.194 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:07:42.197 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:08:12.516 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:08:12.520 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:08:12.524 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:08:42.693 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:08:42.697 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:08:42.699 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:09:12.839 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:09:12.842 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:09:12.845 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:09:43.075 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:09:43.080 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:09:43.083 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:10:13.361 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:10:13.364 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:10:13.367 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:10:43.511 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:10:43.515 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:10:43.518 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:11:13.659 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:11:13.662 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:11:13.665 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:11:43.802 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:11:43.806 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:11:43.808 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:12:13.963 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:12:13.966 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:12:13.969 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:12:44.103 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:12:44.107 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:12:44.109 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:13:14.258 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:13:14.263 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:13:14.267 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:13:44.456 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:13:44.459 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:13:44.462 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:14:14.625 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:14:14.629 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:14:14.631 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:14:44.861 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:14:44.864 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:14:44.867 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:15:15.184 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:15:15.188 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:15:15.190 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:15:45.390 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:15:45.393 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:15:45.396 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:16:15.593 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:16:15.596 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:16:15.599 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:16:45.794 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:16:45.799 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:16:45.802 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:17:16.006 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:17:16.010 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:17:16.012 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:17:46.207 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:17:46.210 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:17:46.213 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:18:16.360 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:18:16.363 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:18:16.366 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:18:46.569 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:18:46.572 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:18:46.574 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:19:16.770 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:19:16.773 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:19:16.776 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:19:46.989 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:19:46.993 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:19:46.995 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:20:17.206 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:20:17.210 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:20:17.212 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:20:47.408 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:20:47.411 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:20:47.414 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:21:17.627 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:21:17.631 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:21:17.633 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:21:47.853 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:21:47.857 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:21:47.860 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:22:18.064 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:22:18.067 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:22:18.069 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:22:48.217 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:22:48.220 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:22:48.223 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:23:18.425 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:23:18.429 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:23:18.432 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:23:48.645 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:23:48.648 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:23:48.651 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:24:18.788 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:24:18.791 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:24:18.794 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:24:48.993 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:24:48.996 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:24:48.998 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:25:19.218 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:25:19.221 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:25:19.224 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:25:49.428 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:25:49.430 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:25:49.433 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:26:19.663 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:26:19.666 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:26:19.669 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:26:49.873 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:26:49.876 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:26:49.879 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:27:20.085 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:27:20.089 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:27:20.092 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:27:50.313 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:27:50.316 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:27:50.319 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:28:20.521 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:28:20.524 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:28:20.527 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:28:50.723 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:28:50.728 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:28:50.732 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:29:20.867 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:29:20.871 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:29:20.873 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:29:51.061 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:29:51.064 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:29:51.067 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:30:21.280 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:30:21.284 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:30:21.286 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:30:51.467 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:30:51.470 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:30:51.473 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:31:21.694 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:31:21.697 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:31:21.700 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:31:51.828 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:31:51.832 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:31:51.834 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:32:21.994 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:32:21.998 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:32:22.000 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:32:52.192 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:32:52.196 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:32:52.199 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:33:22.445 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:33:22.448 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:33:22.450 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:33:52.655 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:33:52.659 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:33:52.661 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:34:22.882 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:34:22.886 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:34:22.889 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:34:53.026 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:34:53.029 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:34:53.032 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:35:23.277 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:35:23.284 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:35:23.288 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:35:53.499 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:35:53.503 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:35:53.505 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:36:23.717 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:36:23.721 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:36:23.723 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:36:53.945 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:36:53.948 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:36:53.951 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:37:24.179 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:37:24.183 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:37:24.185 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:37:54.322 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:37:54.325 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:37:54.328 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:38:24.526 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:38:24.532 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:38:24.535 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:38:54.731 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:38:54.735 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:38:54.738 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:39:24.931 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:39:24.936 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:39:24.939 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:39:55.167 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:39:55.171 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:39:55.173 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:40:25.314 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:40:25.318 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:40:25.320 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:40:55.514 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:40:55.518 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:40:55.521 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:41:25.716 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:41:25.719 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:41:25.722 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:41:55.935 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:41:55.938 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:41:55.941 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:42:26.136 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:42:26.140 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:42:26.142 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:42:56.338 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:42:56.342 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:42:56.344 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:43:26.482 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:43:26.486 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:43:26.489 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:43:56.677 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:43:56.680 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:43:56.683 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:44:26.983 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:44:27.062 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:44:27.066 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:44:57.362 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:44:57.366 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:44:57.369 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:45:27.583 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:45:27.586 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:45:27.589 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:45:57.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:45:57.723 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:45:57.725 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:46:27.880 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:46:27.883 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:46:27.886 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:46:58.119 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:46:58.122 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:46:58.125 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:47:28.335 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:47:28.339 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:47:28.341 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:47:58.545 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:47:58.549 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:47:58.552 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:48:28.756 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:48:28.759 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:48:28.762 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:48:58.976 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:48:58.979 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:48:58.982 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:49:29.203 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:49:29.207 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:49:29.210 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:49:59.406 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:49:59.410 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:49:59.412 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:50:29.615 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:50:29.619 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:50:29.622 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:50:59.817 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:50:59.820 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:50:59.823 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:51:30.028 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:51:30.032 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:51:30.034 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:52:00.239 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:52:00.242 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:52:00.245 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:52:30.468 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:52:30.472 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:52:30.475 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:53:00.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:53:00.701 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:53:00.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:53:30.841 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:53:30.845 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:53:30.847 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:54:01.054 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:54:01.057 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:54:01.060 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:54:31.199 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:54:31.202 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:54:31.205 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:55:01.340 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:55:01.343 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:55:01.346 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:55:31.524 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:55:31.528 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:55:31.530 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:56:01.676 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:56:01.680 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:56:01.686 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:56:32.006 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:56:32.012 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:56:32.022 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:57:02.225 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:57:02.228 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:57:02.231 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:57:32.478 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:57:32.481 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:57:32.483 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:58:02.751 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:58:02.754 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:58:02.757 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:58:32.968 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:58:32.972 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:58:32.976 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:59:03.137 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:59:03.140 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:59:03.143 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:59:33.394 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:59:33.398 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T07:59:33.400 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:00:03.602 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:00:03.605 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:00:03.607 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:00:33.745 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:00:33.749 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:00:33.752 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:01:03.900 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:01:03.903 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:01:03.906 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:01:34.111 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:01:34.114 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:01:34.117 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:02:04.246 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:02:04.250 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:02:04.253 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:02:34.457 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:02:34.461 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:02:34.464 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:03:04.678 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:03:04.681 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:03:04.684 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:03:34.928 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:03:34.932 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:03:34.935 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:04:05.150 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:04:05.153 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:04:05.155 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:04:35.361 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:04:35.365 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:04:35.368 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:05:05.581 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:05:05.585 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:05:05.588 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:05:35.808 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:05:35.811 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:05:35.814 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:06:05.953 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:06:05.957 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:06:05.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:06:36.107 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:06:36.111 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:06:36.113 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:07:06.453 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:07:06.456 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:07:06.458 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:07:36.665 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:07:36.669 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:07:36.672 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:08:07.047 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:08:07.051 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:08:07.054 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:08:37.249 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:08:37.252 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:08:37.255 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:09:07.477 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:09:07.481 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:09:07.484 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:09:37.776 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:09:37.779 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:09:37.782 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:10:08.110 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:10:08.113 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:10:08.116 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:10:38.251 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:10:38.255 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:10:38.257 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:11:08.411 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:11:08.415 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:11:08.417 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:11:38.557 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:11:38.561 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:11:38.564 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:12:08.709 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:12:08.712 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:12:08.715 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:12:38.931 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:12:38.934 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:12:38.936 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:13:09.259 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:13:09.263 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:13:09.266 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:13:39.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:13:39.479 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:13:39.481 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:14:09.702 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:14:09.706 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:14:09.708 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:14:39.908 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:14:39.911 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:14:39.913 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:15:10.107 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:15:10.111 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:15:10.114 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:15:40.318 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:15:40.322 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:15:40.325 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:16:10.513 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:16:10.516 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:16:10.519 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:16:40.749 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:16:40.752 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:16:40.755 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:17:10.992 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:17:10.996 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:17:10.999 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:17:41.142 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:17:41.149 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:17:41.151 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:18:11.339 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:18:11.342 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:18:11.345 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:18:41.626 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:18:41.634 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:18:41.637 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:19:11.768 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:19:11.772 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:19:11.777 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:19:41.944 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:19:41.948 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:19:41.951 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:20:12.274 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:20:12.277 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:20:12.279 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:20:42.504 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:20:42.508 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:20:42.510 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:21:12.712 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:21:12.716 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:21:12.719 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:21:42.939 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:21:42.942 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:21:42.945 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:22:13.175 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:22:13.178 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:22:13.181 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:22:43.419 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:22:43.423 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:22:43.425 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:23:13.647 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:23:13.651 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:23:13.654 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:23:43.865 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:23:43.869 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:23:43.871 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:24:14.068 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:24:14.072 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:24:14.075 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:24:44.299 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:24:44.303 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:24:44.306 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:25:14.508 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:25:14.511 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:25:14.513 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:25:44.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:25:44.869 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:25:44.872 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:26:15.086 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:26:15.089 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:26:15.092 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:26:45.314 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:26:45.317 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:26:45.320 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:27:15.541 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:27:15.544 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:27:15.547 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:27:45.750 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:27:45.754 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:27:45.757 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:28:16.114 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:28:16.117 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:28:16.120 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:28:46.313 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:28:46.317 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:28:46.320 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:29:16.455 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:29:16.458 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:29:16.461 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:29:46.735 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:29:46.742 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:29:46.746 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:30:16.964 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:30:16.968 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:30:16.971 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:30:47.198 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:30:47.202 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:30:47.204 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:31:17.425 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:31:17.429 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:31:17.431 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:31:47.836 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:31:47.840 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:31:47.842 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:32:17.980 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:32:17.983 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:32:17.986 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:32:48.174 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:32:48.182 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:32:48.186 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:33:18.403 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:33:18.407 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:33:18.410 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:33:48.745 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:33:48.749 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:33:48.751 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:34:18.879 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:34:18.883 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:34:18.887 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:34:49.220 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:34:49.224 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:34:49.227 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:35:19.426 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:35:19.429 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:35:19.432 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:35:49.613 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:35:49.617 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:35:49.622 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:36:19.765 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:36:19.769 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:36:19.772 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:36:50.038 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:36:50.042 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:36:50.045 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:37:20.419 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:37:20.424 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:37:20.426 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:37:50.623 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:37:50.627 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:37:50.630 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:38:20.833 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:38:20.837 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:38:20.840 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:38:51.052 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:38:51.055 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:38:51.057 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:39:21.263 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:39:21.266 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:39:21.269 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:39:51.500 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:39:51.504 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:39:51.519 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:40:21.673 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:40:21.676 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:40:21.679 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:40:51.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:40:51.963 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:40:51.966 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:41:22.180 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:41:22.184 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:41:22.187 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:41:52.426 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:41:52.430 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:41:52.432 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:42:22.644 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:42:22.647 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:42:22.650 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:42:52.910 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:42:52.914 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:42:52.917 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:43:23.157 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:43:23.160 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:43:23.163 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:43:53.393 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:43:53.396 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:43:53.399 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:44:23.611 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:44:23.614 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:44:23.616 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:44:53.861 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:44:53.865 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:44:53.868 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:45:04.121 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-12-19T08:45:24.191 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:45:24.196 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:45:24.199 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:45:54.477 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:45:54.480 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:45:54.483 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:46:24.616 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:46:24.620 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:46:24.623 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:46:54.821 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:46:54.825 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:46:54.827 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:47:25.034 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:47:25.038 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:47:25.041 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:47:55.297 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:47:55.301 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:47:55.303 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:48:25.539 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:48:25.542 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:48:25.545 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:48:55.772 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:48:55.776 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:48:55.778 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:49:25.919 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:49:25.923 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:49:25.925 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:49:56.131 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:49:56.134 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:49:56.137 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:50:26.332 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:50:26.336 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:50:26.338 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:50:56.535 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:50:56.540 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:50:56.543 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:51:26.754 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:51:26.757 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:51:26.760 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:51:56.957 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:51:56.961 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:51:56.963 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:52:27.168 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:52:27.171 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:52:27.174 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:52:57.320 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:52:57.323 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:52:57.326 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:53:27.540 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:53:27.543 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:53:27.546 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:53:57.684 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:53:57.687 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:53:57.690 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:54:27.912 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:54:27.916 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:54:27.918 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:54:58.055 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:54:58.058 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:54:58.061 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:55:28.319 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:55:28.323 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:55:28.326 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:55:58.543 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:55:58.546 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:55:58.549 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:56:28.753 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:56:28.756 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:56:28.759 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:56:58.888 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:56:58.893 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:56:58.895 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:57:29.175 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:57:29.178 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:57:29.181 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:57:59.512 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:57:59.516 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:57:59.519 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:58:29.788 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:58:29.791 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:58:29.794 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:59:00.017 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:59:00.021 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:59:00.025 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:59:30.277 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:59:30.285 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T08:59:30.288 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:00:00.497 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:00:00.500 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:00:00.503 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:00:30.874 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:00:30.877 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:00:30.879 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:01:01.028 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:01:01.031 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:01:01.034 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:01:31.153 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:01:31.157 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:01:31.159 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:02:01.289 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:02:01.292 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:02:01.295 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:02:31.452 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:02:31.455 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:02:31.458 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:03:01.604 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:03:01.607 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:03:01.610 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:03:31.739 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:03:31.743 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:03:31.746 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:04:01.966 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:04:01.970 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:04:01.972 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:04:32.177 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:04:32.180 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:04:32.183 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:05:02.396 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:05:02.400 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:05:02.402 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:05:32.582 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:05:32.586 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:05:32.589 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:06:02.717 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:06:02.720 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:06:02.723 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:06:32.918 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:06:32.922 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:06:32.925 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:07:03.106 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:07:03.110 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:07:03.113 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:07:33.308 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:07:33.311 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:07:33.314 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:08:03.552 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:08:03.556 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:08:03.560 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:08:33.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:08:33.700 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:08:33.702 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:09:03.848 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:09:03.852 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:09:03.855 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:09:34.169 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:09:34.173 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:09:34.175 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:10:04.341 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:10:04.344 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:10:04.347 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:10:34.504 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:10:34.507 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:10:34.509 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:11:04.650 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:11:04.653 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:11:04.656 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:11:34.803 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:11:34.806 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:11:34.809 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:12:04.975 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:12:04.979 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:12:04.981 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:12:35.147 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:12:35.150 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:12:35.153 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:13:05.301 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:13:05.304 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:13:05.307 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:13:35.446 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:13:35.449 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:13:35.452 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:14:05.593 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:14:05.596 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:14:05.599 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:14:35.741 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:14:35.745 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:14:35.747 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:15:05.936 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:15:05.939 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:15:05.942 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:15:36.173 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:15:36.176 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:15:36.179 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:16:06.395 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:16:06.398 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:16:06.401 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:16:36.635 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:16:36.638 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:16:36.642 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:17:06.854 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:17:06.857 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:17:06.860 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:17:37.081 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:17:37.085 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:17:37.088 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:18:07.253 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:18:07.257 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:18:07.259 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:18:37.400 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:18:37.404 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:18:37.406 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:19:07.613 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:19:07.617 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:19:07.620 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:19:37.884 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:19:37.887 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:19:37.890 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:20:08.102 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:20:08.106 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:20:08.108 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:20:38.329 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:20:38.333 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:20:38.335 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:21:08.548 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:21:08.551 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:21:08.554 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:21:38.777 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:21:38.780 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:21:38.782 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:22:08.954 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:22:08.961 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:22:08.964 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:22:39.190 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:22:39.193 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:22:39.195 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:23:09.393 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:23:09.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:23:09.400 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:23:39.620 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:23:39.623 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:23:39.626 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:24:09.849 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:24:09.852 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:24:09.855 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:24:39.993 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:24:39.997 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:24:40.000 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:25:10.195 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:25:10.199 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:25:10.201 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:25:40.457 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:25:40.460 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:25:40.463 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:26:10.593 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:26:10.597 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:26:10.599 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:26:40.737 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:26:40.740 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:26:40.743 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:27:10.875 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:27:10.879 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:27:10.882 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:27:41.009 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:27:41.012 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:27:41.014 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:28:11.455 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:28:11.459 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:28:11.462 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:28:41.598 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:28:41.602 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:28:41.605 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:29:11.744 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:29:11.747 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:29:11.750 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:29:41.952 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:29:41.956 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:29:41.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:30:12.212 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:30:12.216 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:30:12.219 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:30:42.446 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:30:42.449 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:30:42.452 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:31:12.595 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:31:12.598 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:31:12.600 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:31:42.729 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:31:42.733 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:31:42.735 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:32:12.874 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:32:12.877 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:32:12.880 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:32:43.085 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:32:43.089 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:32:43.091 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:33:13.270 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:33:13.274 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:33:13.277 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:33:43.416 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:33:43.419 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:33:43.421 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:34:13.762 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:34:13.766 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:34:13.768 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:34:43.953 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:34:43.956 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:34:43.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:35:14.172 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:35:14.175 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:35:14.178 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:35:44.391 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:35:44.395 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:35:44.398 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:36:08.023 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-12-19T09:36:14.768 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:36:14.771 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:36:14.773 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:36:44.998 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:36:45.001 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:36:45.004 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:37:15.198 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:37:15.201 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:37:15.204 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:37:45.341 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:37:45.345 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:37:45.347 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:38:15.569 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:38:15.573 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:38:15.575 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:38:45.839 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:38:45.842 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:38:45.845 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:39:16.049 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:39:16.054 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:39:16.056 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:39:46.243 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:39:46.247 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:39:46.249 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:40:16.451 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:40:16.454 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:40:16.456 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:40:46.657 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:40:46.660 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:40:46.663 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:41:16.893 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:41:16.896 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:41:16.899 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:41:47.095 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:41:47.099 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:41:47.101 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:42:17.299 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:42:17.303 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:42:17.307 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:42:47.453 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:42:47.456 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:42:47.458 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:43:17.685 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:43:17.688 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:43:17.691 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:43:47.889 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:43:47.892 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:43:47.895 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:44:18.158 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:44:18.161 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:44:18.164 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:44:48.305 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:44:48.309 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:44:48.312 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:45:18.642 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:45:18.646 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:45:18.648 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:45:48.783 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:45:48.786 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:45:48.789 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:46:18.985 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:46:18.989 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:46:18.991 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:46:49.138 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:46:49.143 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:46:49.146 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:47:19.331 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:47:19.334 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:47:19.337 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:47:49.485 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:47:49.490 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:47:49.494 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:48:19.698 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:48:19.701 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:48:19.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:48:49.873 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:48:49.876 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:48:49.879 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:49:20.014 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:49:20.018 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:49:20.020 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:49:50.284 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:49:50.288 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:49:50.291 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:50:20.437 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:50:20.441 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:50:20.444 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:50:50.582 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:50:50.585 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:50:50.588 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:51:20.801 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:51:20.805 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:51:20.807 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:51:51.140 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:51:51.143 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:51:51.146 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:52:21.356 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:52:21.359 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:52:21.362 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:52:51.558 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:52:51.562 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:52:51.564 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:53:21.711 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:53:21.715 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:53:21.718 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:53:52.008 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:53:52.011 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:53:52.013 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:54:22.227 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:54:22.232 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:54:22.234 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:54:52.444 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:54:52.448 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:54:52.450 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:55:22.655 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:55:22.658 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:55:22.660 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:55:52.858 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:55:52.862 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:55:52.864 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:56:23.002 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:56:23.005 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:56:23.008 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:56:53.214 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:56:53.218 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:56:53.220 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:57:23.356 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:57:23.359 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:57:23.362 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:57:53.523 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:57:53.526 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:57:53.529 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:58:23.678 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:58:23.682 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:58:23.685 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:58:53.871 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:58:53.874 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:58:53.877 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:59:24.091 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:59:24.094 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:59:24.097 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:59:54.293 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:59:54.297 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T09:59:54.299 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:00:24.521 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:00:24.524 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:00:24.527 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:00:54.674 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:00:54.678 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:00:54.680 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:01:24.820 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:01:24.823 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:01:24.826 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:01:55.038 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:01:55.042 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:01:55.044 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:02:25.182 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:02:25.185 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:02:25.188 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:02:55.333 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:02:55.337 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:02:55.339 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:03:25.553 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:03:25.556 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:03:25.559 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:03:55.772 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:03:55.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:03:55.779 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:04:26.058 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:04:26.062 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:04:26.065 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:04:56.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:04:56.196 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:04:56.199 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:05:26.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:05:26.329 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:05:26.332 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:05:56.473 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:05:56.476 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:05:56.479 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:06:26.609 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:06:26.613 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:06:26.615 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:06:56.907 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:06:56.910 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:06:56.913 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:07:27.046 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:07:27.048 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:07:27.051 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:07:57.270 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:07:57.273 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:07:57.276 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:08:27.477 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:08:27.480 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:08:27.483 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:08:57.780 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:08:57.783 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:08:57.786 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:09:27.991 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:09:27.994 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:09:27.997 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:09:58.134 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:09:58.138 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:09:58.141 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:10:28.284 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:10:28.287 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:10:28.290 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:10:58.506 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:10:58.509 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:10:58.512 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:11:28.733 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:11:28.737 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:11:28.740 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:11:58.952 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:11:58.955 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:11:58.958 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:12:29.096 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:12:29.100 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:12:29.103 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:12:59.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:12:59.329 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:12:59.332 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:13:29.526 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:13:29.529 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:13:29.532 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:13:59.745 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:13:59.748 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:13:59.750 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:14:29.972 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:14:29.976 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:14:29.978 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:15:00.200 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:15:00.203 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:15:00.206 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:15:30.436 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:15:30.440 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:15:30.443 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:16:00.646 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:16:00.649 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:16:00.652 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:16:30.857 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:16:30.861 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:16:30.864 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:17:01.101 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:17:01.105 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:17:01.107 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:17:31.321 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:17:31.324 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:17:31.327 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:18:01.547 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:18:01.551 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:18:01.554 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:18:31.805 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:18:31.808 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:18:31.811 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:19:02.029 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:19:02.032 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:19:02.035 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:19:32.264 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:19:32.269 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:19:32.272 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:20:02.500 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:20:02.503 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:20:02.505 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:20:32.703 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:20:32.707 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:20:32.709 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:21:02.922 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:21:02.925 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:21:02.928 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:21:33.132 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:21:33.135 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:21:33.138 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:22:03.277 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:22:03.281 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:22:03.283 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:22:33.413 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:22:33.416 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:22:33.419 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:23:03.557 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:23:03.560 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:23:03.563 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:23:33.793 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:23:33.796 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:23:33.799 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:24:03.928 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:24:03.933 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:24:03.936 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:24:34.140 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:24:34.143 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:24:34.145 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:25:04.313 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:25:04.317 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:25:04.319 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:25:34.514 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:25:34.518 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:25:34.520 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:26:04.739 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:26:04.742 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:26:04.745 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:26:34.932 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:26:34.936 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:26:34.938 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:27:05.087 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:27:05.090 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:27:05.093 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:27:35.414 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:27:35.418 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:27:35.420 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:28:05.624 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:28:05.627 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:28:05.630 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:28:35.852 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:28:35.855 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:28:35.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:29:05.995 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:29:05.998 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:29:06.001 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:29:36.191 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:29:36.194 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:29:36.197 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:30:06.343 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:30:06.347 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:30:06.350 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:30:36.546 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:30:36.549 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:30:36.553 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:31:06.765 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:31:06.768 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:31:06.771 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:31:36.967 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:31:36.970 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:31:36.973 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:32:07.253 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:32:07.258 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:32:07.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:32:37.480 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:32:37.484 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:32:37.487 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:33:07.683 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:33:07.686 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:33:07.689 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:33:37.835 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:33:37.839 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:33:37.842 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:34:08.087 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:34:08.090 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:34:08.093 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:34:38.267 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:34:38.271 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:34:38.273 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:35:08.485 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:35:08.489 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:35:08.492 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:35:38.750 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:35:38.753 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:35:38.756 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:36:08.949 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:36:08.953 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:36:08.955 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:36:39.185 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:36:39.188 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:36:39.191 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:37:09.378 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:37:09.381 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:37:09.384 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:37:39.684 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:37:39.688 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:37:39.690 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:38:09.833 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:38:09.837 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:38:09.840 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:38:39.969 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:38:39.973 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:38:39.975 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:39:10.155 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:39:10.159 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:39:10.161 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:39:40.290 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:39:40.293 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:39:40.297 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:40:10.426 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:40:10.429 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:40:10.432 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:40:40.629 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:40:40.633 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:40:40.636 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:41:10.974 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:41:10.977 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:41:10.980 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:41:41.236 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:41:41.239 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:41:41.242 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:42:11.445 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:42:11.448 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:42:11.450 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:42:41.681 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:42:41.684 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:42:41.687 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:43:11.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:43:11.869 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:43:11.872 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:43:42.006 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:43:42.009 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:43:42.012 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:44:12.267 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:44:12.270 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:44:12.273 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:44:42.406 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:44:42.409 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:44:42.412 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:45:12.626 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:45:12.630 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:45:12.632 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:45:42.837 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:45:43.502 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:45:43.505 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:46:13.732 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:46:13.735 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:46:13.738 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:46:43.973 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:46:43.977 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:46:43.980 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:47:14.204 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:47:14.207 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:47:14.210 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:47:44.473 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:47:44.476 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:47:44.479 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:48:14.682 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:48:14.686 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:48:14.688 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:48:44.982 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:48:44.985 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:48:44.989 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:49:15.345 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:49:15.349 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:49:15.352 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:49:45.565 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:49:45.568 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:49:45.571 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:50:15.774 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:50:15.778 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:50:15.781 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:50:46.003 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:50:46.007 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:50:46.010 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:51:16.214 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:51:16.217 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:51:16.219 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:51:46.450 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:51:46.453 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:51:46.456 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:52:16.660 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:52:16.664 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:52:16.666 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:52:46.877 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:52:46.880 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:52:46.883 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:53:17.014 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:53:17.017 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:53:17.020 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:53:47.217 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:53:47.220 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:53:47.223 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:54:17.428 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:54:17.432 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:54:17.434 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:54:47.589 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:54:47.592 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:54:47.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:55:17.808 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:55:17.811 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:55:17.813 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:55:47.961 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:55:47.964 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:55:47.967 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:56:18.278 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:56:18.281 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:56:18.284 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:56:48.406 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:56:48.410 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:56:48.412 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:57:18.626 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:57:18.630 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:57:18.633 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:57:48.820 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:57:48.824 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:57:48.827 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:58:19.093 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:58:19.097 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:58:19.100 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:58:49.292 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:58:49.295 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:58:49.299 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:59:19.569 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:59:19.573 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:59:19.575 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:59:49.780 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:59:49.783 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T10:59:49.786 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:00:19.990 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:00:19.994 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:00:19.997 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:00:50.192 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:00:50.196 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:00:50.198 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:01:20.328 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:01:20.331 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:01:20.334 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:01:50.555 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:01:50.558 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:01:50.561 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:02:20.700 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:02:20.703 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:02:20.706 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:02:50.902 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:02:50.905 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:02:50.908 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:03:21.104 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:03:21.107 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:03:21.110 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:03:51.374 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:03:51.377 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:03:51.380 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:04:21.516 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:04:21.520 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:04:21.523 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:04:51.660 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:04:51.664 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:04:51.667 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:05:21.959 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:05:21.963 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:05:21.965 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:05:52.175 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:05:52.179 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:05:52.181 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:06:22.397 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:06:22.400 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:06:22.403 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:06:52.633 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:06:52.637 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:06:52.640 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:07:22.849 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:07:22.852 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:07:22.855 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:07:53.066 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:07:53.070 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:07:53.072 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:08:23.285 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:08:23.289 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:08:23.292 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:08:53.513 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:08:53.516 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:08:53.519 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:09:23.765 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:09:23.769 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:09:23.772 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:09:53.918 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:09:53.922 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:09:53.924 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:10:24.053 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:10:24.057 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:10:24.059 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:10:54.264 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:10:54.269 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:10:54.272 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:11:24.491 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:11:24.495 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:11:24.497 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:11:54.669 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:11:54.673 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:11:54.675 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:12:24.838 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:12:24.841 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:12:24.844 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:12:55.182 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:12:55.185 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:12:55.187 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:13:25.376 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:13:25.379 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:13:25.382 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:13:55.629 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:13:55.634 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:13:55.636 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:14:25.881 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:14:25.888 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:14:25.892 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:14:56.107 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:14:56.111 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:14:56.113 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:15:26.311 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:15:26.315 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:15:26.318 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:15:56.521 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:15:56.525 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:15:56.527 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:16:26.748 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:16:26.752 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:16:26.755 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:16:56.967 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:16:56.971 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:16:56.974 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:17:27.112 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:17:27.115 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:17:27.119 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:17:57.281 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:17:57.285 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:17:57.288 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:18:27.424 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:18:27.428 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:18:27.433 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:18:57.660 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:18:57.663 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:18:57.666 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:19:27.813 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:19:27.817 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:19:27.819 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:19:58.031 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:19:58.034 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:19:58.037 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:20:28.241 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:20:28.244 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:20:28.246 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:20:58.393 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:20:58.397 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:20:58.401 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:21:28.767 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:21:28.770 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:21:28.773 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:21:58.917 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:21:58.921 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:21:58.923 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:22:29.098 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:22:29.102 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:22:29.104 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:22:59.294 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:22:59.297 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:22:59.300 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:23:29.574 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:23:29.578 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:23:29.581 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:23:59.735 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:23:59.738 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:23:59.741 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:24:30.082 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:24:30.086 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:24:30.088 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:25:00.298 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:25:00.301 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:25:00.304 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:25:30.517 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:25:30.521 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:25:30.524 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:26:00.654 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:26:00.662 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:26:00.665 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:26:30.798 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:26:30.801 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:26:30.804 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:27:00.941 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:27:00.945 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:27:00.948 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:27:31.153 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:27:31.157 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:27:31.160 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:28:01.346 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:28:01.349 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:28:01.352 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:28:31.516 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:28:31.520 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:28:31.522 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:29:01.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:29:01.723 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:29:01.726 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:29:31.872 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:29:31.876 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:29:31.878 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:30:02.161 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:30:02.164 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:30:02.167 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:30:32.309 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:30:32.313 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:30:32.316 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:31:02.521 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:31:02.525 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:31:02.528 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:31:32.731 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:31:32.734 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:31:32.737 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:32:03.067 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:32:03.070 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:32:03.073 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:32:33.294 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:32:33.299 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:32:33.302 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:33:03.496 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:33:03.500 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:33:03.502 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:33:33.681 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:33:33.685 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:33:33.689 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:34:03.944 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:34:03.948 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:34:03.950 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:34:34.165 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:34:34.168 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:34:34.171 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:35:04.382 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:35:04.385 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:35:04.388 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:35:34.608 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:35:34.612 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:35:34.615 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:36:04.828 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:36:04.831 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:36:04.834 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:36:34.972 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:36:34.976 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:36:34.979 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:37:05.139 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:37:05.142 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:37:05.145 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:37:35.369 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:37:35.372 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:37:35.375 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:38:05.813 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:38:05.817 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:38:05.819 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:38:35.964 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:38:35.968 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:38:35.970 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:39:06.100 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:39:06.105 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:39:06.107 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:39:36.353 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:39:36.357 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:39:36.359 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:40:06.487 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:40:06.491 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:40:06.493 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:40:36.690 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:40:36.693 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:40:36.696 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:41:06.910 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:41:06.914 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:41:06.917 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:41:37.103 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:41:37.107 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:41:37.110 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:42:07.323 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:42:07.329 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:42:07.334 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:42:37.543 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:42:37.547 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:42:37.550 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:43:07.685 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:43:07.688 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:43:07.691 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:43:37.822 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:43:37.827 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:43:37.829 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:44:08.057 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:44:08.061 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:44:08.064 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:44:38.253 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:44:38.257 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:44:38.260 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:45:08.597 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:45:08.600 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:45:08.603 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:45:38.832 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:45:38.835 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:45:38.838 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:46:08.984 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:46:08.989 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:46:08.992 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:46:39.203 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:46:39.206 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:46:39.209 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:47:09.414 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:47:09.419 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:47:09.422 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:47:39.658 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:47:39.661 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:47:39.664 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:48:09.876 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:48:09.880 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:48:09.882 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:48:40.096 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:48:40.099 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:48:40.102 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:49:10.307 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:49:10.310 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:49:10.313 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:49:40.517 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:49:40.520 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:49:40.523 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:50:10.728 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:50:10.732 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:50:10.734 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:50:40.946 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:50:40.950 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:50:40.952 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:51:11.190 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:51:11.195 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:51:11.198 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:51:41.342 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:51:41.345 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:51:41.348 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:52:11.495 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:52:11.499 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:52:11.501 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:52:41.724 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:52:41.727 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:52:41.730 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:53:11.943 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:53:11.946 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:53:11.949 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:53:42.137 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:53:42.140 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:53:42.143 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:54:12.364 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:54:12.367 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:54:12.371 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:54:42.625 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:54:42.629 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:54:42.632 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:55:12.805 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:55:12.809 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:55:12.812 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:55:42.946 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:55:42.950 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:55:42.952 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:56:13.166 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:56:13.170 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:56:13.173 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:56:43.400 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:56:43.404 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:56:43.406 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:57:13.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:57:13.644 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:57:13.647 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:57:43.872 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:57:43.876 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:57:43.879 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:58:14.090 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:58:14.094 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:58:14.097 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:58:44.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:58:44.330 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:58:44.332 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:59:14.529 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:59:14.534 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:59:14.537 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:59:44.747 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:59:44.750 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T11:59:44.754 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:00:15.183 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:00:15.186 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:00:15.189 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:00:45.325 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:00:45.328 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:00:45.331 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:01:15.559 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:01:15.563 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:01:15.566 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:01:45.708 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:01:45.711 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:01:45.716 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:02:16.044 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:02:16.047 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:02:16.050 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:02:46.198 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:02:46.201 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:02:46.204 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:03:16.503 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:03:16.507 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:03:16.510 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:03:46.651 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:03:46.654 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:03:46.656 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:04:17.003 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:04:17.006 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:04:17.009 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:04:47.158 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:04:47.162 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:04:47.165 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:05:17.299 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:05:17.302 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:05:17.305 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:05:47.489 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:05:47.494 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:05:47.497 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:06:17.721 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:06:17.725 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:06:17.730 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:06:47.956 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:06:47.960 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:06:47.963 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:07:18.083 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:07:18.087 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:07:18.089 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:07:48.300 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:07:48.304 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:07:48.307 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:08:18.514 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:08:18.518 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:08:18.520 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:08:48.666 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:08:48.670 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:08:48.672 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:09:18.818 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:09:18.822 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:09:18.824 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:09:49.160 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:09:49.165 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:09:49.167 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:10:19.357 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:10:19.360 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:10:19.363 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:10:49.567 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:10:49.571 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:10:49.573 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:11:19.769 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:11:19.772 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:11:19.775 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:11:50.029 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:11:50.032 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:11:50.035 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:12:20.241 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:12:20.245 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:12:20.248 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:12:50.410 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:12:50.414 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:12:50.417 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:13:20.554 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:13:20.558 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:13:20.561 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:13:50.757 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:13:51.015 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:13:51.018 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:14:21.233 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:14:21.237 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:14:21.240 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:14:51.426 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:14:51.430 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:14:51.433 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:15:21.658 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:15:21.662 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:15:21.664 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:15:51.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:15:51.871 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:15:51.874 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:16:22.094 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:16:22.097 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:16:22.100 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:16:52.296 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:16:52.300 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:16:52.303 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:17:22.531 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:17:22.535 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:17:22.537 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:17:52.735 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:17:52.739 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:17:52.741 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:18:22.946 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:18:22.950 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:18:22.953 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:18:53.147 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:18:53.150 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:18:53.153 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:19:23.317 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:19:23.320 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:19:23.323 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:19:53.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:19:53.522 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:19:53.525 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:20:23.738 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:20:23.742 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:20:23.744 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:20:53.864 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:20:53.868 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:20:53.870 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:21:24.002 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:21:24.005 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:21:24.008 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:21:54.155 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:21:54.158 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:21:54.161 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:22:24.349 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:22:24.354 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:22:24.356 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:22:54.497 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:22:54.500 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:22:54.503 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:23:24.636 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:23:24.640 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:23:24.643 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:23:54.772 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:23:54.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:23:54.778 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:24:25.094 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:24:25.098 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:24:25.100 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:24:55.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:24:55.243 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:24:55.246 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:25:25.387 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:25:25.391 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:25:25.394 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:25:55.532 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:25:55.535 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:25:55.538 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:26:25.712 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:26:25.715 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:26:25.718 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:26:55.844 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:26:55.847 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:26:55.849 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:27:26.008 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:27:26.011 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:27:26.014 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:27:56.304 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:27:56.308 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:27:56.310 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:28:26.453 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:28:26.456 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:28:26.459 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:28:56.587 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:28:56.591 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:28:56.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:29:26.739 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:29:26.742 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:29:26.745 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:29:56.876 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:29:56.880 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:29:56.883 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:30:27.159 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:30:27.163 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:30:27.165 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:30:57.288 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:30:57.292 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:30:57.295 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:31:27.441 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:31:27.445 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:31:27.447 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:31:57.576 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:31:57.580 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:31:57.582 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:32:27.798 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:32:27.802 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:32:27.804 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:32:58.032 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:32:58.035 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:32:58.038 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:33:28.259 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:33:28.263 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:33:28.266 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:33:58.687 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:33:58.690 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:33:58.693 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:34:28.822 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:34:28.826 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:34:28.829 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:34:58.948 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:34:58.951 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:34:58.954 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:35:29.269 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:35:29.273 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:35:29.275 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:35:59.480 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:35:59.484 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:35:59.487 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:36:29.867 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:36:29.870 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:36:29.877 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:37:00.172 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:37:00.176 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:37:00.179 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:37:30.313 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:37:30.317 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:37:30.320 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:38:00.449 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:38:00.453 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:38:00.456 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:38:30.671 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:38:30.675 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:38:30.678 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:39:00.900 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:39:00.904 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:39:00.906 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:39:31.109 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:39:31.114 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:39:31.117 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:40:01.328 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:40:01.331 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:40:01.334 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:40:31.567 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:40:31.571 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:40:31.573 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:41:01.707 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:41:01.710 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:41:01.713 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:41:31.893 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:41:31.897 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:41:31.899 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:42:02.113 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:42:02.117 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:42:02.120 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:42:32.253 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:42:32.257 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:42:32.260 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:43:02.408 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:43:02.412 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:43:02.415 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:43:32.613 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:43:32.617 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:43:32.619 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:44:02.841 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:44:02.845 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:44:02.848 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:44:33.052 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:44:33.056 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:44:33.059 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:45:03.263 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:45:03.266 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:45:03.269 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:45:33.457 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:45:33.460 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:45:33.463 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:46:03.660 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:46:03.663 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:46:03.666 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:46:33.863 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:46:33.866 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:46:33.869 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:47:04.090 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:47:04.093 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:47:04.096 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:47:34.293 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:47:34.297 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:47:34.300 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:48:04.512 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:48:04.515 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:48:04.518 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:48:34.639 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:48:34.642 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:48:34.645 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:49:04.876 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:49:04.879 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:49:04.882 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:49:35.120 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:49:35.124 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:49:35.126 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:50:05.323 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:50:05.326 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:50:05.329 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:50:35.625 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:50:35.629 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:50:35.635 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:51:05.783 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:51:05.787 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:51:05.789 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:51:36.005 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:51:36.009 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:51:36.011 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:52:06.208 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:52:06.212 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:52:06.215 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:52:36.435 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:52:36.439 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:52:36.442 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:53:06.663 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:53:06.666 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:53:06.669 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:53:36.874 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:53:36.878 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:53:36.881 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:54:07.017 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:54:07.021 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:54:07.023 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:54:37.171 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:54:37.175 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:54:37.178 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:55:07.334 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:55:07.338 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:55:07.340 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:55:37.540 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:55:37.543 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:55:37.545 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:56:07.760 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:56:07.764 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:56:07.766 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:56:37.981 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:56:37.984 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:56:37.986 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:57:08.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:57:08.197 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:57:08.200 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:57:38.465 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:57:38.468 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:57:38.471 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:58:08.610 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:58:08.614 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:58:08.617 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:58:38.746 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:58:38.749 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:58:38.752 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:59:09.056 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:59:09.060 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:59:09.062 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:59:39.208 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:59:39.212 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T12:59:39.215 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:00:09.353 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:00:09.356 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:00:09.359 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:00:39.497 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:00:39.503 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:00:39.505 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:01:09.725 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:01:09.729 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:01:09.731 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:01:39.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:01:39.963 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:01:39.968 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:02:10.230 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:02:10.234 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:02:10.236 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:02:40.382 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:02:40.385 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:02:40.388 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:03:10.535 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:03:10.538 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:03:10.540 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:03:40.679 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:03:40.683 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:03:40.686 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:04:10.844 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:04:10.848 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:04:10.850 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:04:40.973 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:04:40.976 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:04:40.979 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:05:11.109 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:05:11.112 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:05:11.115 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:05:41.304 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:05:41.307 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:05:41.310 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:06:11.514 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:06:11.518 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:06:11.520 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:06:41.733 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:06:41.737 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:06:41.739 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:07:11.885 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:07:11.892 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:07:11.895 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:07:42.038 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:07:42.042 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:07:42.044 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:08:12.249 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:08:12.253 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:08:12.256 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:08:42.476 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:08:42.479 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:08:42.482 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:09:12.703 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:09:12.707 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:09:12.709 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:09:42.923 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:09:42.927 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:09:42.930 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:10:13.133 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:10:13.136 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:10:13.139 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:10:43.282 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:10:43.285 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:10:43.288 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:11:13.444 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:11:13.447 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:11:13.450 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:11:43.675 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:11:43.678 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:11:43.681 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:12:13.810 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:12:13.813 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:12:13.816 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:12:44.046 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:12:44.050 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:12:44.053 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:13:14.257 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:13:14.260 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:13:14.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:13:44.467 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:13:44.470 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:13:44.473 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:14:14.670 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:14:14.674 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:14:14.677 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:14:44.888 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:14:44.891 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:14:44.895 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:15:15.023 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:15:15.027 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:15:15.029 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:15:45.234 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:15:45.238 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:15:45.241 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:16:15.387 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:16:15.391 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:16:15.393 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:16:45.533 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:16:45.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:16:45.540 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:17:15.734 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:17:15.737 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:17:15.740 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:17:45.952 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:17:45.955 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:17:45.958 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:18:16.306 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:18:16.309 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:18:16.311 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:18:46.532 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:18:46.537 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:18:46.540 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:19:16.772 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:19:16.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:19:16.778 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:19:47.045 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:19:47.048 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:19:47.051 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:20:17.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:20:17.329 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:20:17.332 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:20:47.542 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:20:47.546 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:20:47.548 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:21:17.772 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:21:17.776 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:21:17.779 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:21:47.916 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:21:47.920 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:21:47.922 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:22:18.233 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:22:18.239 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:22:18.242 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:22:48.403 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:22:48.406 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:22:48.409 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:23:18.700 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:23:18.704 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:23:18.706 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:23:48.917 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:23:48.920 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:23:48.922 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:24:19.192 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:24:19.196 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:24:19.198 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:24:49.423 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:24:49.427 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:24:49.430 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:25:19.742 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:25:19.746 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:25:19.748 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:25:50.025 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:25:50.029 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:25:50.031 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:26:20.238 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:26:20.241 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:26:20.244 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:26:50.397 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:26:50.401 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:26:50.404 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:27:20.619 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:27:20.623 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:27:20.625 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:27:50.881 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:27:50.885 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:27:50.887 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:28:21.103 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:28:21.107 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:28:21.110 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:28:51.318 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:28:51.322 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:28:51.325 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:29:21.528 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:29:21.532 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:29:21.534 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:29:51.855 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:29:51.858 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:29:51.861 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:30:22.083 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:30:22.087 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:30:22.090 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:30:52.301 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:30:52.305 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:30:52.307 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:31:22.544 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:31:22.548 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:31:22.551 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:31:52.690 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:31:52.693 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:31:52.696 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:23.044 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:23.048 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:23.050 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:53.245 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:53.248 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:32:53.251 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:33:23.587 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:33:23.590 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:33:23.593 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:33:53.732 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:33:53.736 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:33:53.740 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:34:23.995 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:34:23.998 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:34:24.001 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:34:54.308 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:34:54.311 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:34:54.314 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:35:24.523 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:35:24.526 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:35:24.529 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:35:54.673 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:35:54.677 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:35:54.680 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:36:24.946 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:36:24.949 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:36:24.952 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:36:55.181 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:36:55.185 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:36:55.187 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:37:25.399 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:37:25.403 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:37:25.406 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:37:55.551 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:37:55.555 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:37:55.558 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:38:25.771 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:38:25.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:38:25.778 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:38:55.964 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:38:55.968 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:38:55.971 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:39:26.166 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:39:26.169 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:39:26.171 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:39:56.436 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:39:56.440 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:39:56.443 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:40:26.654 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:40:26.657 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:40:26.660 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:40:56.849 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:40:56.852 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:40:56.855 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:41:27.085 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:41:27.088 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:41:27.091 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:41:57.234 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:41:57.237 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:41:57.240 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:42:27.375 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:42:27.379 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:42:27.382 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:42:57.533 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:42:57.536 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:42:57.539 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:43:27.684 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:43:27.687 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:43:27.690 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:43:57.896 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:43:57.900 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:43:57.903 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:44:28.116 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:44:28.119 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:44:28.122 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:44:58.510 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:44:58.514 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:44:58.518 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:45:28.737 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:45:28.740 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:45:28.744 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:45:58.892 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:45:58.895 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:45:58.898 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:46:29.033 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:46:29.037 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:46:29.039 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:46:59.178 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:46:59.181 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:46:59.184 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:29.321 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:29.324 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:29.327 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:59.451 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:59.454 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:47:59.457 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:29.668 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:29.672 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:29.674 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:59.896 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:59.900 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:48:59.903 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:49:30.047 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:49:30.051 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:49:30.054 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:00.287 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:00.290 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:00.293 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:30.417 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:30.421 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:50:30.424 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:00.614 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:00.621 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:00.623 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:30.824 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:30.828 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:51:30.831 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:01.044 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:01.048 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:01.051 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:31.205 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:31.208 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:52:31.211 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:01.340 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:01.343 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:01.346 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:31.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:31.479 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:53:31.481 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:01.713 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:01.716 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:01.719 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:31.906 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:31.910 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:54:31.912 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:02.109 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:02.113 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:02.115 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:32.256 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:32.259 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:55:32.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:02.427 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:02.431 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:02.433 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:32.574 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:32.578 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:56:32.580 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:02.710 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:02.714 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:02.716 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:32.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:32.941 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:57:32.944 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:03.114 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:03.117 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:03.120 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:33.268 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:33.272 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:58:33.274 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:03.502 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:03.505 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:03.508 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:33.730 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:33.734 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T13:59:33.736 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:03.940 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:03.943 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:03.946 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:34.076 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:34.080 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:00:34.083 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:04.226 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:04.229 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:04.232 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:34.389 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:34.393 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:01:34.396 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:02:04.609 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:02:04.613 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:02:04.615 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:02:34.819 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:02:34.823 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:02:34.826 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:03:05.038 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:03:05.042 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:03:05.044 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:03:35.257 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:03:35.261 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:03:35.263 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:04:05.460 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:04:05.464 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:04:05.467 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:04:35.662 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:04:35.665 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:04:35.668 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:05:05.890 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:05:05.893 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:05:05.896 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:05:36.100 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:05:36.104 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:05:36.106 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:06:06.303 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:06:06.307 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:06:06.310 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:06:36.514 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:06:36.517 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:06:36.520 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:07:06.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:07:06.646 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:07:06.649 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:07:36.835 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:07:36.839 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:07:36.842 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:08:06.988 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:08:06.992 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:08:06.995 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:08:37.207 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:08:37.210 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:08:37.213 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:09:07.351 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:09:07.355 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:09:07.357 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:09:37.538 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:09:37.541 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:09:37.544 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:10:07.765 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:10:07.768 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:10:07.771 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:10:37.984 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:10:37.989 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:10:37.993 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:11:08.338 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:11:08.341 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:11:08.343 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:11:38.541 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:11:38.545 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:11:38.548 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:12:08.752 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:12:08.755 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:12:08.758 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:12:38.969 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:12:38.972 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:12:38.975 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:13:09.189 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:13:09.192 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:13:09.195 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:13:39.425 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:13:39.428 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:13:39.431 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:14:09.627 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:14:09.630 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:14:09.633 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:14:39.771 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:14:39.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:14:39.778 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:15:09.990 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:15:09.993 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:15:09.995 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:15:40.137 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:15:40.141 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:15:40.144 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:16:10.269 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:16:10.272 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:16:10.275 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:16:40.465 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:16:40.468 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:16:40.471 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:17:10.725 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:17:10.729 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:17:10.731 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:17:40.929 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:17:40.932 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:17:40.935 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:18:11.147 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:18:11.151 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:18:11.153 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:18:41.286 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:18:41.290 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:18:41.293 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:19:11.494 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:19:11.497 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:19:11.500 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:19:41.629 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:19:41.633 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:19:41.636 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:20:11.840 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:20:11.843 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:20:11.846 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:20:42.060 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:20:42.063 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:20:42.066 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:21:12.363 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:21:12.366 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:21:12.368 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:21:42.564 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:21:42.568 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:21:42.570 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:22:12.759 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:22:12.763 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:22:12.766 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:22:42.978 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:22:42.981 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:22:42.984 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:23:13.124 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:23:13.128 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:23:13.130 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:23:43.267 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:23:43.271 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:23:43.273 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:24:13.477 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:24:13.480 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:24:13.483 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:24:43.619 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:24:43.623 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:24:43.625 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:25:13.849 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:25:13.853 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:25:13.856 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:25:44.068 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:25:44.071 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:25:44.075 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:26:14.279 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:26:14.283 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:26:14.286 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:26:44.454 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:26:44.458 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:26:44.460 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:27:14.591 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:27:14.595 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:27:14.598 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:27:44.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:27:44.722 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:27:44.724 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:28:14.859 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:28:14.863 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:28:14.866 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:28:45.091 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:28:45.094 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:28:45.097 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:29:15.313 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:29:15.317 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:29:15.320 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:29:45.529 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:29:45.533 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:29:45.535 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:30:15.748 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:30:15.752 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:30:15.754 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:30:45.958 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:30:45.962 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:30:45.964 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:31:16.178 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:31:16.181 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:31:16.184 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:31:46.330 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:31:46.334 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:31:46.336 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:32:16.481 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:32:16.484 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:32:16.487 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:32:46.709 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:32:46.713 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:32:46.716 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:33:16.929 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:33:16.933 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:33:16.936 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:33:47.130 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:33:47.133 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:33:47.136 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:34:17.350 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:34:17.353 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:34:17.356 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:34:47.570 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:34:47.574 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:34:47.577 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:35:17.796 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:35:17.800 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:35:17.803 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:35:48.025 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:35:48.029 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:35:48.032 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:36:18.234 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:36:18.237 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:36:18.240 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:36:48.437 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:36:48.440 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:36:48.443 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:37:18.655 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:37:18.658 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:37:18.661 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:37:48.859 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:37:48.864 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:37:48.867 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:38:19.085 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:38:19.089 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:38:19.091 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:38:49.287 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:38:49.290 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:38:49.293 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:39:19.439 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:39:19.443 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:39:19.446 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:39:49.876 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:39:49.879 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:39:49.881 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:40:20.104 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:40:20.108 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:40:20.111 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:40:50.256 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:40:50.259 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:40:50.262 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:41:20.404 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:41:20.408 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:41:20.410 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:41:50.620 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:41:50.623 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:41:50.626 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:42:20.760 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:42:20.764 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:42:20.767 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:42:50.899 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:42:50.903 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:42:50.906 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:43:21.045 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:43:21.048 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:43:21.050 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:43:51.198 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:43:51.201 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:43:51.203 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:44:21.352 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:44:21.355 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:44:21.358 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:44:51.499 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:44:51.502 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:44:51.505 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:45:21.645 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:45:21.649 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:45:21.652 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:45:51.815 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:45:51.819 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:45:51.821 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:46:21.961 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:46:21.965 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:46:21.967 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:46:52.115 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:46:52.118 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:46:52.121 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:47:22.257 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:47:22.261 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:47:22.264 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:47:52.489 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:47:52.492 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:47:52.495 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:48:22.632 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:48:22.637 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:48:22.640 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:48:52.781 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:48:52.784 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:48:52.787 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:49:22.995 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:49:22.999 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:49:23.002 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:49:53.139 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:49:53.142 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:49:53.145 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:50:23.293 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:50:23.297 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:50:23.299 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:50:53.456 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:50:53.459 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:50:53.462 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:51:23.605 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:51:23.608 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:51:23.611 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:51:53.756 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:51:53.759 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:51:53.762 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:52:23.909 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:52:23.913 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:52:23.915 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:52:54.111 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:52:54.115 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:52:54.118 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:53:24.334 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:53:24.337 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:53:24.340 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:53:54.528 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:53:54.531 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:53:54.533 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:54:24.745 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:54:24.748 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:54:24.751 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:54:54.955 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:54:54.958 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:54:54.961 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:55:25.174 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:55:25.177 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:55:25.180 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:55:55.355 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:55:55.361 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:55:55.364 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:56:25.511 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:56:25.514 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:56:25.517 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:56:55.723 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:56:55.726 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:56:55.729 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:57:25.933 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:57:25.936 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:57:25.938 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:57:56.119 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:57:56.122 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:57:56.125 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:58:26.331 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:58:26.334 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:58:26.336 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:58:56.548 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:58:56.552 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:58:56.555 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:59:26.785 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:59:26.788 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:59:26.791 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:59:56.969 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:59:56.972 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T14:59:56.975 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:00:27.164 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:00:27.167 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:00:27.170 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:00:57.383 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:00:57.386 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:00:57.389 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:01:27.610 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:01:27.614 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:01:27.616 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:01:57.824 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:01:57.827 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:01:57.830 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:02:28.059 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:02:28.062 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:02:28.065 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:02:58.270 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:02:58.273 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:02:58.276 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:03:28.481 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:03:28.485 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:03:28.487 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:03:58.633 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:03:58.637 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:03:58.640 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:04:28.836 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:04:28.839 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:04:28.841 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:04:59.038 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:04:59.042 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:04:59.044 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:05:29.274 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:05:29.278 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:05:29.281 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:05:59.408 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:05:59.412 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:05:59.414 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:06:29.637 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:06:29.641 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:06:29.643 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:06:59.848 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:06:59.852 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:06:59.858 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:07:30.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:07:30.088 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:07:30.092 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:08:00.322 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:08:00.326 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:08:00.328 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:08:30.465 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:08:30.469 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:08:30.471 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:09:00.632 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:09:00.635 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:09:00.638 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:09:30.827 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:09:30.831 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:09:30.833 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:10:01.072 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:10:01.077 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:10:01.081 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:10:31.298 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:10:31.301 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:10:31.304 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:11:01.509 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:11:01.512 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:11:01.515 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:11:31.737 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:11:31.740 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:11:31.743 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:12:01.948 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:12:01.951 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:12:01.954 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:12:32.158 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:12:32.162 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:12:32.165 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:13:02.308 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:13:02.312 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:13:02.315 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:13:32.462 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:13:32.465 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:13:32.467 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:14:02.667 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:14:02.670 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:14:02.673 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:14:32.893 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:14:32.896 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:14:32.899 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:15:03.088 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:15:03.092 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:15:03.094 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:15:33.299 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:15:33.302 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:15:33.304 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:16:03.433 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:16:03.437 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:16:03.439 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:16:33.579 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:16:33.583 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:16:33.586 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:17:03.714 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:17:03.717 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:17:03.720 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:17:33.926 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:17:33.929 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:17:33.933 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:18:04.162 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:18:04.165 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:18:04.168 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:18:34.305 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:18:34.308 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:18:34.311 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:19:04.518 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:19:04.522 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:19:04.525 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:19:34.661 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:19:34.664 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:19:34.666 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:20:04.800 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:20:04.803 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:20:04.805 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:20:34.945 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:20:34.948 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:20:34.951 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:21:05.083 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:21:05.086 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:21:05.089 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:21:35.229 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:21:35.232 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:21:35.235 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:22:05.367 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:22:05.370 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:22:05.373 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:22:35.503 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:22:35.506 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:22:35.508 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:23:05.651 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:23:05.654 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:23:05.657 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:23:35.880 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:23:35.884 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:23:35.888 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:24:06.024 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:24:06.027 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:24:06.029 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:24:36.179 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:24:36.183 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:24:36.185 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:25:06.314 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:25:06.318 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:25:06.321 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:25:36.543 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:25:36.547 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:25:36.549 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:26:06.746 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:26:06.749 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:26:06.752 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:26:36.903 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:26:36.907 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:26:36.909 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:27:07.050 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:27:07.053 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:27:07.055 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:27:37.187 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:27:37.191 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:27:37.194 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:28:07.397 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:28:07.400 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:28:07.403 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:28:37.633 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:28:37.636 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:28:37.639 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:29:07.783 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:29:07.786 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:29:07.789 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:29:38.014 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:29:38.017 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:29:38.020 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:30:08.409 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:30:08.412 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:30:08.414 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:30:38.558 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:30:38.561 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:30:38.564 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:31:08.772 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:31:08.776 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:31:08.778 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:31:38.991 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:31:38.994 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:31:38.997 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:32:09.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:32:09.197 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:32:09.200 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:32:39.404 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:32:39.408 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:32:39.410 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:33:09.639 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:33:09.643 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:33:09.647 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:33:39.853 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:33:39.857 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:33:39.860 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:34:10.010 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:34:10.014 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:34:10.016 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:34:40.280 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:34:40.283 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:34:40.286 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:35:10.414 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:35:10.418 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:35:10.421 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:35:40.568 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:35:40.572 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:35:40.574 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:36:10.706 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:36:10.710 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:36:10.712 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:36:40.906 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:36:40.911 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:36:40.914 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:37:11.125 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:37:11.128 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:37:11.131 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:37:41.274 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:37:41.278 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:37:41.281 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:38:11.433 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:38:11.437 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:38:11.439 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:38:41.574 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:38:41.577 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:38:41.580 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:39:11.793 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:39:11.797 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:39:11.799 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:39:42.029 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:39:42.032 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:39:42.035 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:40:12.247 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:40:12.250 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:40:12.253 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:40:42.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:40:42.479 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:40:42.482 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:41:12.621 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:41:12.624 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:41:12.627 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:41:42.755 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:41:42.758 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:41:42.760 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:42:12.905 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:42:12.908 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:42:12.911 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:42:43.117 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:42:43.121 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:42:43.123 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:43:13.354 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:43:13.357 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:43:13.360 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:43:43.506 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:43:43.509 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:43:43.512 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:44:13.650 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:44:13.656 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:44:13.658 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:44:43.810 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:44:43.814 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:44:43.816 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:45:13.954 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:45:13.957 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:45:13.960 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:45:44.166 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:45:44.170 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:45:44.172 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:46:14.542 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:46:14.549 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:46:14.551 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:46:44.700 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:46:44.704 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:46:44.706 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:47:14.855 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:47:14.858 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:47:14.860 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:47:45.057 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:47:45.061 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:47:45.067 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:48:15.268 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:48:15.271 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:48:15.274 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:48:45.487 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:48:45.490 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:48:45.493 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:49:15.698 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:49:15.702 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:49:15.705 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:49:45.842 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:49:45.845 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:49:45.847 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:50:15.967 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:50:15.970 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:50:15.973 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:50:46.181 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:50:46.185 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:50:46.189 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:51:16.390 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:51:16.393 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:51:16.396 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:51:46.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:51:46.589 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:51:46.592 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:52:16.795 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:52:16.799 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:52:16.806 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:52:47.031 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:52:47.035 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:52:47.037 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:53:17.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:53:17.238 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:53:17.241 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:53:47.453 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:53:47.457 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:53:47.459 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:54:17.655 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:54:17.658 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:54:17.661 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:54:47.841 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:54:47.845 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:54:47.848 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:55:17.990 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:55:17.997 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:55:18.000 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:55:48.146 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:55:48.150 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:55:48.152 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:56:18.314 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:56:18.318 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:56:18.320 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:56:48.466 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:56:48.469 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:56:48.472 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:57:18.606 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:57:18.609 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:57:18.612 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:57:48.743 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:57:48.747 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:57:48.749 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:58:18.883 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:58:18.887 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:58:18.890 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:58:49.035 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:58:49.038 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:58:49.041 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:59:19.181 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:59:19.185 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:59:19.188 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:59:49.333 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:59:49.337 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T15:59:49.341 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:00:19.474 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:00:19.478 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:00:19.480 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:00:49.628 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:00:49.633 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:00:49.635 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:01:19.799 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:01:19.803 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:01:19.806 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:01:49.934 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:01:49.937 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:01:49.941 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:02:20.154 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:02:20.158 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:02:20.160 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:02:50.439 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:02:50.443 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:02:50.445 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:03:20.574 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:03:20.577 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:03:20.580 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:03:50.786 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:03:50.790 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:03:50.792 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:04:20.988 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:04:20.992 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:04:20.994 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:04:51.149 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:04:51.152 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:04:51.154 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:05:21.287 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:05:21.290 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:05:21.293 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:05:51.437 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:05:51.441 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:05:51.446 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:06:21.607 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:06:21.611 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:06:21.613 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:06:51.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:06:51.744 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:06:51.747 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:07:21.891 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:07:21.895 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:07:21.898 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:07:52.030 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:07:52.034 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:07:52.036 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:08:22.176 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:08:22.180 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:08:22.183 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:08:52.337 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:08:52.341 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:08:52.343 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:09:22.470 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:09:22.474 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:09:22.477 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:09:52.606 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:09:52.609 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:09:52.612 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:10:22.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:10:22.743 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:10:22.746 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:10:52.882 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:10:52.886 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:10:52.888 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:11:23.020 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:11:23.024 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:11:23.026 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:11:53.166 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:11:53.170 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:11:53.172 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:12:23.300 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:12:23.303 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:12:23.306 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:12:53.438 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:12:53.441 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:12:53.444 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:13:23.573 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:13:23.578 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:13:23.580 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:13:53.725 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:13:53.728 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:13:53.731 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:23.855 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:23.859 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:23.862 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:54.080 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:54.084 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:14:54.087 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:24.241 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:24.246 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:24.248 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:54.452 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:54.455 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:15:54.458 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:24.679 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:24.683 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:24.686 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:55.056 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:55.059 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:16:55.062 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:25.275 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:25.281 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:25.283 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:55.487 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:55.490 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:17:55.493 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:25.817 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:25.820 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:25.823 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:56.024 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:56.028 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:18:56.030 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:26.167 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:26.171 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:26.173 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:56.324 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:56.327 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:19:56.330 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:20:26.539 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:20:26.543 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:20:26.545 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:20:56.759 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:20:56.762 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:20:56.765 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:21:26.994 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:21:26.998 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:21:27.000 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:21:57.164 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:21:57.167 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:21:57.170 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:22:27.366 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:22:27.370 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:22:27.372 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:22:57.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:22:57.588 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:22:57.591 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:23:27.796 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:23:27.801 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:23:27.803 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:23:58.023 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:23:58.027 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:23:58.029 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:24:28.260 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:24:28.263 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:24:28.266 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:24:58.536 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:24:58.539 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:24:58.542 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:25:28.713 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:25:28.716 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:25:28.719 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:25:58.932 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:25:58.936 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:25:58.939 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:26:29.160 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:26:29.163 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:26:29.165 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:26:59.363 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:26:59.367 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:26:59.370 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:27:29.531 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:27:29.535 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:27:29.538 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:27:59.698 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:27:59.702 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:27:59.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:28:29.837 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:28:29.840 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:28:29.842 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:29:00.072 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:29:00.076 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:29:00.078 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:29:30.291 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:29:30.295 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:29:30.298 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:30:00.443 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:30:00.446 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:30:00.449 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:30:30.594 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:30:30.598 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:30:30.600 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:31:00.752 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:31:00.755 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:31:00.758 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:31:30.893 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:31:30.900 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:31:30.907 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:32:01.043 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:32:01.047 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:32:01.050 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:32:31.169 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:32:31.173 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:32:31.175 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:33:01.306 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:33:01.309 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:33:01.312 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:33:31.442 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:33:31.446 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:33:31.448 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:34:01.595 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:34:01.599 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:34:01.603 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:34:31.747 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:34:31.750 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:34:31.752 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:35:01.883 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:35:01.886 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:35:01.889 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:35:32.018 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:35:32.021 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:35:32.024 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:36:02.153 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:36:02.157 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:36:02.160 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:36:32.297 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:36:32.301 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:36:32.303 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:37:02.441 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:37:02.444 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:37:02.447 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:37:32.628 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:37:32.632 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:37:32.635 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:38:02.771 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:38:02.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:38:02.777 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:38:33.007 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:38:33.010 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:38:33.013 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:39:03.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:39:03.330 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:39:03.333 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:39:33.475 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:39:33.478 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:39:33.481 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:40:03.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:40:03.701 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:40:03.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:40:33.861 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:40:33.865 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:40:33.868 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:41:04.030 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:41:04.034 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:41:04.037 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:41:34.162 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:41:34.165 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:41:34.168 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:42:04.304 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:42:04.307 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:42:04.310 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:42:34.684 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:42:34.687 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:42:34.690 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:43:04.895 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:43:04.898 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:43:04.901 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:43:35.052 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:43:35.056 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:43:35.058 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:44:05.199 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:44:05.203 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:44:05.205 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:44:35.418 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:44:35.421 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:44:35.424 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:45:05.654 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:45:05.657 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:45:05.660 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:45:35.864 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:45:35.868 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:45:35.870 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:46:06.083 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:46:06.086 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:46:06.089 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:46:36.288 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:46:36.291 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:46:36.294 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:47:06.488 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:47:06.491 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:47:06.494 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:47:36.707 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:47:36.710 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:47:36.713 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:48:06.935 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:48:06.939 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:48:06.942 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:48:37.087 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:48:37.091 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:48:37.094 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:49:07.222 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:49:07.225 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:49:07.228 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:49:37.376 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:49:37.379 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:49:37.382 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:50:07.578 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:50:07.581 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:50:07.584 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:50:37.782 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:50:37.789 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:50:37.792 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:51:08.008 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:51:08.011 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:51:08.014 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:51:38.210 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:51:38.214 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:51:38.217 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:52:08.413 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:52:08.417 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:52:08.420 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:52:38.557 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:52:38.561 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:52:38.569 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:53:08.794 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:53:08.798 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:53:08.800 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:53:38.987 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:53:38.990 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:53:38.993 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:54:09.130 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:54:09.133 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:54:09.136 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:54:39.287 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:54:39.291 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:54:39.293 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:55:09.431 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:55:09.434 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:55:09.437 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:55:39.588 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:55:39.591 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:55:39.594 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:56:09.741 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:56:09.744 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:56:09.747 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:56:39.951 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:56:39.954 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:56:39.957 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:57:10.153 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:57:10.157 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:57:10.159 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:57:40.357 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:57:40.360 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:57:40.363 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:58:10.583 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:58:10.586 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:58:10.589 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:58:40.802 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:58:40.806 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:58:40.808 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:59:11.013 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:59:11.016 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:59:11.019 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:59:41.232 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:59:41.236 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T16:59:41.239 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:00:11.368 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:00:11.371 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:00:11.373 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:00:41.504 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:00:41.508 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:00:41.510 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:01:11.723 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:01:11.726 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:01:11.729 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:01:41.951 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:01:41.955 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:01:41.959 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:02:12.169 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:02:12.173 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:02:12.176 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:02:42.313 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:02:42.316 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:02:42.319 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:03:12.517 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:03:12.521 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:03:12.525 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:03:42.710 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:03:42.713 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:03:42.716 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:04:12.846 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:04:12.852 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:04:12.855 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:04:42.980 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:04:42.983 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:04:42.986 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:05:13.109 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:05:13.113 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:05:13.115 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:05:43.244 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:05:43.248 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:05:43.251 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:06:13.473 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:06:13.476 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:06:13.478 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:06:43.708 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:06:43.711 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:06:43.714 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:07:13.927 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:07:13.930 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:07:13.933 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:07:44.062 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:07:44.065 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:07:44.067 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:08:14.390 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:08:14.394 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:08:14.397 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:08:44.559 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:08:44.563 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:08:44.565 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:09:14.701 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:09:14.704 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:09:14.707 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:09:44.853 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:09:44.857 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:09:44.860 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:10:15.057 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:10:15.060 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:10:15.062 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:10:45.260 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:10:45.264 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:10:45.266 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:11:15.412 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:11:15.415 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:11:15.418 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:11:45.649 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:11:45.653 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:11:45.656 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:12:15.861 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:12:15.864 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:12:15.867 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:12:46.055 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:12:46.058 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:12:46.061 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:13:16.257 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:13:16.261 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:13:16.264 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:13:46.412 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:13:46.415 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:13:46.417 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:14:16.653 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:14:16.657 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:14:16.659 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:14:46.788 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:14:46.792 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:14:46.795 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:15:16.942 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:15:16.945 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:15:16.948 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:15:47.077 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:15:47.081 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:15:47.083 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:16:17.287 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:16:17.291 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:16:17.295 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:16:47.490 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:16:47.493 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:16:47.495 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:17:17.726 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:17:17.730 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:17:17.733 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:17:47.877 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:17:47.881 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:17:47.883 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:18:18.096 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:18:18.100 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:18:18.102 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:18:48.324 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:18:48.327 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:18:48.330 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:19:18.526 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:19:18.529 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:19:18.532 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:19:48.670 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:19:48.674 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:19:48.677 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:20:18.822 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:20:18.826 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:20:18.829 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:20:48.970 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:20:48.973 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:20:48.976 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:21:19.116 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:21:19.120 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:21:19.122 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:21:49.347 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:21:49.350 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:21:49.352 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:22:19.591 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:22:19.594 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:22:19.597 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:22:49.732 DEBUG:teuthology.orchestra.run.smithi120:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:22:49.736 DEBUG:teuthology.orchestra.run.smithi155:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:22:49.738 DEBUG:teuthology.orchestra.run.smithi188:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:22:51.949 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-12-19T17:22:51.949 DEBUG:teuthology.task.console_log:Killing console logger for smithi120 2023-12-19T17:22:51.950 DEBUG:teuthology.task.console_log:Killing console logger for smithi155 2023-12-19T17:22:51.950 DEBUG:teuthology.task.console_log:Killing console logger for smithi188 2023-12-19T17:22:51.951 DEBUG:teuthology.exit:Finished running handlers